"There are no such things as numbers"
The most exciting essay I've read so far this year: Paul Benacerraf, "What numbers could not be," Philosophical Review 74 (1965), reprinted in Benacerraf and Putnam, eds., Philosophy of Mathematics: Selected Readings (Cambridge UP, 1983). This was the essay that spurred the development of the first new position in the philosophy of mathematics - structuralism - since the debates on the foundation of mathematics in the early 20th century. Some stand-up-and-cheer goodness:
...that any recursive sequence whatever would do suggests that what is important is not the individuality of each element but the structure which they jointly exhibit..."Objects" do not do the job of numbers singly; the whole system performs the job or nothing does. I therefore argue, extending the argument that led to the conclusion that numbers could not be sets, that numbers could not be objects at all; for there is no more reason to identify any individual number with any one particular object than with any other (not already known to be a number). ...
[N]umbers are not objects at all, because in giving the properties (that is, necessary and sufficient) of numbers you merely characterize an abstract structure - and the distinction lies in the fact that the "elements" of the structure have no properties other than those relating them to other "elements" of the same structure....Any object can play the role of 3; that is, any object can be the third element in some progression. What is peculiar to 3 is that it defines that role - not by being a paradigm of any object which plays it, but by representing the relation that any third member of a progression bears to the rest of the progression. Arithmetic is therefore the science that elaborates the abstract structure that all progressions have in common merely in virtue of being progressions.
Benacerraf is positioned against not only Fregean logicism, but also classical platonism; and he claims at the end to explain "what the ordinary formalist apparently cannot - why these axioms were chosen [in the first place]". I will go read Stewart Shapiro's book on structuralism and let you know what happens.
People. And their brains!