This piece appeared in the Times Higher Educational Supplement in 2006.

More years ago than I care to remember, I edited the famous philosophy journal Mind. With the arrogance of relative youth, I and a colleague did most of the refereeing ourselves. When we asked for outside evaluations, we found it gave us two things to referee instead of one, so we kept them to a minimum. I expect we made mistakes: unjust rejections, certainly, since 90% of submissions were rejected. Perhaps occasional inept acceptances, but then we only had to determine whether something was publishable or not. Getting that right was hard enough.

Now we live in braver or brasher times. Behold the philosophy criteria for the upcomng RAE exercise. Work that has passed editors and referees (and, amazingly, also work that is just plonked on the web) is now to be divided into no less than five categories of merit. The best four of these get stars, since as in infant school even poor marks come with a star, perhaps in different colours, from gold down to brown. With antennae tuned beyond anything I could have dreamed of, the heroic sub-panel will tell, for instance, whether work ‘is or ought to be a primary point of reference in its field’ (4*, the top) or whether it merely ‘is or ought to be a point of reference in its field’ (only 3*, poor enough to lose your department funding). Since the deletion of the word ‘primary’ does not tell us very much, 4* and 3* are further explained as firstly ‘a contribution of which every serious worker in that field is or ought to be aware’ versus secondly ‘a contribution of which serious workers in that field are or ought to be aware’. Look again if you do not spot the difference. It is that between ‘a tail is something of which every serious dog should be possessed (4*)’ as opposed to ‘a tail is something of which serious dogs should be possessed (3*)’. Subtle, no? Imagine the argument:

“We are agreed that serious workers ought to know of this. But every serious worker? I think not, Mr. Chairman: I believe it is permissible for Professor Dotterel not to know of this, since, although he is indeed a serious worker, he is also excused by being blind/too poor to afford the journal/web illiterate/dying/a genius/working on different problems/a monolingual Basque”.

“I agree, Dr. Youngturk; it’s only 3*. Pity about the department’s cash”.

Myself, I am lost in amazement at the nose, the palate, the infinitely sensitive proboscis, not to mention the gift of prophecy, that each of these sub-panellists must boast. Then there is the speed at which their tastebuds have to work! Given the avalanche that will fall on them I imagine they will have about ten minutes to perform these exquisite discriminations on each submission, although doubters are earnestly assured that everything will be read (including, presumably, books—they are just read very, very fast).

In fact, our sub-panel is generous with reassurances, no doubt through a very natural desire to expiate the guilt of collaborating with this lunacy. It also reassures us all that ‘4* is a realistic and attainable grade’, so its official words cannot really mean what they say. In amongst the 4* management-speak encomia for team building and research environments we also find with gratitude that “the sub-panel is aware that research of high quality is very often carried out by individual scholars”. Phew! A close call then for Plato, Leibniz, Hume, Kant, Wittgenstein and all the rest! They just squeak in, although whether in their own time they would have done so at the 1*, 2*, 3*, or 4* level might puzzle us to say. Well, actually it would not, since most of them fail the need to show four “outputs” every six years, perhaps because they had better things to think about, and would therefore have come in unclassified, right at the bottom, without even a brown star. Of course, you can argue that with some version of the RAE in place they would have produced a constant stream of little masterpieces, one every eighteen months, regular like nanny says, but it does not seem very likely, and even if they had, their managerially-minded contemporaries might still have stuck them with those brown stars, because, like creative art, as often as not great and even good philosophy only slowly creates the sensibilities by which it gets recognized.

So here we are, rewarded on how well we fit whichever shape of bed Dr Youngturk thinks appropriate. A strange place to end up for an activity whose only true practitioners, according to Socrates in the Phaedrus, are those sincerely able to argue that their own writings are of little worth. But then, what kind of star would Socrates have got? He never wrote a thing. No measurable output at all. Rubbish.