THE Adjectival Hyperbole

Times Higher Education (THE) has always had, or tried to have, a good opinion of itself and its rankings.

A perennial highlight of the ranking season is the flurry of adjectives used by THE to describe its summits (prestigious, exclusive) and the rankings and their methodology. Here is a selection:

"the sharper, deeper insights revealed by our new and more rigorous world rankings"

"Robust, transparent and sophisticated"

"the most comprehensive and sophisticated exercise ever undertaken to provide transparent, rigorous and genuinely meaningful global-performance"

"the most comprehensive, sophisticated and balanced global rankings in the world."

"a dramatically improved ranking system"

"our dramatic innovations"

"our tried, trusted and comprehensive combination of 13 performance indicators remains in place, with the same carefully calibrated weightings" 

"our most comprehensive, inclusive and insightful World University Rankings to date"

The problem is that if the rankings are so robust and sophisticated then what is the point of a dramatic improvement? If there is a dramatic improvement one year is there a need for more dramatic improvements in the next? And are there no limits to the rigor of the methodology and the sharpness and depth of the insights?

Why are university bosses paid so much?

Times Higher Education (THE) has an article by Ellie Bothwell about the earnings of university heads in the USA and the UK. The US data is from the Chronicle of Higher Education.

The sums paid are in some cases extraordinary. Maybe Lee Bollinger of Columbia deserves $4,615,230 but $1,634,000 for the head of Tulane?

On the other side of the Atlantic the biggest earner is the head of Nottingham Trent University. To the lay reader that makes as much sense as the manager of Notts County or Plymouth Argyle outearning Manchester City or Chelsea.

THE argues that there is little correlation between the salaries of the top earning twenty American and British university heads and university prestige as measured by position in the overall THE world rankings.

It would actually be very surprising if a large correlation were found since there is an obvious restriction of range effect if only the top 20 are considered. If we looked at the entire spectrum of salaries we would almost certainly get a much greater correlation. I suspect that THE is trying to deflect criticism that its rankings measure wealth and age rather than genuine quality.

THE do not give any numbers so I have calculated the correlation between the salaries of the US heads and overall scores in the brand name rankings. Maybe I'll get round to the British salaries next week.

The Pearson correlation coefficient between the salaries of the 20 most highly paid university heads in the US and overall THE world rankings scores is only .259, which is not statistically  significant.

The correlation is greater when we compare salaries with the US News (USN) America's Best Colleges and the Shanghai Academic Ranking of World Universities. The top 20 US salaries have a .362 correlation with the overall scores in the 2015 America's Best Colleges (not significant) and .379 (significant at the 0.05 level [1 tailed]) with the total scores in the 2015 ARWU.

That suggests that American university heads are recruited with the object of doing well in the things that count in the USN rankings and more so in the Shanghai rankings. Or perhaps that the THE rankings are not so good at measuring the things that the heads are supposed to do.

Of course, if we looked at the whole range of university salaries and university quality there would probably be different results.

By the way, there is almost zero correlation between the top 20 salaries and university size as measured by the number of students.

Not as Elite as They Thought

British higher education is very definitely not a flat system. There is an enormous difference between Oxford or LSE and the University of Bolton or the University of East London in terms of research output and quality, graduate outcomes, public perceptions, student attributes and just about anything else you could think of.

The most obvious dividing line in the UK university world is between the post-1992 and pre-1992 universities. The former were mostly polytechnics run by local authorities that did not award their own degrees, provided sub-degree courses and did little research.

Another line was drawn in 1994. Named after the hotel (only four stars but it is "old", "famous", "grand" and "impressive") where the inaugural meeting was held, the Russell Group now has 24 members, including of course Oxford and Cambridge, and claims to include only elite research intensive universities. Definitely no riff-raff.



The home page of the group gives a good idea of its priorities:

Our universities are global leaders in research, but it is vital they receive sufficient funding and support

A high-quality, research-led education requires proper funding at both undergraduate and postgraduate level

Collaboration with business is a key part of the work of our universities but Government could foster more innovation

Our universities are global businesses competing for staff, students and funding with the best in the world.

Like all good clubs, membership is not cheap. In 2012 the Universities of Durham, Exeter and York and Queen Mary College University of London paid  £500,000 apiece to join.

They may have been wasting their money.

A paper by Vikki Boliver of Durham University, whose research does not appear to have received any sort of funding, finds that analysis of data on research activity, teaching quality, economic resources, academic selectivity and socioeconomic student mix reveals four tiers within UK tertiary education. They are:

• A very small premier league composed of Oxford and Cambridge
• A second tier composed of 22 members of the Russell Group plus 17 of the other old universities -- the first three alphabetically are  Aberdeen, Bath and Birmingham
• A third tier with 13 old and 54 post-1992 universities -- starting with Abertaye, Aberystwyth, and University of the Arts Bournemouth
• A fourth tier 4 of  19 post-1992  universities -- starting with Anglia Ruskin,  Bishop Grosseteste and University College Birmingham.

It looks like some of the Russell Group are in danger of descending into the abyss of the Tier Three riff-raff.

Incidentally, taking a look at the well known world  rankings, the US News Best Global Universities has a gap of 12 places between Cambridge, second of the Tier 1 universities, and Imperial College, best of the Tier 2 schools.

The Shanghai rankings similarly have a gap of ten places between Oxford and University College London.

But there are only four places in the THE World University Rankings between Cambridge and Imperial and one between Oxford and UCL in the QS world rankings.

Another finding is that the differences between teaching quality in the old and new universities are relatively minor compared to the amount and impact of research.

Does that explain why the Russell Group are so hostile to initiatives like AHELO and U-Multirank?