What Global Rankings Ignore
(at least some of them)

Inside Higher Ed has an article by Indira Samarasekera, president and vice-chancellor of the University of Alberta, that voices some fairly conventional complaints about international university rankings. She has some praise for two of the rankers:

"The problems with national and international rankings are numerous and well known. So well known, in fact, that the world’s most powerful ranking organizations — the World’s Best Universities Rankings conducted by U.S. News & World Report in partnership with Quacquarelli Symonds and the Times Higher Education Rankings — have been working diligently to revise ranking measures and their methods in an attempt to increase the accuracy and objectivity of the rankings.

It should be pointed out that U.S. News & World report does not conduct any world rankings: it just publishes those prepared by QS. And I wonder how successful those diligent attempts will be.

She goes on:

"From my perspective, rankings are also missing the mark by failing to shine a light on some of the most significant benefits that universities bring to local, national and global societies. The focus of most rankings is on academic research outputs — publications, citations and major awards — that stand in as proxies for research quality and reach. While these outputs do a fairly good job of pinpointing the impact of a university’s contributions to knowledge, especially in science, technology, engineering and health sciences, they provide little indication of what kind of impact these advancements have on factors that the global community generally agrees are markers of prosperous and secure societies with a high quality of life.

Let me give you an example of what I mean: governments and policy makers everywhere now consider universities as economic engines as well as educational institutions. Public investments in research are increasingly directed toward research with the potential to translate into products, processes and policies — even whole new industries. This trend in research funding reveals a lot about the ways in which universities matter to governments, policy makers, regions and the public today, but the rankers aren’t paying attention.

Consider Israel. According to data on NASDAQ’s website, Israel has more companies listed on the NASDAQ stock exchange than any other country in the world except the U.S., and major companies such as Intel, Microsoft, IBM and Google have major research and development centers in Israel. Why? If you look at the data, you see a correlation between this entrepreneurial activity and the investments in and outputs from Israel’s universities.

Israel is among a handful of nations with the highest public expenditure on educational institutions relative to GDP, and it has the highest rate of R&D investment relative to GDP in the world. It also has the highest percentage of engineers in the work force and among the highest ratio of university degrees per capita. Many of the companies listed on NASDAQ were started by graduates of Israel’s universities: Technion, Tel Aviv University, Weizmann Institute and Hebrew University of Jerusalem, to mention a few. Do international university rankings capture these economic impacts from research and postsecondary education in Israel? The answer is no. In spite of their tremendous impact and output, Israel’s universities are ranked somewhere in the 100 to 200 range."

In fact, the Shanghai rankings had the Hebrew University of Jerusalem in 72nd position in 2010 and the percentage of Israeli universities in the Shanghai 500 was higher than any other country. So, the vice-chancellor's logic leads to the conclusion that Shanghai does at a better job at capturing this aspect of excellence than QS or THE.

Tel Aviv University and the Hebrew University of Jerusalem were not in the THE 200 or indeed the THE top 400. What happened is that Thomson Reuters either did not receive or did not ask for the information.