Degree Class is no Longer Important

The relentless grade inflation in British secondary and tertiary education has been well documented. A first or upper second class degree or a grade A at A level no longer means very much. It has  been far too easy for universities to cover up their deficiencies or attract applications by handing out firsts or upper seconds like smarties.

Now the consequences are beginning to become apparent. Ernst and Young (EY), the accounting firm, will no longer require applicants to have an upper second or three grade Bs. Instead they will use "numerical tests" and "strength assessments" to assess applicants.

I suspect that in a little while EY will come under fire for not recruiting enough of those groups that do not test well, especially in quantitative skills. They and others will probably join in the hunt for the Holy Grail of modern social science, the factor that is non-cognitive but still significantly predictive of career success.

Meanwhile, universities will try to find new functions to replace their historical role as the guarantor of a certain level of cognitive ability. Expect to see more conversations about assessing civic engagement or reaching out to communities.

The CWUR Rankings 2015

The Center for World University Rankings, based in Jeddah, Saudi Arabia, has produced the latest edition of its global ranking of 1,000 universities.  The Center is headed by Nadim Mahassen, an Assistant Professor at King Abdulaziz University.

The rankings include five indicators that measure various aspects of publication and research: publications in "reputable journals", research papers in "highly influential" journals, citations, h-index and patents.

These indicators are given a combined weighting of 25%.

Another 25% goes to Quality of Education, which is measured by the number of alumni receiving major international awards relative to size (current number of students according to national agencies). This is obviously a  crude measure which fails to distinguish among the great mass of universities that have never won an award.

Similarly, another quarter is assigned to Quality of Faculty measured by the number of faculty receiving such awards and another quarter to Alumni Employment measured by the number of CEOs of top corporations. Again, these indicators are of little or no relevance to all but a few hundred institutions.

Alumni employment gets another 25%. This is measured by alumni holding CEO positions in top companies. Again, this would be of relevance to a limited number of universities.

The Top Ten are:

1.    Harvard

2.    Stanford

3.    MIT

4.    Cambridge

5.    Oxford

6.    Columbia

7.    Berkeley

8.    Chicago

9.    Princeton

10.  Cornell.

The only change from last year is that Cornell has replaced Yale in tenth place.


Countries with Universities in the Top Hundred in 2015 and 2014

Country	Universities in  top 100 2015	2014
US	55	53
UK	7	7
Japan	7	8
Switzerland	4	4
France	4	4
Canada	3	3
Israel	3	3
South Korea	2	1
Germany	2	4
Australia	2	2
China	2	2
Netherlands	2	1
Russia	1	1
Taiwan	1	1
Belgium	1	1
Norway	1	0
Sweden	1	2
Singapore	1	1
Denmark	1	1

Italy

0

1

Top Ranked in Region or Country

USA:                                       Harvard
Canada:                                  Toronto
Asia:                                       Tokyo
South Asia:                             IIT Delhi
Southeast Asia :                      National University of Singapore
Europe:                                   Cambridge
Central and Eastern Europe:    Lomonosov Moscow State University
Arab World:                             King Saud University
Middle East:                             Hebrew University of Jerusalem
Latin America:                         Sao Paulo
Africa:                                      University of the Witwatersrand

Carribbean:                              University of Puerto Rico at Mayagüez



Noise Index


In the top 20, the CWUR rankings are more stable than THE and QS but less stable than the Shanghai rankings.

Average position change of universities in the top 20 in 2014: 0.5

Comparison

CWUR 2013-14:            0.9
Shanghai Rankings (ARWU)
2011-12:                        0.15
2012-13:                        0.25
THE WUR  2012-13:      1.2
QS  WUR    2012-13      1.7

With regard to the top 100, the CWUR rankings are more stable this year, with a volatility similar to the QS and THE rankings although significantly less so than ARWU.



Average position change of universities in the top 100 in 2014: 4.15

Comparison

CWUR 2013-14:           10.59

Shanghai Rankings (ARWU
2011-12:                           2.01
2012-13:                           1.66
THE WUR  2012-13:         5.36
QS  WUR    2012-13:    -   3.97

The Other THE African University Rankings

THE have just presented Africa and the world with a list of 30 African universities ranked according to "research impact", that is the number of citations per paper normalised by field (300 of them?) and year. Citations are not just counted but compared with the world average for specific years and fields.

The result is that a university that manages to join a large international project, typically in medicine, genetics or particle physics with a disproportionate number of citations especially in the first couple of years of publication, can get an extremely high score. If the university had few publications to begin with the score for this indicator would be even higher.

For these rankings THE have introduced fractionalised counting. so that a university that is one of 100 contributors to a project with 2000 citations would get the equivalent of 20 citations. Under the procedure THE and the their former data collectors Thomson Reuters had been using for the world university rankings it would have been credited with 2000 citations as would all the other contributors.

THE are to be congratulated for finally using fractionalised counting which has reduced the likelihood of the indicator producing very odd results. Even so, the snapshot ranking is inappropriate for African universities, as it still privileges those that happen to contribute to to a few international projects.

The results might seem acceptable to THE and its international audiencebut I suspect that Egyptian academics will be amused by a ranking that includes six universities but not Cairo University . I wonder how many Nigerians will accept a ranking that includes Port Harcourt but not Ibadan or Ahmadu Bello.

Along with standardised scores for citations THE has also included the number of publications in the Scopus database between 2009 and 2013. This, a measurement of research output of a fairly high quality, is probably more relevant to Africa than the citations indicator. Unfortunately, it shows the very limited amount of research done between the Sahara and the Kalahari and so would be inexpedient to present as a snapshot of what a future ranking might look like.

The methods, approaches and assumptions of THE's world rankings with their emphasis on inputs, especially income, research quality, inappropriately called research impact or research influence, reputation, and doctoral education are of limited value to all but a few African universities and stakeholders. Whether anything of value comes from the conversation in Johannesburg remains to be seen but it is unlikely that a modified version of the world rankings will be of much value to anyone.

Anyway, below are the 30 African universities reordered according to number of publications.

Rank	University	Country	number of  publications 2009-2013
1	University of Cape Town	South Africa	5540.21
2	University of Pretoria	South Africa	4544.33
3	University of the Witwatersrand	South Africa	4387.17
4	Stellenbosch University	South Africa	4357.33
5	University of Kwazulu-Natal	South Africa	4235.09
6	Alexandria University	Egypt	2550.15
7	Universite de Sfax	Tunisia	2355.30
8	University of Johannesburg	South Africa	2192.74
9	North West University	South Africa	1707.94
10	Assiut University	Egypt	1588.64
11	University of the Free State	South Africa	1512.56
12	Université Mohammed V – Agdal	Morocco	1503.69
13	Rhodes University	South Africa	1296.96
14	University of the Western Cape	South Africa	1154.77
15	Makerere University	Uganda	1112.69
16	Suez Canal University	Egypt	998.98
17	University of South Africa	South Africa	981.67
18	Nelson Mandela Metropolitan University	South Africa	885.77
19	Universite Hassan II Casablanca	Morocco	960.25
20	Universite Cadi Ayyad	Morocco	910.82
21	Addis Ababa University	Ethiopia	893.90
22	Univerite de Tunis	Tunisia	879.63
23	Universite de Yaounde I	Cameroons	876.33
24	Ecole Nationale d’Ingénieurs de Sfax	Tunisia	822.31
25	University of Ghana	Ghana	804.53
26	American University in Cairo	Egypt	700.89
27	Minia University	Egypt	694.79
28	University of Nairobi	Kenya	671.72
29	South Valley University	Egypt	636.85
30	University of Port Harcourt	Nigeria	573.55

Google Scholar Ranking of African Universities

As competition in the ranking world intensifies, Times Higher Education (THE) and Quacquarelli Symonds are  diligently promoting their various regional ranking, data processing and event management projects. The latest is THE's African summit at the University of Johannesburg.

Three weeks ago THE issued what they described as an "experimental and preliminary" ranking which consisted of 15 universities ordered according to the number of citations per paper normalised for field and year. An interesting innovation was that citations were fractionalised so that participants in large collaborative projects would be credited in proportion to their fraction of the total contributors .

This is just one indicator and it is not really a measure of research influence, but rather of research quality and it is still skewed by participation in multi-contributor papers in medicine and particle physics. It is unlikely that the University of Port Harcourt or Universite Cadi Ayyad would  be in the top ten of any other indicator.

THE have indicated that they will add another 15 names to the list at the Johannesburg summit.

The table below was compiled for the purpose of checking on the claims of THE or other rankers that might attempt to evaluate African universities. It simply counts the number of results (2012-2014: exclude citations and patents) from a query to Google Scholar. Data was compiled on the 25th and 26th of July. The criteria for inclusion were being in the top 50 of the Webometrics rankings or the 15 universities in the THE list. The top university in any country not included was added from either the Webometrics or ic4u rankings.

This database includes papers, reports, theses and dissertations, conference proceedings and so on. It is certainly not a measure of research quality but rather of the volume of any activities connected with research.  In the case of the two Kenyan universities it probably reflects the size and inclusiveness of the university repositories.

One thing about the Google scholar list is that it confirms suspicions that the quality of Egyptian universities has been underestimated by the big name rankers. For further evidence one might look at data from social media such as LinkedIn or just contrast the aspirations of Egyptian students in the revolutions of 2011 and 2013 compared with those of students at the University of Cape Town and Durban University of Technology.

Rank	University	Country	Google Scholar  Results
1	University of Cape Town	South Africa	17,000
2	Cairo University	Egypt	16,800
3	University of Pretoria	South Africa	16,500
4	University of Nairobi	Kenya	16,400
5	University of the Witwatersrand	South Africa	15,800
6	University of Kwazulu-Natal	South Africa	15,500
7	Stellenbosch University	South Africa	14,900
8	University of Ibadan	Nigeria	14,800
9	University of South Africa	South Africa	13,500
10	Kenyatta University	Kenya	12,000
11	University of Johannesburg	South Africa	11,200
12	Makerere University	Uganda	10,400
13	North West University	South Africa	10,100
14	University of Ghana	Ghana	8,330
15	Alexandria University	Egypt	7,610
16	University of Lagos	Nigeria	7,220
17	Rhodes University	South Africa	7,210
18	University of the Western Cape	South Africa	6,870
19	Obafemi Awolowo University	Nigeria	6,800
20	Mansoura University	Egypt	6,480
21	University of the Free State	South Africa	6,400
22	Addis Ababa University	Ethiopia	6,210
23	Zagazig University	Egypt	6,160
24	American University in Cairo	Egypt	5,770
25	University of Ilorin	Nigeria	5,620
26	Assiut University	Egypt	5,580
27	Kwame Nkrumah University of Science and Technology	Ghana	5,080
28=	University of Zimbabwe	Zimbabwe	4,830
28=	University of Port Harcourt	Nigeria	4,830
30	University of Botswana	Botswana	4,260
31	University of Zambia	Zambia	4,240
32	University of Dar Es Salaam	Tanzania	4,120
33	University of Khartoum	Sudan	4,110
34	Suez Canal University	Egypt	3,670
35	Tanta University	Egypt	3,600
36	Jomo Kenyatta University of Agriculture and Technology	Kenya	3,520
37	Nelson Mandela Metropolitan University	South Africa	3,490
38	Covenant University Ota	Nigeria	2,950
39	Helwan University	Egypt	2,940
40	Benha University	Egypt	2,570
41	Minia University	Egypt	2,390
42	University of Malawi	Malawi	2,340
43	Université Abou Bekr Belkaid	Algeria	2,290
44	Universityof Tunis	Tunisia	2,270
45=	Université Kasdi Merbah Ouargla	Algeria	2,240
45=	Cape Peninsula University of Technology	South Africa	2,240
47	Université Cheikh Anta Diop de Dakar	Senegal	1,950
48	University of Namibia	Namibia	1,760
49	Universite de la Reunion	Reunion	1,690
50	Durban University of Technology	South Africa	1,560
51	University of Mauritius	Mauritius	1,490
52	Université d'Abomey-Calavi	Benin	1,460
53	South Valley University	Egypt	1,440
54	Universidade Eduardo Mondlane	Mozambique	1,420
55	Beni-Suef University	Egypt	1,400
56	Université Cadi Ayyad Marrakech	Morroco	1,370
57	Université de Ouagadougou	Burkina Faso	1,300
58	University of Rwanda	Rwanda	1,270
59	Université des Sciences et de la Technologie Houari Boumediene	Algeria	976
60	Université de Lomé	Togo	784
61	Université de Bamako	Mali	660
62	Kafrelsheikh University	Egypt	618
63	University of Swaziland	Swaziland	615
64	Université Félix Houphouët-Boigny	Ivory Coast	590
65	Université de Kinshasa	Domocratic Republic of the Congo	558
66	National University of Lesotho	Lesotho	555
67	Université Constantine 1	Algeria	468
68	Bejaia University	Algeria	413
69	Universidade Jean Piaget de Cabo Verde	Cape Verde	407
70	Université Mohammed V Souissi	Tunisia	361
71	National Engineering School of Sfax	Tunisia	271
72	Université Marien Ngouabi	Republc of Congo	256
73	University of Liberia	Liberia	255
74	Université Djillali Liabes	Algeria	243
75	Université Abdou Moumouni de Niamey	Niger	206
76	Misurata University	Libya	155
77	Université Omar Bongo	Gabon	138
78	University of The Gambia	Gambia	130
79	Universidade Católica de Angola	Angola	115
80=	Université de Dschang	Cameroons	113
80=	Université de Bangui	Central African Empire	113
82	Université de Nouakchott	Mauretania	108
83	Eritrea Institute of Technology	Eritrea	76
84	Université de Djibouti	Djibouti	66
85	Université de Toliara	Madagascar	59
86	Université Hassan II Ain Chock	Morocco	55
87	University of Seychelles	Seychelles	52
88	Mogadishu University	Somalia	51
89	Universidad Nacional de Guinea Ecuatorial	Equatorial Guinea	40
90	Universite Gamal Abdel Nasser de Conakry	Guinea	21
91	University of Makeni	Sierra Leone	18
92	John Garang Memorial University	South Sudan	12
93	Hope Africa University	Burundi	3
94	Universite de Moundou	Chad	2