Saturday, August 27, 2011

The THE Citations Indicator

The Research Impact indicator in last year's Times Higher Education - Thomson Reuters World University Rankings led to much condemnation and not a little derision. Alexandria University was fourth in the world for research impact, with Bilkent, Turkey, Hong Kong Baptist University and several other relatively obscure institutions achieving remarkably high scores.

The villain here was Thomson Reuters' field and year normalisation system by which citations were compared with world benchmarks for field and year. This meant that a large number of citations within year of publication  to a paper classified as being in a low cited field could have a disproportionate  effect, which might be further enhanced if the university was in a region where citations were low.

Now THE have announced that this year there will be three changes. These are:

  • raising the threshold for inclusion in the citations indicator from 50 publications per year to 200
  • Extending the period for counting citations from five to six years
  • Changing regional normalisation so that it takes account of subject variations within regions as well as the overall level  of citations.
Here are some things which Thomson Reuters apparently will not do:

  • reducing the weighting given to citations
  • not counting sell-citations, citations within institutions or citations within journals
  • using a variety of indications to assess research impact, such as h-index, total citations, citations per paper
  • using a variety of databases

So, everybody will have to wait until September to see what will happen.

1 comment:

Jason said...

Hi Richard,

"and not a little derision" haha, I chuckled. By the way, a small typo: "sell-citations" should be "self-citations".

I linked to this post from El Naschie Watch.