Should you believe in the Shanghai ranking? - Archive ouverte HAL Access content directly
Journal Articles Scientometrics Year : 2010

Should you believe in the Shanghai ranking?


This paper proposes a critical analysis of the "Academic Ranking of World Universities", published every year by the Institute of Higher Education of the Jiao Tong University in Shanghai and more commonly known as the Shanghai ranking. After having recalled how the ranking is built, we first discuss the relevance of the criteria and then analyze the proposed aggregation method. Our analysis uses tools and concepts from Multiple Criteria Decision Making (MCDM). Our main conclusions are that the criteria that are used are not relevant, that the aggregation methodology is plagued by a number of major problems and that the whole exercise suffers from an insufficient attention paid to fundamental structuring issues. Hence, our view is that the Shanghai ranking, in spite of the media coverage it receives, does not qualify as a useful and pertinent tool to discuss the "quality" of academic institutions, let alone to guide the choice of students and family or to promote reforms of higher education systems. We outline the type of work that should be undertaken to oer sound alternatives to the Shanghai ranking.
Fichier principal
Vignette du fichier
Shanghai_JCB_DB_PV.pdf (403.9 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-00388319 , version 1 (26-05-2009)
hal-00388319 , version 2 (15-07-2009)


  • HAL Id : hal-00388319 , version 2


Jean-Charles Billaut, Denis Bouyssou, Philippe Vincke. Should you believe in the Shanghai ranking?. Scientometrics, 2010, 84 (1), pp.237-263. ⟨hal-00388319v2⟩
3423 View
3180 Download


Gmail Mastodon Facebook X LinkedIn More