NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1132708
Record Type: Journal
Publication Date: 2014
Pages: 14
Abstractor: As Provided
ISSN: ISSN-0018-1609
Problems of Indicator Weights and Multicolinearity in World University Rankings: Comparisons of Three Systems
Soh, Kaycheng
Higher Education Review, v46 n2 p47-60 Spr 2014
World university rankings (WUR) use the weight-and-sum approach to arrive at an overall measure which is then used to rank the participating universities of the world. Although the weight-and-sum procedure seems straightforward and accords with common sense, it has hidden methodological or statistical problems which render the meaning of the overall measure (and therefore the ranking results) suspect. The study investigates indicator weight inconsistency and multicolinearity. The 2013 ranking results of the ARWU, QSWUR, and THEWUR for the top 100 universities were re-analysed. Correlations, weight discrepancies, and tolerances were estimated and then compared across the three ranking systems. Weight discrepancy and multicolinearity were found in all three systems to different degrees. These can be attributed to the nature of the indicators and their inter-correlations. Each system has strengths and weaknesses. Rank users need to be aware of the interpretive problems, to avoid equating the rankings from the systems, and to make specific reference to the system concerned when citing rankings. Re-conceptualisation and possible modifications to the systems are discussed.
Tyrrell Burgess Associates. 34 Sandilands, Croydon, CRO 5DB, UK. Tel: +44-2086-561770; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A