ERIC Number: EJ1061029
Record Type: Journal
Publication Date: 2015-May
Abstractor: As Provided
Reference Count: 20
Technical Pitfalls in University Rankings
Bougnol, Marie-Laure; Dulá, Jose H.
Higher Education: The International Journal of Higher Education Research, v69 n5 p859-866 May 2015
Academicians, experts, and other stakeholders have contributed extensively to the literature on university rankings also known as "league tables". Often the tone is critical usually focused on the subjective aspects of the process; e.g., the list of the universities' attributes used in the rankings, their respective weights, and the size and composition of the comparison group. These aspects of a ranking are an easy target since, after all, they are based on someone's opinion even if this person is considered an expert. There are other, purely technical, reasons why ranking schemes are problematic. In this paper we discuss these aspects of rankings by studying the handling of the data, exposing logical mistakes, and raising interpretation issues. We present these as a list of four "pitfalls" invoking in each case an example from an actual rankings. Each case also results in recommendations that address the technical issues involved.
Descriptors: Universities, Achievement Rating, Institutional Characteristics, Data Interpretation, Problems
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: firstname.lastname@example.org; Web site: http://www.springerlink.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A