University rankings

What do they really show?

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

University rankings as developed by the media are used by many stakeholders in higher education: students looking for university places; academics looking for university jobs; university managers who need to maintain standing in the competitive arena of student recruitment; and governments who want to know that public funds spent on universities are delivering a world class higher education system. Media rankings deliberately draw attention to the performance of each university relative to all others, and as such they are undeniably simple to use and interpret. But one danger is that they are potentially open to manipulation and gaming because many of the measures underlying the rankings are under the control of the institutions themselves. This paper examines media rankings (constructed from an amalgamation of variables representing performance across numerous dimensions) to reveal the problems with using a composite index to reflect overall performance. It ends with a proposal for an alternative methodology which leads to groupings rather than point estimates.
Original languageEnglish
Pages (from-to)585-606
Number of pages22
JournalScientometrics
Volume115
Issue number1
Early online date7 Feb 2018
DOIs
Publication statusPublished - 1 Apr 2018

Fingerprint

university ranking
Education
Students
university
ranking
Managers
Composite materials
performance
grouping
education system
manipulation
student
stakeholder
manager
methodology
education

Cite this

@article{90eb9ee42e3a4ea088c1c9726f9f1951,
title = "University rankings: What do they really show?",
abstract = "University rankings as developed by the media are used by many stakeholders in higher education: students looking for university places; academics looking for university jobs; university managers who need to maintain standing in the competitive arena of student recruitment; and governments who want to know that public funds spent on universities are delivering a world class higher education system. Media rankings deliberately draw attention to the performance of each university relative to all others, and as such they are undeniably simple to use and interpret. But one danger is that they are potentially open to manipulation and gaming because many of the measures underlying the rankings are under the control of the institutions themselves. This paper examines media rankings (constructed from an amalgamation of variables representing performance across numerous dimensions) to reveal the problems with using a composite index to reflect overall performance. It ends with a proposal for an alternative methodology which leads to groupings rather than point estimates.",
keywords = "higher education, rankings, performance, principle components analysis, Higher education, Principal components analysis, Rankings, Performance",
author = "Jill Johnes",
note = "This is a post-peer-review, pre-copyedit version of an article published in Scientometrics. The final authenticated version is available online at: https://doi.org/10.1007/s11192-018-2666-1",
year = "2018",
month = "4",
day = "1",
doi = "10.1007/s11192-018-2666-1",
language = "English",
volume = "115",
pages = "585--606",
journal = "Scientometrics",
issn = "0138-9130",
publisher = "Springer Netherlands",
number = "1",

}

University rankings : What do they really show? / Johnes, Jill.

In: Scientometrics, Vol. 115, No. 1, 01.04.2018, p. 585-606.

Research output: Contribution to journalArticle

TY - JOUR

T1 - University rankings

T2 - What do they really show?

AU - Johnes, Jill

N1 - This is a post-peer-review, pre-copyedit version of an article published in Scientometrics. The final authenticated version is available online at: https://doi.org/10.1007/s11192-018-2666-1

PY - 2018/4/1

Y1 - 2018/4/1

N2 - University rankings as developed by the media are used by many stakeholders in higher education: students looking for university places; academics looking for university jobs; university managers who need to maintain standing in the competitive arena of student recruitment; and governments who want to know that public funds spent on universities are delivering a world class higher education system. Media rankings deliberately draw attention to the performance of each university relative to all others, and as such they are undeniably simple to use and interpret. But one danger is that they are potentially open to manipulation and gaming because many of the measures underlying the rankings are under the control of the institutions themselves. This paper examines media rankings (constructed from an amalgamation of variables representing performance across numerous dimensions) to reveal the problems with using a composite index to reflect overall performance. It ends with a proposal for an alternative methodology which leads to groupings rather than point estimates.

AB - University rankings as developed by the media are used by many stakeholders in higher education: students looking for university places; academics looking for university jobs; university managers who need to maintain standing in the competitive arena of student recruitment; and governments who want to know that public funds spent on universities are delivering a world class higher education system. Media rankings deliberately draw attention to the performance of each university relative to all others, and as such they are undeniably simple to use and interpret. But one danger is that they are potentially open to manipulation and gaming because many of the measures underlying the rankings are under the control of the institutions themselves. This paper examines media rankings (constructed from an amalgamation of variables representing performance across numerous dimensions) to reveal the problems with using a composite index to reflect overall performance. It ends with a proposal for an alternative methodology which leads to groupings rather than point estimates.

KW - higher education

KW - rankings

KW - performance

KW - principle components analysis

KW - Higher education

KW - Principal components analysis

KW - Rankings

KW - Performance

UR - http://www.scopus.com/inward/record.url?scp=85041499797&partnerID=8YFLogxK

U2 - 10.1007/s11192-018-2666-1

DO - 10.1007/s11192-018-2666-1

M3 - Article

VL - 115

SP - 585

EP - 606

JO - Scientometrics

JF - Scientometrics

SN - 0138-9130

IS - 1

ER -