Measuring efficiency: A comparison of multilevel modelling and data envelopment analysis in the context of higher education

Research output: Contribution to journalArticle

44 Citations (Scopus)

Abstract

Data envelopment analysis (DEA) and multilevel modelling (MLM) are applied to a data set of 54,564 graduates from UK universities in 1993 to assess whether the choice of technique affects the measurement of universities' performance. A methodology developed by Thanassoulis and Portela (2002; Education Economics, 10(2), pp. 183-207) allows each individual's DEA efficiency score to be decomposed into two components: one attributable to the university at which the student studied and the other attributable to the individual student. From the former component, a measure of each institution's teaching efficiency is derived and compared to the university effects from various multilevel models. The comparisons are made within four broad subjects: pure science, applied science, social science and arts. The results show that the rankings of universities derived from the DEA efficiencies which measure the universities' own performance (i.e., having excluded the efforts of the individuals) are not strongly correlated with the university rankings derived from the university effects of the multilevel models. The data were also used to perform a university-level DEA. The university efficiency scores derived from these DEAs are largely unrelated to the scores from the individual-level DEAs, confirming a result from a smaller data set (Johnes, 2006a; European Journal of Operational Research, forthcoming). However, the University-level DEAs provide efficiency scores which are generally strongly related to the university effects of the multilevel models.

LanguageEnglish
Pages75-104
Number of pages30
JournalBulletin of Economic Research
Volume58
Issue number2
Early online date15 Mar 2006
DOIs
Publication statusPublished - 1 Apr 2006
Externally publishedYes

Fingerprint

Multilevel modeling
Data envelopment analysis
Multilevel models
Education economics
Art
Efficiency measures
Operations research
Social sciences
Ranking
University rankings
Methodology

Cite this

@article{373f0e278ad94cf8a75eea49fee94960,
title = "Measuring efficiency: A comparison of multilevel modelling and data envelopment analysis in the context of higher education",
abstract = "Data envelopment analysis (DEA) and multilevel modelling (MLM) are applied to a data set of 54,564 graduates from UK universities in 1993 to assess whether the choice of technique affects the measurement of universities' performance. A methodology developed by Thanassoulis and Portela (2002; Education Economics, 10(2), pp. 183-207) allows each individual's DEA efficiency score to be decomposed into two components: one attributable to the university at which the student studied and the other attributable to the individual student. From the former component, a measure of each institution's teaching efficiency is derived and compared to the university effects from various multilevel models. The comparisons are made within four broad subjects: pure science, applied science, social science and arts. The results show that the rankings of universities derived from the DEA efficiencies which measure the universities' own performance (i.e., having excluded the efforts of the individuals) are not strongly correlated with the university rankings derived from the university effects of the multilevel models. The data were also used to perform a university-level DEA. The university efficiency scores derived from these DEAs are largely unrelated to the scores from the individual-level DEAs, confirming a result from a smaller data set (Johnes, 2006a; European Journal of Operational Research, forthcoming). However, the University-level DEAs provide efficiency scores which are generally strongly related to the university effects of the multilevel models.",
keywords = "Data envelopment analysis, Efficiency measurement, Higher education, Multilevel modelling",
author = "Jill Johnes",
year = "2006",
month = "4",
day = "1",
doi = "10.1111/j.0307-3378.2006.00238.x",
language = "English",
volume = "58",
pages = "75--104",
journal = "Bulletin of Economic Research",
issn = "0307-3378",
publisher = "Wiley-Blackwell",
number = "2",

}

TY - JOUR

T1 - Measuring efficiency

T2 - Bulletin of Economic Research

AU - Johnes, Jill

PY - 2006/4/1

Y1 - 2006/4/1

N2 - Data envelopment analysis (DEA) and multilevel modelling (MLM) are applied to a data set of 54,564 graduates from UK universities in 1993 to assess whether the choice of technique affects the measurement of universities' performance. A methodology developed by Thanassoulis and Portela (2002; Education Economics, 10(2), pp. 183-207) allows each individual's DEA efficiency score to be decomposed into two components: one attributable to the university at which the student studied and the other attributable to the individual student. From the former component, a measure of each institution's teaching efficiency is derived and compared to the university effects from various multilevel models. The comparisons are made within four broad subjects: pure science, applied science, social science and arts. The results show that the rankings of universities derived from the DEA efficiencies which measure the universities' own performance (i.e., having excluded the efforts of the individuals) are not strongly correlated with the university rankings derived from the university effects of the multilevel models. The data were also used to perform a university-level DEA. The university efficiency scores derived from these DEAs are largely unrelated to the scores from the individual-level DEAs, confirming a result from a smaller data set (Johnes, 2006a; European Journal of Operational Research, forthcoming). However, the University-level DEAs provide efficiency scores which are generally strongly related to the university effects of the multilevel models.

AB - Data envelopment analysis (DEA) and multilevel modelling (MLM) are applied to a data set of 54,564 graduates from UK universities in 1993 to assess whether the choice of technique affects the measurement of universities' performance. A methodology developed by Thanassoulis and Portela (2002; Education Economics, 10(2), pp. 183-207) allows each individual's DEA efficiency score to be decomposed into two components: one attributable to the university at which the student studied and the other attributable to the individual student. From the former component, a measure of each institution's teaching efficiency is derived and compared to the university effects from various multilevel models. The comparisons are made within four broad subjects: pure science, applied science, social science and arts. The results show that the rankings of universities derived from the DEA efficiencies which measure the universities' own performance (i.e., having excluded the efforts of the individuals) are not strongly correlated with the university rankings derived from the university effects of the multilevel models. The data were also used to perform a university-level DEA. The university efficiency scores derived from these DEAs are largely unrelated to the scores from the individual-level DEAs, confirming a result from a smaller data set (Johnes, 2006a; European Journal of Operational Research, forthcoming). However, the University-level DEAs provide efficiency scores which are generally strongly related to the university effects of the multilevel models.

KW - Data envelopment analysis

KW - Efficiency measurement

KW - Higher education

KW - Multilevel modelling

UR - http://www.scopus.com/inward/record.url?scp=33745937527&partnerID=8YFLogxK

U2 - 10.1111/j.0307-3378.2006.00238.x

DO - 10.1111/j.0307-3378.2006.00238.x

M3 - Article

VL - 58

SP - 75

EP - 104

JO - Bulletin of Economic Research

JF - Bulletin of Economic Research

SN - 0307-3378

IS - 2

ER -