IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v96y2013i1d10.1007_s11192-013-0971-2.html
   My bibliography  Save this article

What about excellence in teaching? A benevolent ranking of universities

Author

Listed:
  • Kristof Witte

    (Maastricht University
    Katholieke Universiteit Leuven (KULeuven))

  • Lenka Hudrlikova

    (University of Economics, Prague)

Abstract

Existing university rankings apply fixed and exogenous weights based on a theoretical framework, stakeholder or expert opinions. Fixed weights cannot embrace all requirements of a ‘good ranking’ according to the Berlin Principles. As the strengths of universities differ, the weights on the ranking should differ as well. This paper proposes a fully nonparametric methodology to rank universities. The methodology is in line with the Berlin Principles. It assigns to each university the weights that maximize (minimize) the impact of the criteria where university performs relatively well (poor). The method accounts for background characteristics among universities and evaluates which characteristics have an impact on the ranking. In particular, it accounts for the level of tuition fees, an English speaking environment, size, research or teaching orientation. In general, medium sized universities in English speaking countries benefit from the benevolent ranking. On the contrary, we observe that rankings with fixed weighting schemes reward large and research oriented universities. Especially Swiss and German universities significantly improve their position in a more benevolent ranking.

Suggested Citation

  • Kristof Witte & Lenka Hudrlikova, 2013. "What about excellence in teaching? A benevolent ranking of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 337-364, July.
  • Handle: RePEc:spr:scient:v:96:y:2013:i:1:d:10.1007_s11192-013-0971-2
    DOI: 10.1007/s11192-013-0971-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-013-0971-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-013-0971-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    2. Michael B. Coelli, 2009. "Tuition fees and equality of university enrolment," Canadian Journal of Economics, Canadian Economics Association, vol. 42(3), pages 1072-1099, August.
    3. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    4. Frans van Vught & Don F. Westerheijden, 2010. "Multidimensional ranking: a new transparency tool for higher education and research," Higher Education Management and Policy, OECD Publishing, vol. 22(3), pages 1-26.
    5. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    6. Jeffery Racine & Jeffrey Hart & Qi Li, 2006. "Testing the Significance of Categorical Predictor Variables in Nonparametric Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 25(4), pages 523-544.
    7. TULKENS, Henry, 2007. "Ranking universities: How to take better account of diversity," LIDAM Discussion Papers CORE 2007042, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    8. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    9. Kristof De Witte & Mika Kortelainen, 2013. "What explains the performance of students in a heterogeneous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Applied Economics, Taylor & Francis Journals, vol. 45(17), pages 2401-2412, June.
    10. repec:dau:papers:123456789/2947 is not listed on IDEAS
    11. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    12. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    13. Webster, Thomas J., 2001. "A principal component analysis of the U.S. News & World Report tier rankings of colleges and universities," Economics of Education Review, Elsevier, vol. 20(3), pages 235-244, June.
    14. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    15. De Witte, Kristof & Rogge, Nicky, 2011. "Accounting for exogenous influences in performance evaluations of teachers," Economics of Education Review, Elsevier, vol. 30(4), pages 641-653, August.
    16. Peter Michaelis, 2004. "Education, Research and the Impact of Tuition Fees - A Simple Model of the University," Discussion Paper Series 265, Universitaet Augsburg, Institute for Economics.
    17. Griffith, Amanda & Rask, Kevin, 2007. "The influence of the US News and World Report collegiate rankings on the matriculation decision of high-ability students: 1995-2004," Economics of Education Review, Elsevier, vol. 26(2), pages 244-255, April.
    18. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    19. Ellen Hazelkorn, 2007. "The Impact of League Tables and Ranking Systems on Higher Education Decision Making," Higher Education Management and Policy, OECD Publishing, vol. 19(2), pages 1-24.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2015. "Explaining (in)efficiency in higher education: a comparison of parametric and non-parametric analyses to rank universities," MPRA Paper 67119, University Library of Munich, Germany.
    2. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    3. Mishra, Neelesh Kumar & Chakraborty, Abhishek & Singh, Sanjeet & Ranjan, Prabhat, 2023. "Efficiency analysis of engineering colleges in India: Decomposition into parallel sub-processes systems," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    4. Ruiz, José L. & Sirvent, Inmaculada, 2016. "Common benchmarking and ranking of units with DEA," Omega, Elsevier, vol. 65(C), pages 1-9.
    5. Tommaso Agasisti & Cristian Barra & Roberto Zotti, 2019. "Research, knowledge transfer, and innovation: The effect of Italian universities’ efficiency on local economic development 2006−2012," Journal of Regional Science, Wiley Blackwell, vol. 59(5), pages 819-849, November.
    6. Tommaso Agasisti & Ekaterina Shibanova, 2020. "Autonomy, Performance And Efficiency: An Empirical Analysis Of Russian Universities 2014-2018," HSE Working papers WP BRP 224/EC/2020, National Research University Higher School of Economics.
    7. Juan Antonio Dip, 2021. "What does U-multirank tell us about knowledge transfer and research?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3011-3039, April.
    8. Csóka, Imola & Sebestyén, Géza & Neszveda, Gábor, 2019. "Tudományos teljesítmény mérése a magyar felsőoktatás gazdasági képzéseiben [Measuring scientific performance of business and economics faculties in Hungarian higher education]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(7), pages 751-770.
    9. Cristian Barra & Raffaele Lagravinese & Roberto Zotti, 2022. "Exploring hospital efficiency within and between Italian regions: new empirical evidence," Journal of Productivity Analysis, Springer, vol. 57(3), pages 269-284, June.
    10. José L. Ruiz & Inmaculada Sirvent, 2017. "Fuzzy cross-efficiency evaluation: a possibility approach," Fuzzy Optimization and Decision Making, Springer, vol. 16(1), pages 111-126, March.
    11. Karagiannis, Giannis, 2023. "Aggregating faculty members’ research effectiveness to the department or university level: Exact versus approximate solutions," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    12. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    13. Giannis Karagiannis & Georgia Paschalidou, 2017. "Assessing research effectiveness: a comparison of alternative nonparametric models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 456-468, April.
    14. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    15. Eline Sneyers & Kristof De Witte, 2017. "The interaction between dropout, graduation rates and quality ratings in universities," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 416-430, April.
    16. Csató, László & Tóth, Csaba, 2020. "University rankings from the revealed preferences of the applicants," European Journal of Operational Research, Elsevier, vol. 286(1), pages 309-320.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    2. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    3. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.
    4. Fusco, Elisa & Vidoli, Francesco & Sahoo, Biresh K., 2018. "Spatial heterogeneity in composite indicator: A methodological proposal," Omega, Elsevier, vol. 77(C), pages 1-14.
    5. Cordero, José Manuel & Alonso-Morán, Edurne & Nuño-Solinis, Roberto & Orueta, Juan F. & Arce, Regina Sauto, 2015. "Efficiency assessment of primary care providers: A conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 240(1), pages 235-244.
    6. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    7. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    8. Cordero, José Manuel & Salinas-Jiménez, Javier & Salinas-Jiménez, M Mar, 2017. "Exploring factors affecting the level of happiness across countries: A conditional robust nonparametric frontier analysis," European Journal of Operational Research, Elsevier, vol. 256(2), pages 663-672.
    9. López-Torres, Laura & Nicolini, Rosella & Prior, Diego, 2017. "Does strategic interaction affect demand for school places? A conditional efficiency approach," Regional Science and Urban Economics, Elsevier, vol. 65(C), pages 89-103.
    10. José Manuel Cordero & Daniel Santín & Rosa Simancas, 2017. "Assessing European primary school performance through a conditional nonparametric model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 364-376, April.
    11. Christopher Bruffaerts & Bram De Rock & Catherine Dehon, 2013. "The Research Efficiency of US Universities: a Nonparametric Frontier Modelling Approach," Working Papers ECARES ECARES 2013-31, ULB -- Universite Libre de Bruxelles.
    12. Rogge, Nicky & Archer, Geoffrey, 2021. "Measuring and analyzing country change in establishing ease of doing business using a revised version of World Bank's ease of doing business index," European Journal of Operational Research, Elsevier, vol. 290(1), pages 373-385.
    13. Giménez, Víctor & Prior, Diego & Thieme, Claudio & Tortosa-Ausina, Emili, 2024. "International comparisons of COVID-19 pandemic management: What can be learned from activity analysis techniques?," Omega, Elsevier, vol. 122(C).
    14. Jill Johnes & Maria Portela & Emmanuel Thanassoulis, 2017. "Efficiency in education," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 331-338, April.
    15. López-Torres, Laura & Prior, Diego, 2022. "Long-term efficiency of public service provision in a context of budget restrictions. An application to the education sector," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    16. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    17. Baležentis, Tomas & De Witte, Kristof, 2015. "One- and multi-directional conditional efficiency measurement – Efficiency in Lithuanian family farms," European Journal of Operational Research, Elsevier, vol. 245(2), pages 612-622.
    18. Kourtesi, Sofia & De Witte, Kristof & Polymeros, Apostolos, 2016. "Technical Efficiency in the Agricultural Sector - Evidence from a Conditional Quantile-Based Approach," Agricultural Economics Review, Greek Association of Agricultural Economists, vol. 17(2), June.
    19. Julián Ramajo & José Manuel Cordero & Miguel Ángel Márquez, 2017. "European regional efficiency and geographical externalities: a spatial nonparametric frontier analysis," Journal of Geographical Systems, Springer, vol. 19(4), pages 319-348, October.
    20. Julián Ramajo & Miguel A. Márquez & Geoffrey J. D. Hewings, 2024. "Addressing spatial dependence when estimating technical efficiency: A spatialized data envelopment analysis of regional productive performance in the European Union," Growth and Change, Wiley Blackwell, vol. 55(1), March.

    More about this item

    Keywords

    University ranking; Endogenous weight selection; Conditional efficiency; Higher education;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:96:y:2013:i:1:d:10.1007_s11192-013-0971-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.