IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v125y2020i2d10.1007_s11192-020-03717-w.html
   My bibliography  Save this article

Studying the heterogeneity of European higher education institutions

Author

Listed:
  • Renato Bruni

    (Sapienza University of Rome)

  • Giuseppe Catalano

    (Sapienza University of Rome)

  • Cinzia Daraio

    (Sapienza University of Rome)

  • Martina Gregori

    (Sapienza University of Rome
    Sapienza University of Rome)

  • Henk F. Moed

    (Sapienza University of Rome)

Abstract

The heterogeneity of the Higher Education (HE) Institutions is one of the main critical issues in the assessment of their performance. This paper adopts a multi-level and multi-dimensional perspective, combining national (macro) and institution (micro) level data, and measuring both research and teaching activity, using performance indicators derived from the European Tertiary Education Register, CWTS Leiden Ranking, and PATSTAT patent database. Clustering and efficiency analysis are combined to characterize the heterogeneity of national HE systems in European countries, and reveal the potential of using micro level data to characterize national level performance. Large differences are observed between the European countries, partially due to the fact that they are in different phases of their scientific (and economic) development and of the re-structuring of their HE systems. Evidence is found that universities specializing either in teaching or in research tend to have a higher efficiency than those institutions balancing research and teaching. Tradeoffs are observed between undergraduate and post-graduate activities, and a “Matthew cumulative effect” seems in place on the European institutions analysed: high quality research is able to attract external funds that stimulate innovative and patenting activities that in turn are self-reinforcing to the scientific activities. The results reveal once more the limits and dangers of one-dimensional approaches to the performance of HEIs.

Suggested Citation

  • Renato Bruni & Giuseppe Catalano & Cinzia Daraio & Martina Gregori & Henk F. Moed, 2020. "Studying the heterogeneity of European higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1117-1144, November.
    • Handle: RePEc:spr:scient:v:125:y:2020:i:2:d:10.1007_s11192-020-03717-w
    DOI: 10.1007/s11192-020-03717-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-020-03717-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-020-03717-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. GARCÍA-ARACIL, Adela & PALOMARES-MONTERO, Davinia, 2012. "Agrupación Alternativa Para La Evaluación De Las Universidades Públicas Españolas," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 12(3).
    2. Benedetto Lepori & Aldo Geuna & Antonietta Mira, 2019. "Scientific output scales with resources. A comparison of US and European universities," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-18, October.
    3. Andrea Bonaccorsi & Cinzia Daraio, 2009. "Characterizing the European university system: a preliminary classification using census microdata," Science and Public Policy, Oxford University Press, vol. 36(10), pages 763-775, December.
    4. Abankina, Irina & Aleskerov, Fuad & Belousova, Veronika & Gokhberg, Leonid & Kiselgof, Sofya & Petrushchenko, Vsevolod & Shvydun, Sergey & Zinkovsky, Kirill, 2016. "From equality to diversity: Classifying Russian universities in a performance oriented system," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 228-239.
    5. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
    6. Eva M de la Torre & Fernando Casani & Marti Sagarra, 2018. "Defining typologies of universities through a DEA-MDS analysis: An institutional characterization for formative evaluation purposes," Research Evaluation, Oxford University Press, vol. 27(4), pages 388-403.
    7. Cinzia Daraio & Andrea Bonaccorsi, 2017. "Beyond university rankings? Generating new indicators on universities by linking data in open platforms," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(2), pages 508-529, February.
    8. Secundo, Giustina & Elena Perez, Susana & Martinaitis, Žilvinas & Leitner, Karl Heinz, 2017. "An Intellectual Capital framework to measure universities' third mission activities," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 229-239.
    9. Carmen López-Illescas & Félix Moya-Anegón & Henk F. Moed, 2011. "A ranking of universities should account for differences in their disciplinary specialization," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 563-574, August.
    10. Daraio, Cinzia & Bonaccorsi, Andrea & Geuna, Aldo & Lepori, Benedetto & Bach, Laurent & Bogetoft, Peter & F. Cardoso, Margarida & Castro-Martinez, Elena & Crespi, Gustavo & de Lucio, Ignacio Fernandez, 2011. "The European university landscape: A micro characterization based on evidence from the Aquameth project," Research Policy, Elsevier, vol. 40(1), pages 148-164, February.
    11. Chuanyi Wang & Qiang Zha, 2018. "Measuring systemic diversity of Chinese universities: a clustering-method approach," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(3), pages 1331-1347, May.
    12. Andrea Bonaccorsi & Luca Secondi, 2017. "The determinants of research performance in European universities: a large scale multilevel analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1147-1178, September.
    13. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cinzia Daraio & Simone Di Leo & Loet Leydesdorff, 2023. "A heuristic approach based on Leiden rankings to identify outliers: evidence from Italian universities in the European landscape," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 483-510, January.
    2. Cinzia Daraio & Simone Di Leo & Loet Leydesdorff, 2022. "Using the Leiden Rankings as a Heuristics: Evidence from Italian universities in the European landscape," LEM Papers Series 2022/08, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    3. Nilmini M. Rathnayake & Pivithuru J. Kumarasinghe & Ajantha S. Kumara, 2022. "How Do Different Types of University Academics Perceive Work from Home Amidst COVID-19 and Beyond?," Sustainability, MDPI, vol. 14(9), pages 1-19, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Renato Bruni & Giuseppe Catalano & Cinzia Daraio & Martina Gregori & Henk F. Moed, 2019. "Studying the Heterogeneity of European Higher Education Institutions," DIAG Technical Reports 2019-12, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    2. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    3. Joanna Wolszczak-Derlacz, 2015. "Analysis of efficiency of European and American higher education institutions - nonparametric approach," Ekonomia journal, Faculty of Economic Sciences, University of Warsaw, vol. 40.
    4. Avenali, Alessandro & Daraio, Cinzia & Di Leo, Simone & Wolszczak-Derlacz, Joanna, 2024. "Heterogeneity of national accounting systems, world-class universities and financial resources: What are the links?," Journal of Informetrics, Elsevier, vol. 18(2).
    5. Agasisti, Tommaso & Wolszczak-Derlacz, Joana, 2014. "Exploring universities’ efficiency differentials between countries in a multi-year perspective: an application of bootstrap DEA and Malmquist index to Italy and Poland, 2001-2011," Institute for Research on Labor and Employment, Working Paper Series qt14m8g45v, Institute of Industrial Relations, UC Berkeley.
    6. Abankina, Irina & Aleskerov, Fuad & Belousova, Veronika & Gokhberg, Leonid & Kiselgof, Sofya & Petrushchenko, Vsevolod & Shvydun, Sergey & Zinkovsky, Kirill, 2016. "From equality to diversity: Classifying Russian universities in a performance oriented system," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 228-239.
    7. Irina V. Abankina & Fuad T. Aleskerov & Veronika Yu. Belousova & Leonid M. Gokhberg & Kirill V. Zinkovsky & Sofya G. Kiselgof & Vsevolod Petrushchenko & Sergey V. Shvydun, 2015. "Performance-Based Typology Of Universities: Evidence From Russia," HSE Working papers WP BRP 33/STI/2015, National Research University Higher School of Economics.
    8. Benedetto Lepori & Aldo Geuna & Valerio Veglio, 2017. "A Typology of European Research Universities. Differentiation, Layering and Resource Distribution," SPRU Working Paper Series 2017-01, SPRU - Science Policy Research Unit, University of Sussex Business School.
    9. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Efficiency and economies of scale and specialization in European universities: A directional distance approach," Journal of Informetrics, Elsevier, vol. 9(3), pages 430-448.
    10. Claudia Curi & Cinzia Daraio & Patrick Llerena, 2012. "University technology transfer: how (in)efficient are French universities?," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 36(3), pages 629-654.
    11. Andrea Bonaccorsi & Daniele Biancardi & Mabel Sanchez Barrioluengo & Federico Biagi, 2019. "Study on Higher Education Institutions and Local Development," JRC Research Reports JRC117272, Joint Research Centre.
    12. Berbegal-Mirabent, Jasmina & Gil-Doménech, Dolors & de la Torre, Rocío, 2019. "Dealing with heterogeneity: An analysis of Spanish universities," TEC Empresarial, School of Business, Costa Rica Institute of Technology (ITCR), vol. 13(3), pages 58-77.
    13. Tommaso Agasisti & Ralph Hippe & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: empirical analyses in Europe," JRC Research Reports JRC106678, Joint Research Centre.
    14. Róbert Štefko & Jarmila Horváthová & Martina Mokrišová, 2021. "The Application of Graphic Methods and the DEA in Predicting the Risk of Bankruptcy," JRFM, MDPI, vol. 14(5), pages 1-19, May.
    15. Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017. "A Typology of European Universities. Differentiation and resource distribution," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201705, University of Turin.
    16. Calogero Guccio & Marco Ferdinando Martorana & Isidoro Mazza, 2016. "Efficiency assessment and convergence in teaching and research in Italian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1063-1094, June.
    17. Andreas Niederl & Andrea Bonaccorsi & Benedetto Lepori & Tasso Brandt & Daniela De Filippo & Ulrich Schmoch, 2014. "Mapping the European higher education landscape: new insights from the EUMIDA project," Chapters, in: Andrea Bonaccorsi (ed.), Knowledge, Diversity and Performance in European Higher Education, chapter 1, pages iii-iii, Edward Elgar Publishing.
    18. Zofio, Jose Luis & Aparicio, Juan & Barbero, Javier & Zabala-Iturriagagoitia, Jon Mikel, 2024. "Benchmarking performance through efficiency analysis trees: Improvement strategies for colombian higher education institutions," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    19. Telcs, András & Kosztyán, Zsolt Tibor & Banász, Zsuzsanna & Csányi, Vivien Valéria, 2019. "Felsőoktatási ligák, parciális rangsorok képzése biklaszterezési eljárásokkal [How to rate higher education systems partial rankings using bi-clustering methods]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(9), pages 905-931.
    20. Calogero Guccio & Marco Ferdinando Martorana & Luisa Monaco, 2016. "Evaluating the impact of the Bologna Process on the efficiency convergence of Italian universities: a non-parametric frontier approach," Journal of Productivity Analysis, Springer, vol. 45(3), pages 275-298, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:125:y:2020:i:2:d:10.1007_s11192-020-03717-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.