IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v92y2024ics0038012124000442.html
   My bibliography  Save this article

Benchmarking performance through efficiency analysis trees: Improvement strategies for colombian higher education institutions

Author

Listed:
  • Zofio, Jose Luis
  • Aparicio, Juan
  • Barbero, Javier
  • Zabala-Iturriagagoitia, Jon Mikel

Abstract

We introduce benchmarking analysis based on state-of-the-art machine learning techniques applied to the measurement of efficiency to assess the performance of Higher Education Institutions (HEIs). We rely on Efficiency Analysis Trees (EAT) and its Convexified frontier counterpart (CEAT) to assess the efficiency of 144 private HEIs in Colombia and compare the results with those achieved with classical Data Envelopment Analysis (DEA). Both EAT and CEAT show a higher discriminatory power than DEA when determining efficiency scores. Our results identify the different splits of the production frontier, corresponding to each node of the efficiency tree, which groups HEIs according to specific management models. By identifying relevant peers for inefficient observations at the node level, we show which strategic guidelines can be adopted to improve the performance of each HEI. This process encourages mutual learning and suggests potential changes within each node leading to efficiency improvements.

Suggested Citation

  • Zofio, Jose Luis & Aparicio, Juan & Barbero, Javier & Zabala-Iturriagagoitia, Jon Mikel, 2024. "Benchmarking performance through efficiency analysis trees: Improvement strategies for colombian higher education institutions," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    • Handle: RePEc:eee:soceps:v:92:y:2024:i:c:s0038012124000442
    DOI: 10.1016/j.seps.2024.101845
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012124000442
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.seps.2024.101845?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J. Colin Glass & Gillian McCallion & Donal McKillop & Syamarlah Rasaratnam & Karl Stringer, 2009. "Best-practice benchmarking in UK higher education: new nonparametric approaches using financial ratios and profit efficiency methodologies," Applied Economics, Taylor & Francis Journals, vol. 41(2), pages 249-267.
    2. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    3. Ligia Alba Melo-Becerra & Jorge Enrique Ramos-Forero & Pedro Oswaldo Hernández-Santamaría, 2017. "La educación superior en Colombia: situación actual y análisis de eficiencia," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE, vol. 78, February.
    4. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    5. Charles, Vincent & Aparicio, Juan & Zhu, Joe, 2019. "The curse of dimensionality of decision-making units: A simple approach to increase the discriminatory power of data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 279(3), pages 929-940.
    6. Kerstens, Kristiaan & Sadeghi, Jafar & Van de Woestyne, Ignace, 2019. "Convex and nonconvex input-oriented technical and economic capacity measures: An empirical comparison," European Journal of Operational Research, Elsevier, vol. 276(2), pages 699-709.
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Cesaroni, Giovanni & Kerstens, Kristiaan & Van de Woestyne, Ignace, 2017. "Global and local scale characteristics in convex and nonconvex nonparametric technologies: A first empirical exploration," European Journal of Operational Research, Elsevier, vol. 259(2), pages 576-586.
    9. Thursby, Jerry G. & Kemp, Sukanya, 2002. "Growth and productive efficiency of university intellectual property licensing," Research Policy, Elsevier, vol. 31(1), pages 109-124, January.
    10. Andrea Bonaccorsi & Cinzia Daraio, 2008. "The differentiation of the strategic profile of higher education institutions. New positioning indicators based on microdata," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(1), pages 15-37, January.
    11. Ruiz, José L. & Segura, José V. & Sirvent, Inmaculada, 2015. "Benchmarking and target setting with expert preferences: An application to the evaluation of educational performance of Spanish universities," European Journal of Operational Research, Elsevier, vol. 242(2), pages 594-605.
    12. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Efficiency and economies of scale and specialization in European universities: A directional distance approach," Journal of Informetrics, Elsevier, vol. 9(3), pages 430-448.
    13. Juan Aparicio & Miriam Esteve & Jesus J. Rodriguez-Sala & Jose L. Zofio, 2021. "The Estimation of Productive Efficiency Through Machine Learning Techniques: Efficiency Analysis Trees," International Series in Operations Research & Management Science, in: Joe Zhu & Vincent Charles (ed.), Data-Enabled Analytics, pages 51-92, Springer.
    14. Balk, Bert M. & (René) De Koster, M.B.M. & Kaps, Christian & Zofío, José L., 2021. "An evaluation of cross-efficiency methods: With an application to warehouse performance," Applied Mathematics and Computation, Elsevier, vol. 406(C).
    15. Jesus Pastor & C. Lovell & Juan Aparicio, 2012. "Families of linear efficiency programs based on Debreu’s loss function," Journal of Productivity Analysis, Springer, vol. 38(2), pages 109-120, October.
    16. Juan Aparicio & Dorys Yaneth Rodríguez & Jon Mikel Zabala-Iturriagagoitia, 2021. "The systemic approach as an instrument to evaluate higher education systems: Opportunities and challenges [Benchmarking Universities’ Efficiency Indicators in the Presence of Internal Heterogeneity," Research Evaluation, Oxford University Press, vol. 30(3), pages 336-348.
    17. Eva M de la Torre & Fernando Casani & Marti Sagarra, 2018. "Defining typologies of universities through a DEA-MDS analysis: An institutional characterization for formative evaluation purposes," Research Evaluation, Oxford University Press, vol. 27(4), pages 388-403.
    18. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    19. Navas, Lina P. & Montes, Felipe & Abolghasem, Sepideh & Salas, Ricardo J. & Toloo, Mehdi & Zarama, Roberto, 2020. "Colombian higher education institutions evaluation," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    20. Tommaso Agasisti, 2011. "Performances and spending efficiency in higher education: a European comparison through non-parametric approaches," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 199-224.
    21. Roger Carrington & Tim Coelli & D. S. Prasada Rao, 2005. "The Performance Of Australian Universities: Conceptual Issues And Preliminary Results," Economic Papers, The Economic Society of Australia, vol. 24(2), pages 145-163, June.
    22. Susanne Warning, 2004. "Performance Differences in German Higher Education: Empirical Analysis of Strategic Groups," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 24(4), pages 393-408, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ebrahimi, Bohlool & Dhamotharan, Lalitha & Ghasemi, Mohammad Reza & Charles, Vincent, 2022. "A cross-inefficiency approach based on the deviation variables framework," Omega, Elsevier, vol. 111(C).
    2. Esteve, Miriam & Aparicio, Juan & Rodriguez-Sala, Jesus J. & Zhu, Joe, 2023. "Random Forests and the measurement of super-efficiency in the context of Free Disposal Hull," European Journal of Operational Research, Elsevier, vol. 304(2), pages 729-744.
    3. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    4. Renato A. Villano & Carolyn‐Dung T. T. Tran, 2021. "Survey on technical efficiency in higher education: A meta‐fractional regression analysis," Pacific Economic Review, Wiley Blackwell, vol. 26(1), pages 110-135, February.
    5. Cristian Barra & Roberto Zotti, 2016. "Measuring Efficiency in Higher Education: An Empirical Study Using a Bootstrapped Data Envelopment Analysis," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 22(1), pages 11-33, February.
    6. Mishra, Neelesh Kumar & Chakraborty, Abhishek & Singh, Sanjeet & Ranjan, Prabhat, 2023. "Efficiency analysis of engineering colleges in India: Decomposition into parallel sub-processes systems," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    7. Manuel Salas-Velasco, 2024. "Nonparametric efficiency measurement of undergraduate teaching by university size," Operational Research, Springer, vol. 24(1), pages 1-29, March.
    8. Dag Fjeld Edvardsen & Finn R. Førsund & Sverre A. C. Kittelsen, 2017. "Productivity development of Norwegian institutions of higher education 2004–2013," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 399-415, April.
    9. Delimiro Visbal-Cadavid & Mónica Martínez-Gómez & Francisco Guijarro, 2017. "Assessing the Efficiency of Public Universities through DEA. A Case Study," Sustainability, MDPI, vol. 9(8), pages 1-19, August.
    10. Raul Moragues & Juan Aparicio & Miriam Esteve, 2023. "Ranking the Importance of Variables in a Nonparametric Frontier Analysis Using Unsupervised Machine Learning Techniques," Mathematics, MDPI, vol. 11(11), pages 1-24, June.
    11. Alexander Arévalo S & Víctor Giménez G & Diego Prior J, 2022. "Análisis de eficiencia en educación: una aplicación del método StoNED," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE, vol. 92(2), pages 45-91, October.
    12. Tommaso Agasisti & Cristian Barra & Roberto Zotti, 2019. "Research, knowledge transfer, and innovation: The effect of Italian universities’ efficiency on local economic development 2006−2012," Journal of Regional Science, Wiley Blackwell, vol. 59(5), pages 819-849, November.
    13. Sanjeet Singh & Prabhat Ranjan, 2018. "Efficiency analysis of non-homogeneous parallel sub-unit systems for the performance measurement of higher education," Annals of Operations Research, Springer, vol. 269(1), pages 641-666, October.
    14. Daraio, Cinzia & Simar, Léopold & Wilson, Paul W., 2021. "Quality as a latent heterogeneity factor in the efficiency of universities," Economic Modelling, Elsevier, vol. 99(C).
    15. Liu, John S. & Lu, Wen-Min, 2010. "DEA and ranking with the network-based approach: a case of R&D performance," Omega, Elsevier, vol. 38(6), pages 453-464, December.
    16. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    17. Yang, Guoliang & Ahlgren, Per & Yang, Liying & Rousseau, Ronald & Ding, Jielan, 2016. "Using multi-level frontiers in DEA models to grade countries/territories," Journal of Informetrics, Elsevier, vol. 10(1), pages 238-253.
    18. Rafael Benítez & Vicente Coll-Serrano & Vicente J. Bolós, 2021. "deaR-Shiny: An Interactive Web App for Data Envelopment Analysis," Sustainability, MDPI, vol. 13(12), pages 1-19, June.
    19. Aparicio, Juan & López-Torres, Laura & Santín, Daniel, 2018. "Economic crisis and public education. A productivity analysis using a Hicks-Moorsteen index," Economic Modelling, Elsevier, vol. 71(C), pages 34-44.
    20. Manuel Salas-Velasco, 2020. "Measuring and explaining the production efficiency of Spanish universities using a non-parametric approach and a bootstrapped-truncated regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 825-846, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:92:y:2024:i:c:s0038012124000442. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.