IDEAS home Printed from https://ideas.repec.org/a/kap/jproda/v51y2019i2d10.1007_s11123-019-00549-6.html
   My bibliography  Save this article

Measuring the efficiency of European education systems by combining Data Envelopment Analysis and Multiple-Criteria Evaluation

Author

Listed:
  • Tommaso Agasisti

    (Economics and Industrial Engineering)

  • Giuseppe Munda

    (European Commission, Joint Research Centre (JRC))

  • Ralph Hippe

    (European Commission, Joint Research Centre (JRC))

Abstract

Education is considered an important factor of economic growth, employment and social inclusion. However, the economic crisis has put the need to achieve educational goals in the most efficient way ever more to the fore. The main objective of this paper is to assess the spending efficiency of European compulsory educational systems, creating a ranking of countries based on the efficiency scores of their systems using a number of standard variables from the literature. To this end, we also present a methodological innovation that combines Data Envelopment Analysis (DEA) with discrete Multiple Criteria Evaluation (MCE), two methods that we consider complementary if used for providing a performance analysis. Moreover, both methods identify a set of common variables which are associated with higher levels of efficiency in educational systems (e.g. some characteristics of teachers, the stock of adults’ human capital and lower expenditures per student). The results show that findings using DEA are largely confirmed by MCE.

Suggested Citation

  • Tommaso Agasisti & Giuseppe Munda & Ralph Hippe, 2019. "Measuring the efficiency of European education systems by combining Data Envelopment Analysis and Multiple-Criteria Evaluation," Journal of Productivity Analysis, Springer, vol. 51(2), pages 105-124, June.
  • Handle: RePEc:kap:jproda:v:51:y:2019:i:2:d:10.1007_s11123-019-00549-6
    DOI: 10.1007/s11123-019-00549-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11123-019-00549-6
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11123-019-00549-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. William W. Cooper & Lawrence M. Seiford & Joe Zhu (ed.), 2011. "Handbook on Data Envelopment Analysis," International Series in Operations Research and Management Science, Springer, number 978-1-4419-6151-8, April.
    2. Eric Hanushek & Ludger Woessmann, 2012. "Do better schools lead to more growth? Cognitive skills, economic outcomes, and causation," Journal of Economic Growth, Springer, vol. 17(4), pages 267-321, December.
    3. Leopold Simar & Paul Wilson, 2000. "A general methodology for bootstrapping in non-parametric frontier models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 27(6), pages 779-802.
    4. Tommaso Agasisti & Ralph Hippe & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: empirical analyses in Europe," JRC Research Reports JRC106678, Joint Research Centre.
    5. Sacerdote, Bruce, 2011. "Peer Effects in Education: How Might They Work, How Big Are They and How Much Do We Know Thus Far?," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 4, pages 249-277, Elsevier.
    6. Tarja Joro & Pekka Korhonen & Jyrki Wallenius, 1998. "Structural Comparison of Data Envelopment Analysis and Multiple Objective Linear Programming," Management Science, INFORMS, vol. 44(7), pages 962-970, July.
    7. Douglas Sutherland & Robert Price & Eric Gonand, 2009. "Improving public spending efficiency in primary and secondary education," OECD Journal: Economic Studies, OECD Publishing, vol. 2009(1), pages 1-30.
    8. Hanushek, Eric A. & Woessmann, Ludger, 2011. "The Economics of International Differences in Educational Achievement," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 2, pages 89-200, Elsevier.
    9. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    10. Emrouznejad, Ali & Yang, Guo-liang, 2018. "A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 4-8.
    11. Pritchett, Lant & Filmer, Deon, 1999. "What education production functions really show: a positive theory of education expenditures," Economics of Education Review, Elsevier, vol. 18(2), pages 223-239, April.
    12. Fried, Harold O. & Lovell, C. A. Knox & Schmidt, Shelton S. (ed.), 2008. "The Measurement of Productive Efficiency and Productivity Growth," OUP Catalogue, Oxford University Press, number 9780195183528.
    13. W. Alexander & Alfred Haug & Mohammad Jaforullah, 2010. "A two-stage double-bootstrap data envelopment analysis of efficiency differences of New Zealand secondary schools," Journal of Productivity Analysis, Springer, vol. 34(2), pages 99-110, October.
    14. Boaz Golany & Eran Tamir, 1995. "Evaluating Efficiency-Effectiveness-Equality Trade-Offs: A Data Envelopment Analysis Approach," Management Science, INFORMS, vol. 41(7), pages 1172-1184, July.
    15. Giuseppe Munda, 2012. "Intensity of preference and related uncertainty in non-compensatory aggregation rules," Theory and Decision, Springer, vol. 73(4), pages 649-669, October.
    16. Eric A. Hanushek & Ludger Woessmann, 2008. "The Role of Cognitive Skills in Economic Development," Journal of Economic Literature, American Economic Association, vol. 46(3), pages 607-668, September.
    17. Benhabib, Jess & Spiegel, Mark M., 1994. "The role of human capital in economic development evidence from aggregate cross-country data," Journal of Monetary Economics, Elsevier, vol. 34(2), pages 143-173, October.
    18. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "A survey of DEA applications," Omega, Elsevier, vol. 41(5), pages 893-902.
    19. D Bouyssou, 1999. "Using DEA as a tool for MCDM: some remarks," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 50(9), pages 974-978, September.
    20. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    21. Grosskopf, Shawna & Moutray, Chad, 2001. "Evaluating performance in Chicago public high schools in the wake of decentralization," Economics of Education Review, Elsevier, vol. 20(1), pages 1-14, February.
    22. Walker, Warren E., 2009. "Does the best practice of rational-style model-based policy analysis already include ethical considerations?," Omega, Elsevier, vol. 37(6), pages 1051-1062, December.
    23. Léopold Simar & Paul Wilson, 2011. "Two-stage DEA: caveat emptor," Journal of Productivity Analysis, Springer, vol. 36(2), pages 205-218, October.
    24. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    25. Andrew Worthington, 2001. "An Empirical Survey of Frontier Efficiency Measurement Techniques in Education," Education Economics, Taylor & Francis Journals, vol. 9(3), pages 245-268.
    26. Li, Xiao-Bai & Reeves, Gary R., 1999. "A multiple criteria approach to data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 115(3), pages 507-517, June.
    27. Hanushek, Eric A. & Luque, Javier A., 2003. "Efficiency and equity in schools around the world," Economics of Education Review, Elsevier, vol. 22(5), pages 481-502, October.
    28. repec:dau:papers:123456789/7958 is not listed on IDEAS
    29. Haelermans, Carla & De Witte, Kristof, 2012. "The role of innovations in secondary school performance – Evidence from a conditional efficiency model," European Journal of Operational Research, Elsevier, vol. 223(2), pages 541-549.
    30. Doyle, J & Green, R, 1993. "Data envelopment analysis and multiple criteria decision making," Omega, Elsevier, vol. 21(6), pages 713-715, November.
    31. Mariana Cunha & Vera Rocha, 2012. "On the Efficiency of Public Higher Education Institutions in Portugal: An Exploratory Study," FEP Working Papers 468, Universidade do Porto, Faculdade de Economia do Porto.
    32. Geraint Johnes & Jill Johnes (ed.), 2004. "International Handbook on the Economics of Education," Books, Edward Elgar Publishing, number 2847.
    33. Kenneth J. Arrow & Herve Raynaud, 1986. "Social Choice and Multicriterion Decision-Making," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262511754, April.
    34. Romer, Paul M., 1990. "Human capital and growth: Theory and evidence," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 32(1), pages 251-286, January.
    35. Jose Manuel Cordero-Ferrera & Francisco Pedraja-Chaparro & Javier Salinas-Jimenez, 2008. "Measuring efficiency in education: an analysis of different approaches for incorporating non-discretionary inputs," Applied Economics, Taylor & Francis Journals, vol. 40(10), pages 1323-1339.
    36. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    37. Tommaso Agasisti, 2011. "Performances and spending efficiency in higher education: a European comparison through non-parametric approaches," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 199-224.
    38. Färe, Rolf & Karagiannis, Giannis, 2017. "The denominator rule for share-weighting aggregation," European Journal of Operational Research, Elsevier, vol. 260(3), pages 1175-1180.
    39. Robert J. Barro, 2001. "Human Capital and Growth," American Economic Review, American Economic Association, vol. 91(2), pages 12-17, May.
    40. Madlener, Reinhard & Antunes, Carlos Henggeler & Dias, Luis C., 2009. "Assessing the performance of biogas plants with multi-criteria and data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 197(3), pages 1084-1094, September.
    41. Shawna Grosskopf & Kathy J. Hayes & Lori L. Taylor, 2014. "Efficiency in Education: Research and Implications," Applied Economic Perspectives and Policy, Agricultural and Applied Economics Association, vol. 36(2), pages 175-210.
    42. Giuseppe Munda, 2008. "Social Multi-Criteria Evaluation for a Sustainable Economy," Springer Books, Springer, number 978-3-540-73703-2, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel Clermont & Julia Schaefer, 2019. "Identification of Outliers in Data Envelopment Analysis," Schmalenbach Business Review, Springer;Schmalenbach-Gesellschaft, vol. 71(4), pages 475-496, October.
    2. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    3. Aparicio, Juan & Ortiz, Lidia & Santín, Daniel, 2021. "Comparing group performance over time through the Luenberger productivity indicator: An application to school ownership in European countries," European Journal of Operational Research, Elsevier, vol. 294(2), pages 651-672.
    4. Giuseppe Coco & Raffaele Lagravinese & Giuliano Resce, 2020. "Beyond the weights: a multicriteria approach to evaluate inequality in education," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 18(4), pages 469-489, December.
    5. Briec, Walter & Dumas, Audrey & Kerstens, Kristiaan & Stenger, Agathe, 2022. "Generalised commensurability properties of efficiency measures: Implications for productivity indicators," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1481-1492.
    6. Marius Sorin Dincă & Gheorghiţa Dincă & Maria Letiţia Andronic & Anna Maria Pasztori, 2021. "Assessment of the European Union’s Educational Efficiency," Sustainability, MDPI, vol. 13(6), pages 1-29, March.
    7. Dyckhoff, Harald & Souren, Rainer, 2022. "Integrating multiple criteria decision analysis and production theory for performance evaluation: Framework and review," European Journal of Operational Research, Elsevier, vol. 297(3), pages 795-816.
    8. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    9. Legenzova Renata & Gaigalienė Asta & Rudytė Dalia & Skunčikienė Solveiga & Kazlauskienė Vilma, 2023. "Assessment of public education expenditure efficiency across Lithuanian municipalities," Financial Internet Quarterly (formerly e-Finanse), Sciendo, vol. 19(4), pages 63-79, December.
    10. Zorica Lazić & Aleksandar Đorđević & Albina Gazizulina, 2021. "Improvement of Quality of Higher Education Institutions as a Basis for Improvement of Quality of Life," Sustainability, MDPI, vol. 13(8), pages 1-27, April.
    11. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    12. Paolo Esposito & Emanuele Doronzo & Spiridione Lucio Dicorato, 2023. "The financial and green effects of cultural values on mission drifts in European social enterprises," Business Strategy and the Environment, Wiley Blackwell, vol. 32(1), pages 1-29, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    3. Tommaso Agasisti & Ralph Hippe & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: empirical analyses in Europe," JRC Research Reports JRC106678, Joint Research Centre.
    4. Cordero, Jose M. & Polo, Cristina & Santín, Daniel & Simancas, Rosa, 2018. "Efficiency measurement and cross-country differences among schools: A robust conditional nonparametric analysis," Economic Modelling, Elsevier, vol. 74(C), pages 45-60.
    5. Tommaso Agasisti, 2014. "How does schools’ efficiency look like across Europe? An empirical analysis of Germany, Spain, France, Italy and UK using OECD PISA2012 data," Working papers 9, Società Italiana di Economia Pubblica.
    6. Dyckhoff, Harald & Souren, Rainer, 2022. "Integrating multiple criteria decision analysis and production theory for performance evaluation: Framework and review," European Journal of Operational Research, Elsevier, vol. 297(3), pages 795-816.
    7. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    8. Delprato, Marcos & Antequera, Germán, 2021. "School efficiency in low and middle income countries: An analysis based on PISA for development learning survey," International Journal of Educational Development, Elsevier, vol. 80(C).
    9. José Manuel Cordero & Daniel Santín & Rosa Simancas, 2017. "Assessing European primary school performance through a conditional nonparametric model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 364-376, April.
    10. Cordero, Jose Manuel & Polo, Cristina & Simancas, Rosa, 2022. "Assessing the efficiency of secondary schools: Evidence from OECD countries participating in PISA 2015," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    11. Manuel Salas-Velasco, 2020. "Measuring and explaining the production efficiency of Spanish universities using a non-parametric approach and a bootstrapped-truncated regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 825-846, February.
    12. K. Kounetas & G. Androulakis & M. Kaisari & G. Manousakis, 2023. "Educational reforms and secondary school's efficiency performance in Greece: a bootstrap DEA and multilevel approach," Operational Research, Springer, vol. 23(1), pages 1-29, March.
    13. Cordero, José Manuel & Alonso-Morán, Edurne & Nuño-Solinis, Roberto & Orueta, Juan F. & Arce, Regina Sauto, 2015. "Efficiency assessment of primary care providers: A conditional nonparametric approach," European Journal of Operational Research, Elsevier, vol. 240(1), pages 235-244.
    14. Agasisti, Tommaso & de Oliveira Ribeiro, Celma & Montemor, Daniel Sanches, 2022. "The efficiency of Brazilian elementary public schools," International Journal of Educational Development, Elsevier, vol. 93(C).
    15. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    16. Stumbrienė, Dovilė & Želvys, Rimantas & Žilinskas, Julius & Dukynaitė, Rita & Jakaitienė, Audronė, 2022. "Efficiency and effectiveness analysis based on educational inclusion and fairness of European countries," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    17. Aparicio, Juan & Cordero, Jose M. & Gonzalez, Martin & Lopez-Espin, Jose J., 2018. "Using non-radial DEA to assess school efficiency in a cross-country perspective: An empirical analysis of OECD countries," Omega, Elsevier, vol. 79(C), pages 9-20.
    18. Fritz Schiltz & Kristof Witte & Deni Mazrekaj, 2020. "Managerial efficiency and efficiency differentials in adult education: a conditional and bias-corrected efficiency analysis," Annals of Operations Research, Springer, vol. 288(2), pages 529-546, May.
    19. Amir Moradi-Motlagh & Ali Emrouznejad, 2022. "The origins and development of statistical approaches in non-parametric frontier models: a survey of the first two decades of scholarly literature (1998–2020)," Annals of Operations Research, Springer, vol. 318(1), pages 713-741, November.
    20. Johnes, Jill, 2015. "Operational Research in education," European Journal of Operational Research, Elsevier, vol. 243(3), pages 683-696.

    More about this item

    Keywords

    Compulsory Education; Human Capital; Efficiency Analysis; Data Envelopment Analysis; Multiple-Criteria Evaluation; NAIADE method;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jproda:v:51:y:2019:i:2:d:10.1007_s11123-019-00549-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.