IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v69y2020ics0038012118301174.html
   My bibliography  Save this article

Adjusted indicators of quality and equity for monitoring the education systems over time. Insights on EU15 countries from PISA surveys

Author

Listed:
  • Sulis, Isabella
  • Giambona, Francesca
  • Porcu, Mariano

Abstract

In this work, we investigate how European countries belonging to EU15 are performing in terms of the quality and equity of their educational systems. To do so, we jointly analysed student competencies in mathematics and reading using data collected in four different waves (2006, 2009, 2012, 2015) by the Program for International Student Assessment (PISA) run by the Organisation for Economic Cooperation and Development (OECD). The aim of this analysis is twofold: (i) to assess the associations between students' competencies inmathematics and reading and their socioeconomic status and to investigate how this relationship varies across countries over time; (ii) to present a batch of adjusted indicators relevant to the investigation of educational performance over time in terms of quality (average student competencies) and equity (low association between student achievement and their socioeconomic backgrounds). We fitted a mixed-effect (multilevel) regression model with a bivariate latent structure and random intercepts and slopes to assess the effect of socioeconomic and cultural background on student competencies across countries over time and to assess the performance trajectories of EU15 countries with respect to European Commission benchmarks. We present and discuss our main findings and their implications in terms of the policies of EU15 countries.

Suggested Citation

  • Sulis, Isabella & Giambona, Francesca & Porcu, Mariano, 2020. "Adjusted indicators of quality and equity for monitoring the education systems over time. Insights on EU15 countries from PISA surveys," Socio-Economic Planning Sciences, Elsevier, vol. 69(C).
  • Handle: RePEc:eee:soceps:v:69:y:2020:i:c:s0038012118301174
    DOI: 10.1016/j.seps.2019.05.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012118301174
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.seps.2019.05.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jon Rasbash & George Leckie & Rebecca Pillinger & Jennifer Jenkins, 2010. "Children's educational progress: partitioning family, school and area effects," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(3), pages 657-682, July.
    2. Afonso, Antonio & St. Aubyn, Miguel, 2005. "Non-Parametric Approaches to Education and Health Efficiency in OECD Countries," Journal of Applied Economics, Universidad del CEMA, vol. 8(2), pages 1-20, November.
    3. Contini, Dalit & Tommaso, Maria Laura Di & Mendolia, Silvia, 2017. "The gender gap in mathematics achievement: Evidence from Italian data," Economics of Education Review, Elsevier, vol. 58(C), pages 32-42.
    4. Barro, Robert J. & Lee, Jong-Wha, 1993. "International comparisons of educational attainment," Journal of Monetary Economics, Elsevier, vol. 32(3), pages 363-394, December.
    5. Daniel Cohen & Marcelo Soto, 2007. "Growth and human capital: good data, good results," Journal of Economic Growth, Springer, vol. 12(1), pages 51-76, March.
    6. Massimiliano Bratti & Daniele Checchi & Antonio Filippin, 2007. "Geographical Differences in Italian Students' Mathematical Competencies: Evidence from Pisa 2003," Giornale degli Economisti, GDE (Giornale degli Economisti e Annali di Economia), Bocconi University, vol. 66(3), pages 299-333, November.
    7. Isabella Sulis & Vincenza Capursi, 2013. "Building up adjusted indicators of students’ evaluation of university courses using generalized item response models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 40(1), pages 88-102, January.
    8. Mikael Lindahl & Alan B. Krueger, 2001. "Education for Growth: Why and for Whom?," Journal of Economic Literature, American Economic Association, vol. 39(4), pages 1101-1136, December.
    9. David Lam & Suzanne Duryea, 1999. "Effects of Schooling on Fertility, Labor Supply, and Investments in Children, with Evidence from Brazil," Journal of Human Resources, University of Wisconsin Press, vol. 34(1), pages 160-192.
    10. Tommaso Agasisti & Sergio Longobardi, 2017. "Equality of Educational Opportunities, Schools’ Characteristics and Resilient Students: An Empirical Study of EU-15 Countries Using OECD-PISA 2009 Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 134(3), pages 917-953, December.
    11. Thomas Fuchs & Ludger Wößmann, 2008. "What accounts for international differences in student prformance? A re-examination using PISA data," Studies in Empirical Economics, in: Christian Dustmann & Bernd Fitzenberger & Stephen Machin (ed.), The Economics of Education and Training, pages 209-240, Springer.
    12. Isabella Sulis & Mariano Porcu, 2015. "Assessing Divergences in Mathematics and Reading Achievement in Italian Primary Schools: A Proposal of Adjusted Indicators of School Effectiveness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 122(2), pages 607-634, June.
    13. Eric A. Hanushek & Ludger Wössmann, 2006. "Does Educational Tracking Affect Performance and Inequality? Differences- in-Differences Evidence Across Countries," Economic Journal, Royal Economic Society, vol. 116(510), pages 63-76, March.
    14. David Draper & Mark Gittoes, 2004. "Statistical analysis of performance indicators in UK higher education," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(3), pages 449-474, August.
    15. John H. Tyler & Richard J. Murnane & John B. Willett, 2000. "Do the Cognitive Skills of School Dropouts Matter in the Labor Market?," Journal of Human Resources, University of Wisconsin Press, vol. 35(4), pages 748-754.
    16. Gary S. Becker, 1964. "Human Capital: A Theoretical and Empirical Analysis with Special Reference to Education, First Edition," NBER Books, National Bureau of Economic Research, Inc, number beck-5.
    17. Giambona, Francesca & Porcu, Mariano, 2018. "School size and students' achievement. Empirical evidences from PISA survey data," Socio-Economic Planning Sciences, Elsevier, vol. 64(C), pages 66-77.
    18. Jonathan Temple, 1999. "The New Growth Evidence," Journal of Economic Literature, American Economic Association, vol. 37(1), pages 112-156, March.
    19. N. Gregory Mankiw & David Romer & David N. Weil, 1992. "A Contribution to the Empirics of Economic Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(2), pages 407-437.
    20. Robert J. Barro, 2001. "Human Capital and Growth," American Economic Review, American Economic Association, vol. 91(2), pages 12-17, May.
    21. Lauer, Charlotte, 2003. "Family background, cohort and education: A French-German comparison based on a multivariate ordered probit model of educational attainment," Labour Economics, Elsevier, vol. 10(2), pages 231-251, April.
    22. George Leckie & Harvey Goldstein, 2009. "The limitations of using school league tables to inform school choice," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 835-851, October.
    23. Leckie, George & Charlton, Chris, 2013. "runmlwin: A Program to Run the MLwiN Multilevel Modeling Software from within Stata," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 52(i11).
    24. Hanushek, Eric A, 1995. "Interpreting Recent Research on Schooling in Developing Countries," The World Bank Research Observer, World Bank, vol. 10(2), pages 227-246, August.
    25. Agasisti, Tommaso & Longobardi, Sergio, 2014. "Inequality in education: Can Italian disadvantaged students close the gap?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 52(C), pages 8-20.
    26. Janet Currie & Enrico Moretti, 2003. "Mother's Education and the Intergenerational Transmission of Human Capital: Evidence from College Openings," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1495-1532.
    27. Martins, Lurdes & Veiga, Paula, 2010. "Do inequalities in parents' education play an important role in PISA students' mathematics achievement test score disparities?," Economics of Education Review, Elsevier, vol. 29(6), pages 1016-1033, December.
    28. Michele Raitano & Francesco Vona, 2016. "Assessing students’ equality of opportunity in OECD countries: the role of national- and school-level policies," Applied Economics, Taylor & Francis Journals, vol. 48(33), pages 3148-3163, July.
    29. Romer, Paul M, 1990. "Endogenous Technological Change," Journal of Political Economy, University of Chicago Press, vol. 98(5), pages 71-102, October.
    30. Jerik Hanushek & Dennis Kimko, 2006. "Schooling, Labor-force Quality, and the Growth of Nations," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 154-193.
    31. Hanushek, Eric A. & Luque, Javier A., 2003. "Efficiency and equity in schools around the world," Economics of Education Review, Elsevier, vol. 22(5), pages 481-502, October.
    32. Tommaso Agasisti & Sergio Longobardi & Andrea Regoli, 2014. "Does public spending improve educational resilience? A longitudinal analysis of OECD-PISA data," Working papers 3, Società Italiana di Economia Pubblica.
    33. Jacob Mincer, 1958. "Investment in Human Capital and Personal Income Distribution," Journal of Political Economy, University of Chicago Press, vol. 66(4), pages 281-281.
    34. Harvey Goldstein & David J. Spiegelhalter, 1996. "League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(3), pages 385-409, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alexander Arévalo S & Víctor Giménez G & Diego Prior J, 2022. "Análisis de eficiencia en educación: una aplicación del método StoNED," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE, vol. 92(2), pages 45-91, October.
    2. Vargas-Montoya, Luis & Gimenez, Gregorio & Fernández-Gutiérrez, Marcos, 2023. "ICT use for learning and students' outcomes: Does the country's development level matter?," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    3. De la Cruz, Marco & Mergoni, Anna, 2024. "Assessing the performance of Peruvian education system from a governance perspective," Socio-Economic Planning Sciences, Elsevier, vol. 93(C).
    4. Svetoslav Danchev & Georgios Gatopoulos & Niki Kalavrezou & Nikolaos Vettas, 2023. "Intergenerational Mobility in Education in Greece: an exploration into socioeconomic determinants of students' performance and future career plans before, during and after the crisis," GreeSE – Hellenic Observatory Papers on Greece and Southeast Europe 185, Hellenic Observatory, LSE.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Serge Coulombe & Jean-Francois Tremblay, 2009. "Education, Productivity and Economic Growth: A Selective Review of the Evidence," International Productivity Monitor, Centre for the Study of Living Standards, vol. 18, pages 3-24, Spring.
    2. Eric A. Hanushek & Ludger Woessmann, 2008. "The Role of Cognitive Skills in Economic Development," Journal of Economic Literature, American Economic Association, vol. 46(3), pages 607-668, September.
    3. Chen, Derek H. C. & Dahlman, Carl J., 2004. "Knowledge and development : a cross-section approach," Policy Research Working Paper Series 3366, The World Bank.
    4. Michael S. Delgado & Daniel J. Henderson & Christopher F. Parmeter, 2014. "Does Education Matter for Economic Growth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(3), pages 334-359, June.
    5. Ralph Hippe & Roger Fouquet, 2024. "The Human Capital Transition and the Role of Policy," Springer Books, in: Claude Diebolt & Michael Haupert (ed.), Handbook of Cliometrics, edition 3, pages 411-457, Springer.
    6. Eftimoski, Dimitar, 2022. "On the inconclusive effect of human capital on growth: A new look at extended specifications," Economic Analysis and Policy, Elsevier, vol. 76(C), pages 708-727.
    7. Pereira, João & St. Aubyn, Miguel, 2009. "What level of education matters most for growth?: Evidence from Portugal," Economics of Education Review, Elsevier, vol. 28(1), pages 67-73, February.
    8. Eric Hanushek & Ludger Woessmann, 2012. "Do better schools lead to more growth? Cognitive skills, economic outcomes, and causation," Journal of Economic Growth, Springer, vol. 17(4), pages 267-321, December.
    9. Antonio Ciccone & Elias Papaioannou, 2009. "Human Capital, the Structure of Production, and Growth," The Review of Economics and Statistics, MIT Press, vol. 91(1), pages 66-82, February.
    10. João Paulo Pereira, 2005. "Measuring Human Capital in Portugal," Notas Económicas, Faculty of Economics, University of Coimbra, issue 21, pages 16-34, June.
    11. Isabella Sulis & Mariano Porcu, 2015. "Assessing Divergences in Mathematics and Reading Achievement in Italian Primary Schools: A Proposal of Adjusted Indicators of School Effectiveness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 122(2), pages 607-634, June.
    12. Mueller, Normann, 2007. "(Mis-)Understanding Education Externalities," MPRA Paper 5331, University Library of Munich, Germany, revised Mar 2007.
    13. Rogers, Mark Llewellyn, 2008. "Directly unproductive schooling: How country characteristics affect the impact of schooling on growth," European Economic Review, Elsevier, vol. 52(2), pages 356-385, February.
    14. Jamison, Eliot A. & Jamison, Dean T. & Hanushek, Eric A., 2007. "The effects of education quality on income growth and mortality decline," Economics of Education Review, Elsevier, vol. 26(6), pages 771-788, December.
    15. Tan, Clifford, 2013. "The contribution of university rankings to country's GDP per capita," MPRA Paper 53900, University Library of Munich, Germany.
    16. Capolupo, Rosa, 2009. "The New Growth Theories and Their Empirics after Twenty Years," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 3, pages 1-72.
    17. Hanushek, Eric A. & Woessmann, Ludger, 2012. "Schooling, educational achievement, and the Latin American growth puzzle," Journal of Development Economics, Elsevier, vol. 99(2), pages 497-512.
    18. Audrey Siew Kim Lim & Kam Ki Tang, 2006. "Human inequality, human capital inequality and the Kuznets curve," CAMA Working Papers 2006-08, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    19. CHI, Wei, 2008. "The role of human capital in China's economic development: Review and new evidence," China Economic Review, Elsevier, vol. 19(3), pages 421-436, September.
    20. Columbu, Silvia & Porcu, Mariano & Sulis, Isabella, 2021. "University choice and the attractiveness of the study area: Insights on the differences amongst degree programmes in Italy based on generalised mixed-effect models," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:69:y:2020:i:c:s0038012118301174. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.