IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i13p1579-d588681.html
   My bibliography  Save this article

Efficiency Analysis with Educational Data: How to Deal with Plausible Values from International Large-Scale Assessments

Author

Listed:
  • Juan Aparicio

    (Center of Operations Research (CIO), University Miguel Hernandez of Elche (UMH), 03202 Elche, Spain)

  • Jose M. Cordero

    (Department of Economics, University of Extremadura (UEX), 06006 Badajoz, Spain)

  • Lidia Ortiz

    (Center of Operations Research (CIO), University Miguel Hernandez of Elche (UMH), 03202 Elche, Spain)

Abstract

International large-scale assessments (ILSAs) provide several measures as a representation of educational outcomes, the so-called plausible values, which are frequently interpreted as a representation of the ability range of students. In this paper, we focus on how this information should be incorporated into the estimation of efficiency measures of student or school performance using data envelopment analysis (DEA). Thus far, previous studies that have adopted this approach using data from ILSAs have used only one of the available plausible values or an average of all of them. We propose an approach based on the fuzzy DEA, which allows us to consider the whole distribution of results as a proxy of student abilities. To assess the extent to which our proposal offers similar results to those obtained in previous studies, we provide an empirical example using PISA data from 2015. Our results suggest that the performance measures estimated using the fuzzy DEA approach are strongly correlated with measures calculated using just one plausible value or an average measure. Therefore, we conclude that the studies that decide upon using one of these options do not seem to be making a significant error in their estimates.

Suggested Citation

  • Juan Aparicio & Jose M. Cordero & Lidia Ortiz, 2021. "Efficiency Analysis with Educational Data: How to Deal with Plausible Values from International Large-Scale Assessments," Mathematics, MDPI, vol. 9(13), pages 1-16, July.
    • Handle: RePEc:gam:jmathe:v:9:y:2021:i:13:p:1579-:d:588681
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/13/1579/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/9/13/1579/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Aparicio, Juan & Cordero, Jose M. & Ortiz, Lidia, 2019. "Measuring efficiency in education: The influence of imprecision and variability in data on DEA estimates," Socio-Economic Planning Sciences, Elsevier, vol. 68(C).
    2. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    3. Hatami-Marbini, Adel & Emrouznejad, Ali & Tavana, Madjid, 2011. "A taxonomy and review of the fuzzy data envelopment analysis literature: Two decades in the making," European Journal of Operational Research, Elsevier, vol. 214(3), pages 457-472, November.
    4. Waldo, Staffan, 2007. "On the use of student data in efficiency analysis--Technical efficiency in Swedish upper secondary school," Economics of Education Review, Elsevier, vol. 26(2), pages 173-185, April.
    5. Joseph L. Schafer, 2003. "Multiple Imputation in Multivariate Problems When the Imputation and Analysis Models Differ," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 57(1), pages 19-35, February.
    6. Aparicio, Juan & Cordero, Jose M. & Pastor, Jesus T., 2017. "The determination of the least distance to the strongly efficient frontier in Data Envelopment Analysis oriented models: Modelling and computational aspects," Omega, Elsevier, vol. 71(C), pages 1-10.
    7. José Manuel Cordero & Daniel Santín & Rosa Simancas, 2017. "Assessing European primary school performance through a conditional nonparametric model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 364-376, April.
    8. Kristof De Witte & Mika Kortelainen, 2013. "What explains the performance of students in a heterogeneous environment? Conditional efficiency estimation with continuous and discrete environmental variables," Applied Economics, Taylor & Francis Journals, vol. 45(17), pages 2401-2412, June.
    9. Aparicio, Juan & Cordero, Jose M. & Gonzalez, Martin & Lopez-Espin, Jose J., 2018. "Using non-radial DEA to assess school efficiency in a cross-country perspective: An empirical analysis of OECD countries," Omega, Elsevier, vol. 79(C), pages 9-20.
    10. Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2013. "A multilevel decomposition of school performance using robust nonparametric frontier techniques," Economics of Education Review, Elsevier, vol. 32(C), pages 104-121.
    11. Agasisti, Tommaso & Zoido, Pablo, 2019. "The efficiency of schools in developing countries, analysed through PISA 2012 data," Socio-Economic Planning Sciences, Elsevier, vol. 68(C).
    12. Ganzeboom, H.B.G. & de Graaf, P.M. & Treiman, D.J. & de Leeuw, J., 1992. "A standard international socio-economic index of occupational status," WORC Paper 92.01.001/1, Tilburg University, Work and Organization Research Centre.
    13. Eva Crespo-Cebada & Francisco Pedraja-Chaparro & Daniel Santín, 2014. "Does school ownership matter? An unbiased efficiency comparison for regions of Spain," Journal of Productivity Analysis, Springer, vol. 41(1), pages 153-172, February.
    14. Cordero, Jose M. & Polo, Cristina & Santín, Daniel & Simancas, Rosa, 2018. "Efficiency measurement and cross-country differences among schools: A robust conditional nonparametric analysis," Economic Modelling, Elsevier, vol. 74(C), pages 45-60.
    15. José-Manuel Sáez-López & María-Concepción Domínguez-Garrido & María-del-Castañar Medina-Domínguez & Fuensanta Monroy & Raúl González-Fernández, 2021. "The Competences from the Perception and Practice of University Students," Social Sciences, MDPI, vol. 10(2), pages 1-12, January.
    16. Maarten Marsman & Gunter Maris & Timo Bechger & Cees Glas, 2016. "What can we learn from Plausible Values?," Psychometrika, Springer;The Psychometric Society, vol. 81(2), pages 274-289, June.
    17. Kevin Macdonald, 2008. "PV: Stata module to perform estimation with plausible values," Statistical Software Components S456951, Boston College Department of Economics, revised 25 Oct 2023.
    18. Justo de Jorge Moreno & Daniel Santín, 2010. "Determinantes de la eficiencia educativa en la Unión Europea," Hacienda Pública Española / Review of Public Economics, IEF, vol. 193(2), pages 131-156, June.
    19. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    20. William W. Cooper & Lawrence M. Seiford & Kaoru Tone, 2007. "Data Envelopment Analysis," Springer Books, Springer, edition 0, number 978-0-387-45283-8, October.
    21. Francesco Avvisati & François Keslair, 2014. "REPEST: Stata module to run estimations with weighted replicate samples and plausible values," Statistical Software Components S457918, Boston College Department of Economics, revised 21 Mar 2024.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vargas-Montoya, Luis & Gimenez, Gregorio & Fernández-Gutiérrez, Marcos, 2023. "ICT use for learning and students' outcomes: Does the country's development level matter?," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    2. Henriques, C.O. & Chavez, J.M. & Gouveia, M.C. & Marcenaro-Gutierrez, O.D., 2022. "Efficiency of secondary schools in Ecuador: A value based DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 82(PA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cordero, Jose M. & Polo, Cristina & Santín, Daniel & Simancas, Rosa, 2018. "Efficiency measurement and cross-country differences among schools: A robust conditional nonparametric analysis," Economic Modelling, Elsevier, vol. 74(C), pages 45-60.
    2. Cordero, Jose Manuel & Polo, Cristina & Simancas, Rosa, 2022. "Assessing the efficiency of secondary schools: Evidence from OECD countries participating in PISA 2015," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    3. Aparicio, Juan & Ortiz, Lidia & Santín, Daniel, 2021. "Comparing group performance over time through the Luenberger productivity indicator: An application to school ownership in European countries," European Journal of Operational Research, Elsevier, vol. 294(2), pages 651-672.
    4. Capasso, Salvatore & Kaisari, Maria & Kounetas, Konstantinos & Lainas, Elias, 2024. "School productive performance and technology gaps: New evidence from PISA 2018," Economic Modelling, Elsevier, vol. 131(C).
    5. Aparicio, Juan & Cordero, Jose M. & Ortiz, Lidia, 2019. "Measuring efficiency in education: The influence of imprecision and variability in data on DEA estimates," Socio-Economic Planning Sciences, Elsevier, vol. 68(C).
    6. Mergoni, Anna & Soncin, Mara & Agasisti, Tommaso, 2023. "The effect of ICT on schools’ efficiency: Empirical evidence on 23 European countries," Omega, Elsevier, vol. 119(C).
    7. López-Torres, Laura & Prior, Diego, 2022. "Long-term efficiency of public service provision in a context of budget restrictions. An application to the education sector," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    8. Agasisti, Tommaso & de Oliveira Ribeiro, Celma & Montemor, Daniel Sanches, 2022. "The efficiency of Brazilian elementary public schools," International Journal of Educational Development, Elsevier, vol. 93(C).
    9. Aparicio, Juan & Cordero, Jose M. & Gonzalez, Martin & Lopez-Espin, Jose J., 2018. "Using non-radial DEA to assess school efficiency in a cross-country perspective: An empirical analysis of OECD countries," Omega, Elsevier, vol. 79(C), pages 9-20.
    10. Arbona, Alexei & Giménez, Víctor & López-Estrada, Sebastián & Prior, Diego, 2022. "Efficiency and quality in Colombian education: An application of the metafrontier Malmquist-Luenberger productivity index," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    11. Gabriella Sicilia & Rosa Simancas, 2023. "Eficiencia y equidad educativa en España: un análisis comparativo a nivel regional," Hacienda Pública Española / Review of Public Economics, IEF, vol. 245(2), pages 7-33, June.
    12. Alexander Arévalo S & Víctor Giménez G & Diego Prior J, 2022. "Análisis de eficiencia en educación: una aplicación del método StoNED," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE, vol. 92(2), pages 45-91, October.
    13. Paolo Liberati & Raffaele Lagravinese & Giuliano Resce, 2017. "How Does Economic Social And Cultural Status Affect The Efficiency Of Educational Attainments? A Comparative Analysis On Pisa Results," Departmental Working Papers of Economics - University 'Roma Tre' 0217, Department of Economics - University Roma Tre.
    14. Henriques, C.O. & Chavez, J.M. & Gouveia, M.C. & Marcenaro-Gutierrez, O.D., 2022. "Efficiency of secondary schools in Ecuador: A value based DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 82(PA).
    15. Aparicio, Juan & Cordero, Jose M. & Pastor, Jesus T., 2017. "The determination of the least distance to the strongly efficient frontier in Data Envelopment Analysis oriented models: Modelling and computational aspects," Omega, Elsevier, vol. 71(C), pages 1-10.
    16. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    17. López-Torres, Laura & Nicolini, Rosella & Prior, Diego, 2017. "Does strategic interaction affect demand for school places? A conditional efficiency approach," Regional Science and Urban Economics, Elsevier, vol. 65(C), pages 89-103.
    18. Cordero, José Manuel & Prior, Diego & Simancas Rodríguez, Rosa, 2013. "A comparison of public and private schools in Spain using robust nonparametric frontier methods," MPRA Paper 51375, University Library of Munich, Germany.
    19. José Manuel Cordero & Carlos Díaz Caro & Francisco Pedraja Chaparro & Cristina Polo Fernández, 2020. "Tributos cedidos y eficiencia en la gestión tributaria de las Comunidades Autónomas," Hacienda Pública Española / Review of Public Economics, IEF, vol. 232(1), pages 75-112, March.
    20. Aparicio, Juan & López-Torres, Laura & Santín, Daniel, 2018. "Economic crisis and public education. A productivity analysis using a Hicks-Moorsteen index," Economic Modelling, Elsevier, vol. 71(C), pages 34-44.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:13:p:1579-:d:588681. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.