IDEAS home Printed from https://ideas.repec.org/a/kap/jproda/v39y2013i1p1-14.html
   My bibliography  Save this article

Assessing the evolution of school performance and value-added: trends over four years

Author

Listed:
  • M. Portela
  • A. Camanho
  • A. Keshvari

Abstract

This paper explores the changes in value added (VA) of a sample of schools for cohorts of students finishing secondary education between 2005 and 2008. VA estimates are based on distance measures obtained from DEA models. These measures are computed for each pupil in each school, and evaluate the distance between the school frontier in a given year and a pooled frontier comprising all schools analysed. The school VA is then computed by aggregating the VA scores for the cohort of pupils attending that school in a given year. The ratio between VA estimates for two consecutive cohorts, that attended the school in different years, is taken as the index of VA change. However, the evolution of school performance over time should consider not only the movements of the school frontier, but should also take into account other effects, such as the proximity of the students to the best-practices, represented by the school frontier, observed over time. For that purpose we developed an enhanced Malmquist index to evaluate the evolution of school performance over time. One of the components of the Malmquist index proposed measures VA change, and the other measures the ability of all school students to move closer to their own school best practices over time. The approach developed is applied to a sample of Portuguese secondary schools. Copyright Springer Science+Business Media, LLC 2013

Suggested Citation

  • M. Portela & A. Camanho & A. Keshvari, 2013. "Assessing the evolution of school performance and value-added: trends over four years," Journal of Productivity Analysis, Springer, vol. 39(1), pages 1-14, February.
    • Handle: RePEc:kap:jproda:v:39:y:2013:i:1:p:1-14
    DOI: 10.1007/s11123-012-0263-5
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s11123-012-0263-5
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11123-012-0263-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. M J Mancebon & C Mar Molinero, 2000. "Performance in primary schools," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 51(7), pages 843-854, July.
    2. M C A S Portela & E Thanassoulis & A Horncastle & T Maugg, 2011. "Productivity change in the water industry in England and Wales: application of the meta-Malmquist index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(12), pages 2173-2188, December.
    3. Kirjavainen, Tanja & Loikkanent, Heikki A., 1998. "Efficiency differences of finnish senior secondary schools: An application of DEA and Tobit analysis," Economics of Education Review, Elsevier, vol. 17(4), pages 377-394, October.
    4. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    5. Pastor, Jesus T. & Lovell, C.A. Knox, 2005. "A global Malmquist productivity index," Economics Letters, Elsevier, vol. 88(2), pages 266-271, August.
    6. M C A S Portela & A S Camanho, 2010. "Analysis of complementary methodologies for the estimation of school value added," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(7), pages 1122-1132, July.
    7. Portela, Maria C.A.S. & Thanassoulis, Emmanuel, 2010. "Malmquist-type indices in the presence of negative data: An application to bank branches," Journal of Banking & Finance, Elsevier, vol. 34(7), pages 1472-1483, July.
    8. Eric A. Hanushek, 1979. "Conceptual and Empirical Issues in the Estimation of Educational Production Functions," Journal of Human Resources, University of Wisconsin Press, vol. 14(3), pages 351-388.
    9. Laurens Cherchye & Kristof De Witte & Erwin Ooghe, 2008. "Equity and efficiency in private and public education: a nonparametric comparison," Working Papers of Department of Economics, Leuven ces0725, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    10. Cherchye, Laurens & De Witte, Kristof & Ooghe, Erwin & Nicaise, Ides, 2010. "Efficiency and equity in private and public education: A nonparametric comparison," European Journal of Operational Research, Elsevier, vol. 202(2), pages 563-573, April.
    11. K De Witte & E Thanassoulis & G Simpson & G Battisti & A Charlesworth-May, 2010. "Assessing pupil and school performance by non-parametric and parametric techniques," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(8), pages 1224-1237, August.
    12. Ladd, Helen F. & Walsh, Randall P., 2002. "Implementing value-added measures of school effectiveness: getting the incentives right," Economics of Education Review, Elsevier, vol. 21(1), pages 1-17, February.
    13. Shawna Grosskopf & Kathy J. Hayes & Lori L. Taylor & William L. Weber, 1999. "Anticipating the Consequences of School Reform: A New Use of DEA," Management Science, INFORMS, vol. 45(4), pages 608-620, April.
    14. A. Camanho & R. Dyson, 2006. "Data envelopment analysis and Malmquist indices for measuring group performance," Journal of Productivity Analysis, Springer, vol. 26(1), pages 35-49, August.
    15. D J Mayston, 2003. "Measuring and managing educational performance," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(7), pages 679-691, July.
    16. Berg, Sigbjorn Atle & Forsund, Finn R. & Hjalmarsson, Lennart & Suominen, Matti, 1993. "Banking efficiency in the Nordic countries," Journal of Banking & Finance, Elsevier, vol. 17(2-3), pages 371-388, April.
    17. Silva Portela, Maria Conceicao A. & Thanassoulis, Emmanuel, 2001. "Decomposing school and school-type efficiency," European Journal of Operational Research, Elsevier, vol. 132(2), pages 357-373, July.
    18. M. C. Portela & A. S. Camanho, 2007. "Performance Assessment of Portuguese Secondary Schools," Working Papers de Economia (Economics Working Papers) 07, Católica Porto Business School, Universidade Católica Portuguesa.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Laura López Torres & Diego Prior, 2014. "Measuring school demand in the presence of spatial dependence. A conditional approach," Investigaciones de Economía de la Educación volume 9, in: Adela García Aracil & Isabel Neira Gómez (ed.), Investigaciones de Economía de la Educación 9, edition 1, volume 9, chapter 4, pages 117-141, Asociación de Economía de la Educación.
    2. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    3. Aparicio, Juan & López-Torres, Laura & Santín, Daniel, 2018. "Economic crisis and public education. A productivity analysis using a Hicks-Moorsteen index," Economic Modelling, Elsevier, vol. 71(C), pages 34-44.
    4. Paola Azar & Gabriela Sicilia, 2021. "An assessment of pupil and school performance in public primary education in Uruguay," Documentos de Trabajo (working papers) 21-22, Instituto de Economía - IECON.
    5. Alexander Arévalo S & Víctor Giménez G & Diego Prior J, 2022. "Análisis de eficiencia en educación: una aplicación del método StoNED," Revista Desarrollo y Sociedad, Universidad de los Andes,Facultad de Economía, CEDE, vol. 92(2), pages 45-91, October.
    6. Aparicio, Juan & Ortiz, Lidia & Santín, Daniel, 2021. "Comparing group performance over time through the Luenberger productivity indicator: An application to school ownership in European countries," European Journal of Operational Research, Elsevier, vol. 294(2), pages 651-672.
    7. Blackburn, Vincent & Brennan, Shae & Ruggiero, John, 2014. "Measuring efficiency in Australian Schools: A preliminary analysis," Socio-Economic Planning Sciences, Elsevier, vol. 48(1), pages 4-9.
    8. Aparicio, Juan & Crespo-Cebada, Eva & Pedraja-Chaparro, Francisco & Santín, Daniel, 2017. "Comparing school ownership performance using a pseudo-panel database: A Malmquist-type index approach," European Journal of Operational Research, Elsevier, vol. 256(2), pages 533-542.
    9. Liu, Xiaohong & Yang, Jiangjiang & Xu, Chengzhen & Li, Xingchen & Zhu, Qingyuan, 2023. "Environmental regulation efficiency analysis by considering regional heterogeneity," Resources Policy, Elsevier, vol. 83(C).
    10. Tommaso Agasisti, 2014. "How does schools’ efficiency look like across Europe? An empirical analysis of Germany, Spain, France, Italy and UK using OECD PISA2012 data," Working papers 9, Società Italiana di Economia Pubblica.
    11. Azar, Paola & Sicilia, Gabriela, 2023. "Assessing potential improvement in education: Unravelling pupils' and schools’ inefficiencies using a multi-level metafrontier approach," Economic Modelling, Elsevier, vol. 118(C).
    12. Arbona, Alexei & Giménez, Víctor & López-Estrada, Sebastián & Prior, Diego, 2022. "Efficiency and quality in Colombian education: An application of the metafrontier Malmquist-Luenberger productivity index," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. Johnes, Jill, 2015. "Operational Research in education," European Journal of Operational Research, Elsevier, vol. 243(3), pages 683-696.
    3. Silva, Maria C.A. & Camanho, Ana S. & Barbosa, Flávia, 2020. "Benchmarking of secondary schools based on Students’ results in higher education," Omega, Elsevier, vol. 95(C).
    4. Aparicio, Juan & Ortiz, Lidia & Santín, Daniel, 2021. "Comparing group performance over time through the Luenberger productivity indicator: An application to school ownership in European countries," European Journal of Operational Research, Elsevier, vol. 294(2), pages 651-672.
    5. Aparicio, Juan & Crespo-Cebada, Eva & Pedraja-Chaparro, Francisco & Santín, Daniel, 2017. "Comparing school ownership performance using a pseudo-panel database: A Malmquist-type index approach," European Journal of Operational Research, Elsevier, vol. 256(2), pages 533-542.
    6. Aparicio, Juan & López-Torres, Laura & Santín, Daniel, 2018. "Economic crisis and public education. A productivity analysis using a Hicks-Moorsteen index," Economic Modelling, Elsevier, vol. 71(C), pages 34-44.
    7. Afsharian, Mohsen & Ahn, Heinz & Harms, Sören Guntram, 2019. "Performance comparison of management groups under centralised management," European Journal of Operational Research, Elsevier, vol. 278(3), pages 845-854.
    8. José Manuel Cordero & Daniel Santín & Rosa Simancas, 2017. "Assessing European primary school performance through a conditional nonparametric model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 364-376, April.
    9. Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2013. "A multilevel decomposition of school performance using robust nonparametric frontier techniques," Economics of Education Review, Elsevier, vol. 32(C), pages 104-121.
    10. Mohsen Afsharian & Heinz Ahn, 2015. "The overall Malmquist index: a new approach for measuring productivity changes over time," Annals of Operations Research, Springer, vol. 226(1), pages 1-27, March.
    11. V Giménez & D Prior & C Thieme, 2007. "Technical efficiency, managerial efficiency and objective-setting in the educational system: an international comparison," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(8), pages 996-1007, August.
    12. Azar, Paola & Sicilia, Gabriela, 2023. "Assessing potential improvement in education: Unravelling pupils' and schools’ inefficiencies using a multi-level metafrontier approach," Economic Modelling, Elsevier, vol. 118(C).
    13. Camanho, Ana S. & Varriale, Luisa & Barbosa, Flávia & Sobral, Thiago, 2021. "Performance assessment of upper secondary schools in Italian regions using a circular pseudo-Malmquist index," European Journal of Operational Research, Elsevier, vol. 289(3), pages 1188-1208.
    14. Claudio Thieme & Diego Prior & Víctor Giménez & Emili Tortosa-Ausina, 2011. "Desempeño de los centros educativos: ¿un problema de recursos o capacidades organizativas?," Hacienda Pública Española / Review of Public Economics, IEF, vol. 199(4), pages 81-118, December.
    15. Aparicio, Juan & Santin, Daniel, 2018. "A note on measuring group performance over time with pseudo-panels," European Journal of Operational Research, Elsevier, vol. 267(1), pages 227-235.
    16. José Manuel Cordero & Diego Prior & Rosa Simancas, 2016. "A comparison of public and private schools in Spain using robust nonparametric frontier methods," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 24(3), pages 659-680, September.
    17. Chen, Xiang & Grifell-Tatjé, Emili & Fu, Tsu-Tan, 2023. "A profit difference decomposition model for measuring group performance: an application to Chinese and Taiwanese commercial banks," Omega, Elsevier, vol. 120(C).
    18. M J Mancebón & M A Muñiz, 2008. "Private versus public high schools in Spain: disentangling managerial and programme efficiencies," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(7), pages 892-901, July.
    19. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "A survey of DEA applications," Omega, Elsevier, vol. 41(5), pages 893-902.
    20. M C A S Portela & A S Camanho, 2010. "Analysis of complementary methodologies for the estimation of school value added," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(7), pages 1122-1132, July.

    More about this item

    Keywords

    Data envelopment analysis; Malmquist index; Secondary education; School value-added; C61; C67; I21;
    All these keywords.

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C67 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Input-Output Models
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jproda:v:39:y:2013:i:1:p:1-14. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.