IDEAS home Printed from https://ideas.repec.org/p/ipu/wpaper/67.html
   My bibliography  Save this paper

Evaluating the Stability of School Performance Estimates for School Choice: Evidence for Italian Primary Schools

Author

Listed:
  • Tommaso Agasisti

    (Politecnico di Milano School of Management)

  • Veronica Minaya

    (Politecnico di Milano School of Management)

Abstract

School performance estimates have been used worldwide for both high-and low-stakes accountability purposes. It is expected that by evaluating school performance and making these results public, parents will use them to choose schools and schools will be motivated to increase performance. An institutional debate of this kind is likely to start in the near future in Italy, given the growing availability of indicators obtained through standardized test scores in reading and mathematics. Using administrative data provided by INVALSI (National Evaluation Committee for Education), this paper explores the stability of performance estimates for Italian primary schools. We first construct school performance metrics using INVALSI standardized tests and quarterly teacher assessments, by taking advantage of a rich array of individual level variables (including prior achievement) that allow us to estimate a school-effect in a ‘value added’ perspective. We then explore how sensitive school ratings are to the choice of performance metric and the use of different models to account for compositional differences due to students’ socioeconomic background. We also assess both cross-sectional differences in performance across schools and the persistence of these differences across cohorts. We find that school performance estimates are very robust whatever the models employed to control for compositional differences, but they are inconsistent across metrics and cohorts. We conclude that before using this kind of school-effects’ estimates for school choice purposes, more data and research is needed to understand the factors that drives the impact of a specific school on students’ results.

Suggested Citation

  • Tommaso Agasisti & Veronica Minaya, 2018. "Evaluating the Stability of School Performance Estimates for School Choice: Evidence for Italian Primary Schools," Working papers 67, Società Italiana di Economia Pubblica.
  • Handle: RePEc:ipu:wpaper:67
    as

    Download full text from publisher

    File URL: http://www.siepweb.it/siep/wp/wp-content/uploads/repec/1517998327Agasisti_Minaya_WP_SIEP_733.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 4, number 4, June.
    2. Sandra E. Black, 1999. "Do Better Schools Matter? Parental Valuation of Elementary Education," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 577-599.
    3. Adriana Di Liberto & Fabiano Schivardi & Giovanni Sulis, 2015. "Managerial practices and student performance," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 30(84), pages 683-728.
    4. Nicholas Bloom & Renata Lemos & Raffaella Sadun & John Van Reenen, 2015. "Does Management Matter in schools?," Economic Journal, Royal Economic Society, vol. 0(584), pages 647-674, May.
    5. Allen, Rebecca & Burgess, Simon, 2013. "Evaluating the provision of school performance information for school choice," Economics of Education Review, Elsevier, vol. 34(C), pages 175-190.
    6. Kenneth Y. Chay & Patrick J. McEwan & Miguel Urquiola, 2005. "The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools," American Economic Review, American Economic Association, vol. 95(4), pages 1237-1258, September.
    7. Massimiliano Bratti & Daniele Checchi & Antonio Filippin, 2007. "Geographical Differences in Italian Students' Mathematical Competencies: Evidence from Pisa 2003," Giornale degli Economisti, GDE (Giornale degli Economisti e Annali di Economia), Bocconi University, vol. 66(3), pages 299-333, November.
    8. David J. Deming, 2014. "Using School Choice Lotteries to Test Measures of School Effectiveness," American Economic Review, American Economic Association, vol. 104(5), pages 406-411, May.
    9. Simon Burgess & Ellen Greaves & Anna Vignoles & Deborah Wilson, 2015. "What Parents Want: School Preferences and School Choice," Economic Journal, Royal Economic Society, vol. 125(587), pages 1262-1289, September.
    10. Rosario Maria Ballatore & Margherita Fort & Andrea Ichino, 2018. "Tower of Babel in the Classroom: Immigrants and Natives in Italian Schools," Journal of Labor Economics, University of Chicago Press, vol. 36(4), pages 885-921.
    11. Bertoni, Marco & Brunello, Giorgio & Rocco, Lorenzo, 2013. "When the cat is near, the mice won't play: The effect of external examiners in Italian schools," Journal of Public Economics, Elsevier, vol. 104(C), pages 65-77.
    12. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 3, number 3, June.
    13. Tommaso Agasisti & Patrizia Falzetti & Mara Soncin, 2016. "Italian school principals’ managerial behaviors and students’ test scores: an empirical analysis," Working papers 43, Società Italiana di Economia Pubblica.
    14. David J. Deming & David Figlio, 2016. "Accountability in US Education: Applying Lessons from K-12 Experience to Higher Education," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 33-56, Summer.
    15. Tommaso Agasisti & Francesca Ieva & Anna Maria Paganoni, 2017. "Heterogeneity, school-effects and the North/South achievement gap in Italian secondary education: evidence from a three-level mixed model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 26(1), pages 157-180, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Burgess, Simon, 2016. "Human Capital and Education: The State of the Art in the Economics of Education," IZA Discussion Papers 9885, Institute of Labor Economics (IZA).
    2. Hinnerich, Björn Tyrefors & Vlachos, Jonas, 2017. "The impact of upper-secondary voucher school attendance on student achievement. Swedish evidence using external and internal evaluations," Labour Economics, Elsevier, vol. 47(C), pages 1-14.
    3. Erich Battistin & Lorenzo Neri, 2017. "School Performance, Score Inflation and Economic Geography," Working Papers 837, Queen Mary University of London, School of Economics and Finance.
    4. A. Di Liberto, 2013. "Length of stay in the host country and educational achievement of immigrant students: the Italian case," Working Paper CRENoS 201316, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.
    5. Tommaso Agasisti & Sergio Longobardi & Vincenzo Prete & Felice Russo, 2018. "Multidimensional poverty measures for analysing educational poverty in European countries," Working papers 73, Società Italiana di Economia Pubblica.
    6. David J. Deming & David Figlio, 2016. "Accountability in US Education: Applying Lessons from K-12 Experience to Higher Education," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 33-56, Summer.
    7. d'Este, Rocco & Einiö, Elias, 2018. "Asian Segregation and Scholastic Achievement: Evidence from Primary Schools in New York City," IZA Discussion Papers 11682, Institute of Labor Economics (IZA).
    8. W. Bentley MacLeod & Miguel Urquiola, 2018. "Is Education Consumption or Investment? Implications for the Effect of School Competition," NBER Working Papers 25117, National Bureau of Economic Research, Inc.
    9. Xiaozhou Ding & Christopher Bollinger & Michael Clark & William H. Hoyt, 2022. "Too Late to Buy a Home? School Redistricting and the Timing and Extent of Capitalization," CESifo Working Paper Series 9647, CESifo.
    10. Firpo, Sergio & Ponczek, Vladimir & Possebom, Vítor Augusto, 2014. "Private Education Market, Information on Test Scores and Tuition Practices," IZA Discussion Papers 8476, Institute of Labor Economics (IZA).
    11. Xiaozhou Ding & Christopher Bollinger & Michael Clark & William H. Hoyt, 2020. "How Do School District Boundary Changes and New School Proposals Affect Housing Prices," CESifo Working Paper Series 8069, CESifo.
    12. Boustan, Leah Platt & Kahn, Matthew E. & Rhode, Paul W. & Yanguas, Maria Lucia, 2020. "The effect of natural disasters on economic activity in US counties: A century of data," Journal of Urban Economics, Elsevier, vol. 118(C).
    13. Margaret Brehm & Scott A. Imberman & Michael Naretta, 2017. "Capitalization of Charter Schools into Residential Property Values," Education Finance and Policy, MIT Press, vol. 12(1), pages 1-27, Winter.
    14. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.
    15. Muñoz-Morales, Juan & Singh, Ruchi, 2023. "Do school shootings erode property values?," Regional Science and Urban Economics, Elsevier, vol. 98(C).
    16. Masi, Barbara, 2018. "A ticket to ride: The unintended consequences of school transport subsidies," Economics of Education Review, Elsevier, vol. 63(C), pages 100-115.
    17. Cavalieri, Marina & Finocchiaro Castro, Massimo & Guccio, Calogero, 2023. "Organised crime and educational outcomes in Southern Italy: An empirical investigation," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    18. Rosa Sanchis-Guarner & José Montalbán & Felix Weinhardt, 2021. "Home Broadband and Human Capital Formation," CESifo Working Paper Series 8846, CESifo.
    19. Sofia N. Andreou & Panos Pashardes & Nicoletta Pashourtidou, 2015. "The value of state education to consumers," University of Cyprus Working Papers in Economics 05-2015, University of Cyprus Department of Economics.
    20. Sofia N. Andreou & Panos Pashardes, 2013. "Consumers’ Valuation of Academic and Equality-inducing Aspects of School Performance in England," University of Cyprus Working Papers in Economics 09-2013, University of Cyprus Department of Economics.

    More about this item

    Keywords

    accountability; school choice; school value-added;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ipu:wpaper:67. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Monica Bozzano (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.