IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp7722.html
   My bibliography  Save this paper

Re-testing PISA Students One Year Later: On School Value Added Estimation Using OECD-PISA

Author

Listed:
  • Bratti, Massimiliano

    (Università degli Studi di Milano)

  • Checchi, Daniele

    (University of Milan)

Abstract

Thanks to the effort of two local educational authorities, in two regions of North Italy (Valle d'Aosta and the autonomous province of Trento) the PISA 2009 test was re-administered to the same students one year later. This paper is the first to analyse in the OECD-PISA context the potential advantages of re-testing the same students in order to provide better measures of schools' contributions to student achievement. We show that while cross-sectional measures of school value added based on PISA student literacy, which measures "knowledge for life", tend to be very volatile over time whenever there is a high year-to-year attrition in the student population, longitudinal measures of school value added are very robust to student attrition (even without controlling for sample selection). Moreover, persistence in individual test scores tends to be higher in highly "selective" (i.e. high drop-out) school environments.

Suggested Citation

  • Bratti, Massimiliano & Checchi, Daniele, 2013. "Re-testing PISA Students One Year Later: On School Value Added Estimation Using OECD-PISA," IZA Discussion Papers 7722, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp7722
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp7722.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angrist, Joshua D., 1997. "Conditional independence in sample selection models," Economics Letters, Elsevier, vol. 54(2), pages 103-112, February.
    2. Massimiliano Bratti & Abigail McKnight & Robin Naylor & Jeremy Smith, 2004. "Higher education outcomes, graduate employment and university performance indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(3), pages 475-496, August.
    3. Jesse Rothstein, 2009. "Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables," Education Finance and Policy, MIT Press, vol. 4(4), pages 537-571, October.
    4. Roland Bénabou, 1996. "Equity and Efficiency in Human Capital Investment: The Local Connection," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 63(2), pages 237-264.
    5. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    6. Bratti, Massimiliano & Checchi, Daniele & Filippin, Antonio, 2007. "Territorial Differences in Italian Students’ Mathematical Competencies: Evidence from PISA 2003," IZA Discussion Papers 2603, Institute of Labor Economics (IZA).
    7. Patrick Puhani, 2000. "The Heckman Correction for Sample Selection and Its Critique," Journal of Economic Surveys, Wiley Blackwell, vol. 14(1), pages 53-68, February.
    8. Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages 3-33, February.
    9. Harvey Goldstein & David J. Spiegelhalter, 1996. "League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(3), pages 385-409, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Richard B. Freeman & Martina Viarengo, 2014. "School and family effects on educational outcomes across countries [Teaching practices and social capital]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 29(79), pages 395-446.
    2. Enrico Conti & Silvia Duranti & Carla Rampichini & Nicola Sciclone, 2015. "Quanto conta l?effetto scuola nel ciclo primario? L?efficacia delle istituzioni scolastiche in Toscana," ECONOMIA PUBBLICA, FrancoAngeli Editore, vol. 2015(3), pages 59-84.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meghir, Costas & Rivkin, Steven, 2011. "Econometric Methods for Research in Education," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 1, pages 1-87, Elsevier.
    2. Vandenberghe, V. & Robin, S., 2004. "Evaluating the effectiveness of private education across countries: a comparison of methods," Labour Economics, Elsevier, vol. 11(4), pages 487-506, August.
    3. Massimiliano Bratti & Abigail McKnight & Robin Naylor & Jeremy Smith, 2004. "Higher education outcomes, graduate employment and university performance indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(3), pages 475-496, August.
    4. Muñoz H., Pablo & Redondo S., Amaia, 2013. "Inequality and academic achievement in Chile," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), April.
    5. Lechmann, Daniel S. J., 2017. "Estimating labor supply in self-employment: Pitfalls and resolutions," Discussion Papers 101, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Labour and Regional Economics.
    6. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    7. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    8. Giulio Zanella, 2004. "Discrete Choice with Social Interactions and Endogenous Memberships," Department of Economics University of Siena 442, Department of Economics, University of Siena.
    9. Patrick Bayer & Stephen L. Ross, 2006. "Identifying Individual and Group Effects in the Presence of Sorting: A Neighborhood Effects Application," Working papers 2006-13, University of Connecticut, Department of Economics, revised Jan 2009.
    10. Arndt Reichert & Harald Tauchmann, 2014. "When outcome heterogeneously matters for selection: a generalized selection correction estimator," Applied Economics, Taylor & Francis Journals, vol. 46(7), pages 762-768, March.
    11. Bolwig, Simon & Gibbon, Peter & Jones, Sam, 2009. "The Economics of Smallholder Organic Contract Farming in Tropical Africa," World Development, Elsevier, vol. 37(6), pages 1094-1104, June.
    12. Eric J. Tchetgen Tchetgen & Kathleen E. Wirth, 2017. "A general instrumental variable framework for regression analysis with outcome missing not at random," Biometrics, The International Biometric Society, vol. 73(4), pages 1123-1131, December.
    13. Pastwa, Anna M. & Shrestha, Prabal & Thewissen, James & Torsin, Wouter, 2021. "Unpacking the black box of ICO white papers: a topic modeling approach," LIDAM Discussion Papers LFIN 2021018, Université catholique de Louvain, Louvain Finance (LFIN).
    14. Oren Gazal‐Ayal & Raanan Sulitzeanu‐Kenan, 2010. "Let My People Go: Ethnic In‐Group Bias in Judicial Decisions—Evidence from a Randomized Natural Experiment," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 7(3), pages 403-428, September.
    15. Thapa, Samir & Morrison, Mark & Parton, Kevin A, 2021. "Willingness to pay for domestic biogas plants and distributing carbon revenues to influence their purchase: A case study in Nepal," Energy Policy, Elsevier, vol. 158(C).
    16. Ertan, Arhan & Fiszbein, Martin & Putterman, Louis, 2016. "Who was colonized and when? A cross-country analysis of determinants," European Economic Review, Elsevier, vol. 83(C), pages 165-184.
    17. Neumayer, Eric, 2002. "Is Good Governance Rewarded? A Cross-national Analysis of Debt Forgiveness," World Development, Elsevier, vol. 30(6), pages 913-930, June.
    18. Pfeifer, Christian, 2007. "Eine theoretische und empirische Analyse der betrieblichen Determinanten von Teilzeitarbeit, Mini- und Midi-Jobs (A theoretical and empirical analysis of the company determinants of part-time work, mi," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 40(1), pages 65-76.
    19. Sasidharan, Subash & Kathuria, Vinish, 2011. "Foreign Direct Investment and R&D: Substitutes or Complements--A Case of Indian Manufacturing after 1991 Reforms," World Development, Elsevier, vol. 39(7), pages 1226-1239, July.
    20. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.

    More about this item

    Keywords

    school value added; OECD-PISA; Italy; student attrition;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp7722. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.