IDEAS home Printed from https://ideas.repec.org/p/uto/dipeco/202018.html
   My bibliography  Save this paper

Does Early Tracking Affect Learning Inequalities? Revisiting Difference-in-difference Modeling Strategies with International Assessments

Author

Listed:

Abstract

The development of international surveys on children’s learning like PISA, PIRLS and TIMSS – delivering comparable achievement measures across educational systems – has revealed large crosscountry variability in average performance and in the degree of inequality across social groups. A key question is whether and how institutional differences affect the level and distribution of educational outcomes. In this contribution, we discuss the difference-in-difference strategies employed in the existing literature to evaluate the effect of early tracking on learning inequalities exploiting international assessments administered at different age/grades. In their seminal paper, Hanushek and Woessmann (2006) analyze with two-step estimation the effect of early tracking on overall inequalities, measured by test scores’ variability indexes. Later work of other scholars in the economics and sociology of education focuses instead on inequalities among children of different family background, using individual-level models on pooled data from different countries and assessments. In this contribution, we show that individual pooled difference in difference models are quite restrictive and that in essence they estimate the effect of tracking by double differentiating the estimated cross-sectional family background regression coefficients between tracking regimes and learning assessments. Starting from a simple learning growth model, we show that if test scores at different surveys are not measured on the same scale, as occurs for international learning assessments, pooled individual models may deliver severely biased results. Instead, the scaling problem does not affect the two-step approach. For this reason, we suggest using two-step estimation also to analyze family-background achievement inequalities. Against this background, using PIRLS-2006 and PISA- 2012 we conduct two-step difference-in-difference analyses, finding new evidence that early tracking fosters both overall inequalities and family background differentials in reading literacy.

Suggested Citation

  • Contini, Dalit & Cugnata, Federica, 2020. "Does Early Tracking Affect Learning Inequalities? Revisiting Difference-in-difference Modeling Strategies with International Assessments," Department of Economics and Statistics Cognetti de Martiis. Working Papers 202018, University of Turin.
    • Handle: RePEc:uto:dipeco:202018
    as

    Download full text from publisher

    File URL: https://www.est.unito.it/do/home.pl/Download?doc=/allegati/wp2020dip/wp_18_2020.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Daniele Checchi & Luca Flabbi, 2013. "Intergenerational Mobility and Schooling Decisions in Germany and Italy: The Impact of Secondary School Tracks," Rivista di Politica Economica, SIPI Spa, issue 3, pages 7-57, July-Sept.
    2. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 4, number 4, June.
    3. Piopiunik, Marc, 2014. "The effects of early tracking on student performance: Evidence from a school reform in Bavaria," Economics of Education Review, Elsevier, vol. 42(C), pages 12-33.
    4. Hanushek, Eric A. & Woessmann, Ludger, 2011. "The Economics of International Differences in Educational Achievement," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 2, pages 89-200, Elsevier.
    5. Ruhose, Jens & Schwerdt, Guido, 2016. "Does early educational tracking increase migrant-native achievement gaps? Differences-in-differences evidence across countries," Economics of Education Review, Elsevier, vol. 52(C), pages 134-154.
    6. Ludger Woessmann, 2016. "The Importance of School Systems: Evidence from International Differences in Student Achievement," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 3-32, Summer.
    7. Woessmann Ludger, 2010. "Institutional Determinants of School Efficiency and Equity: German States as a Microcosm for OECD Countries," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 230(2), pages 234-270, April.
    8. Thomas Fuchs & Ludger Wößmann, 2008. "What accounts for international differences in student prformance? A re-examination using PISA data," Studies in Empirical Economics, in: Christian Dustmann & Bernd Fitzenberger & Stephen Machin (ed.), The Economics of Education and Training, pages 209-240, Springer.
    9. Eric A. Hanushek & Ludger Wössmann, 2006. "Does Educational Tracking Affect Performance and Inequality? Differences- in-Differences Evidence Across Countries," Economic Journal, Royal Economic Society, vol. 116(510), pages 63-76, March.
    10. Hanushek, Eric A. & Woessmann, Ludger, 2015. "The Knowledge Capital of Nations: Education and the Economics of Growth," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262029170, April.
    11. Gabriela Schütz & Heinrich W. Ursprung & Ludger Wößmann, 2008. "Education Policy and Equality of Opportunity," Kyklos, Wiley Blackwell, vol. 61(2), pages 279-308, May.
    12. Giorgio Brunello & Daniele Checchi, 2007. "Does school tracking affect equality of opportunity? New international evidence [‘Educational opportunities and the role of institutions’]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 22(52), pages 782-861.
    13. Roland G. Fryer & Steven D. Levitt, 2004. "Understanding the Black-White Test Score Gap in the First Two Years of School," The Review of Economics and Statistics, MIT Press, vol. 86(2), pages 447-464, May.
    14. Bol, Thijs & Witschge, Jacqueline & Van de Werfhorst, Herman & Dronkers, Jaap, 2013. "Curricula tracking and central examinations: counterbalancing the Impact of social background on student achievement in 36 countries," MPRA Paper 44675, University Library of Munich, Germany.
    15. Andreas Ammermueller, 2013. "Institutional Features of Schooling Systems and Educational Inequality: Cross-Country Evidence From PIRLS and PISA," German Economic Review, Verein für Socialpolitik, vol. 14(2), pages 190-213, May.
    16. Wößmann, Ludger, 2016. "The Importance of School Systems," Munich Reprints in Economics 43463, University of Munich, Department of Economics.
    17. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 3, number 3, June.
    18. Heisig, Jan Paul & Schaeffer, Merlin & Giesecke, Johannes, 2017. "The Costs of Simplicity: Why Multilevel Models May Benefit from Accounting for Cross-Cluster Differences in the Effects of Controls," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 82(4), pages 796-827.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Silvia Bianconcini & Stefania Mignani & Jacopo Mingozzi, 2023. "Assessing maths learning gaps using Italian longitudinal data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(3), pages 911-930, September.
    2. Contini Dalit & Di Tommaso Maria Laura & Muratori Caterina & Piazzalunga Daniela & Schiavon Lucia, 2022. "Who Lost the Most? Mathematics Achievement during the COVID-19 Pandemic," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 22(2), pages 399-408, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Contini, Dalit & Cugnata, Federica, 2018. "How do institutions affect learning inequalities? Revisiting difference-in-difference models with international assessments," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201817, University of Turin.
    2. Contini, Dalit & Cugnata, Federica, 2016. "Learning inequalities between primary and secondary school. Difference-in-difference with international assessments," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201607, University of Turin.
    3. Ludger Woessmann, 2016. "The Importance of School Systems: Evidence from International Differences in Student Achievement," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 3-32, Summer.
    4. Contini, Dalit, 2014. "Cross-sectional learning assessments: comparability of regression coefficients and validity of difference-in-difference estimation to evaluate institutional effects," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201431, University of Turin.
    5. Tuomas Pekkarinen, 2018. "School tracking and intergenerational social mobility," IZA World of Labor, Institute of Labor Economics (IZA), pages 1-56, December.
    6. Piopiunik, Marc, 2014. "The effects of early tracking on student performance: Evidence from a school reform in Bavaria," Economics of Education Review, Elsevier, vol. 42(C), pages 12-33.
    7. Annabelle Krause & Simone Schüller, 2014. "Evidence and Persistence of Education Inequality in an Early-Tracking System - The German Case," FBK-IRVAPP Working Papers 2014-07, Research Institute for the Evaluation of Public Policies (IRVAPP), Bruno Kessler Foundation.
    8. Hanushek, Eric A., 2021. "Addressing cross-national generalizability in educational impact evaluation," International Journal of Educational Development, Elsevier, vol. 80(C).
    9. Bonin, Holger, 2017. "The Potential Economic Benefits of Education of Migrants in the EU," IZA Research Reports 75, Institute of Labor Economics (IZA).
    10. Marchionni, Mariana & Vazquez, Emmanuel & Pinto, Florencia, 2012. "Desigualdad educativa en la Argentina. Análisis en base a los datos PISA 2009 [Education Inequality in Argentina. An analysis based on PISA 2009 data]," MPRA Paper 56420, University Library of Munich, Germany.
    11. Esser, Hartmut & Relikowski, Ilona, 2015. "Is Ability Tracking (Really) Responsible for Educational Inequalities in Achievement? A Comparison between the Country States Bavaria and Hesse in Germany," IZA Discussion Papers 9082, Institute of Labor Economics (IZA).
    12. Engzell, Per, 2017. "What Do Books in the Home Proxy For? A Cautionary Tale," Working Paper Series 1/2016, Stockholm University, Swedish Institute for Social Research.
    13. Checchi, Daniele & van de Werfhorst, Herman Gerbert, 2017. "Policies, Skills and Earnings: How Educational Inequality Affects Earnings Inequality," SocArXiv wn3h2, Center for Open Science.
    14. Elke Lüdemann, 2011. "Schooling and the Formation of Cognitive and Non-cognitive Outcomes," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 39.
    15. Marchionni, Mariana & Pinto, Florencia & Vazquez, Emmanuel, 2013. "Determinantes de la desigualdad en el desempeño educativo en la Argentina [Determinants of the inequality in PISA test scores in Argentina]," MPRA Paper 56421, University Library of Munich, Germany.
    16. Giannelli, Gianna Claudia & Rapallini, Chiara, 2019. "Parental occupation and children’s school outcomes in math," Research in Economics, Elsevier, vol. 73(4), pages 293-303.
    17. José M. Cordero & Víctor Cristóbal & Daniel Santín, 2018. "Causal Inference On Education Policies: A Survey Of Empirical Studies Using Pisa, Timss And Pirls," Journal of Economic Surveys, Wiley Blackwell, vol. 32(3), pages 878-915, July.
    18. De Paola, Maria & Brunello, Giorgio, 2016. "Education as a Tool for the Economic Integration of Migrants," IZA Discussion Papers 9836, Institute of Labor Economics (IZA).
    19. Maria A. Cattaneo & Chantal Oggenfuss & Stefan C. Wolter, 2017. "The more, the better? The impact of instructional time on student performance," Education Economics, Taylor & Francis Journals, vol. 25(5), pages 433-445, September.
    20. Murat, Marina & Bonacini, Luca, 2020. "Coronavirus pandemic, remote learning and education inequalities," GLO Discussion Paper Series 679, Global Labor Organization (GLO).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uto:dipeco:202018. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Piero Cavaleri or Marina Grazioli (email available below). General contact details of provider: https://edirc.repec.org/data/detorit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.