IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v41y2014icp137-160.html
   My bibliography  Save this article

The distributional impacts of a universal school reform on mathematical achievements: A natural experiment from Canada

Author

Listed:
  • Haeck, Catherine
  • Lefebvre, Pierre
  • Merrigan, Philip

Abstract

We investigate the impact of an ambitious provincial school reform in Canada on students’ mathematical achievements. It is the first paper to exploit a universal school reform of this magnitude to identify the causal effect of a widely supported teaching approach on students’ math scores. Our data set allows us to differentiate impacts according to the number of years of treatment and the timing of treatment. Using the changes-in-changes model, we find that the reform had negative effects on students’ scores at all points on the skills distribution and that the effects were larger the longer the exposure to the reform.

Suggested Citation

  • Haeck, Catherine & Lefebvre, Pierre & Merrigan, Philip, 2014. "The distributional impacts of a universal school reform on mathematical achievements: A natural experiment from Canada," Economics of Education Review, Elsevier, vol. 41(C), pages 137-160.
    • Handle: RePEc:eee:ecoedu:v:41:y:2014:i:c:p:137-160
    DOI: 10.1016/j.econedurev.2014.03.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S027277571400034X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econedurev.2014.03.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    2. repec:mpr:mprres:5086 is not listed on IDEAS
    3. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    4. Michael Baker & Jonathan Gruber & Kevin Milligan, 2008. "Universal Child Care, Maternal Labor Supply, and Family Well-Being," Journal of Political Economy, University of Chicago Press, vol. 116(4), pages 709-745, August.
    5. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    6. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    7. Mark Bailey & Vani Borooah, 2010. "What enhances mathematical ability? A cross-country analysis based on test scores of 15-year-olds," Applied Economics, Taylor & Francis Journals, vol. 42(29), pages 3723-3733.
    8. Jackson, Erika & Page, Marianne E., 2013. "Estimating the distributional effects of education reforms: A look at Project STAR," Economics of Education Review, Elsevier, vol. 32(C), pages 92-103.
    9. Rouse, Cecilia Elena & Krueger, Alan B., 2004. "Putting computerized instruction to the test: a randomized evaluation of a "scientifically based" reading program," Economics of Education Review, Elsevier, vol. 23(4), pages 323-338, August.
    10. Caroline M. Hoxby, 2000. "The Effects of Class Size on Student Achievement: New Evidence from Population Variation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(4), pages 1239-1285.
    11. Eric A. Hanushek & Ludger Woessmann, 2008. "The Role of Cognitive Skills in Economic Development," Journal of Economic Literature, American Economic Association, vol. 46(3), pages 607-668, September.
    12. Machin, Stephen & McNally, Sandra, 2008. "The literacy hour," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1441-1462, June.
    13. Stephen G. Donald & Kevin Lang, 2007. "Inference with Difference-in-Differences and Other Panel Data," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 221-233, May.
    14. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    15. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    16. Joshua Angrist & Victor Lavy, 2002. "New Evidence on Classroom Computers and Pupil Learning," Economic Journal, Royal Economic Society, vol. 112(482), pages 735-765, October.
    17. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    18. Murnane, Richard J & Willett, John B & Levy, Frank, 1995. "The Growing Importance of Cognitive Skills in Wage Determination," The Review of Economics and Statistics, MIT Press, vol. 77(2), pages 251-266, May.
    19. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2011. "The Long-Term Impacts of Teachers: Teacher Value-Added and Student Outcomes in Adulthood," NBER Working Papers 17699, National Bureau of Economic Research, Inc.
    20. Heather Rose & Julian R. Betts, 2004. "The Effect of High School Courses on Earnings," The Review of Economics and Statistics, MIT Press, vol. 86(2), pages 497-513, May.
    21. Haeck, Catherine & Lefebvre, Pierre & Merrigan, Philip, 2015. "Canadian evidence on ten years of universal preschool policies: The good and the bad," Labour Economics, Elsevier, vol. 36(C), pages 137-157.
    22. Besley, Timothy & Case, Anne, 2000. "Unnatural Experiments? Estimating the Incidence of Endogenous Policies," Economic Journal, Royal Economic Society, vol. 110(467), pages 672-694, November.
    23. Eric A. Hanushek, 2003. "The Failure of Input-Based Schooling Policies," Economic Journal, Royal Economic Society, vol. 113(485), pages 64-98, February.
    24. Ingram, Beth F. & Neumann, George R., 2006. "The returns to skill," Labour Economics, Elsevier, vol. 13(1), pages 35-59, February.
    25. Jeffrey M. Wooldridge, 2003. "Cluster-Sample Methods in Applied Econometrics," American Economic Review, American Economic Association, vol. 93(2), pages 133-138, May.
    26. Ryan, Chris, 2013. "What is behind the decline in student achievement in Australia?," Economics of Education Review, Elsevier, vol. 37(C), pages 226-239.
    27. Eric A. Hanushek & Steven G. Rivkin, 2010. "The Quality and Distribution of Teachers under the No Child Left Behind Act," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 133-150, Summer.
    28. Richard J. Murnane & John B. Willett & Yves Duhaldeborde & John H. Tyler, 2000. "How important are the cognitive skills of teenagers in predicting subsequent earnings?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(4), pages 547-568.
    29. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    30. John Deke & Joshua Haimson, "undated". "Valuing Student Competencies: Which Ones Predict Postsecondary Educational Attainment and Earnings, and for Whom?," Mathematica Policy Research Reports be1c67f2201f4640b7381c0fa, Mathematica Policy Research.
    31. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    32. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pierre Lefebvre & Philip Merrigan, 2020. "Les inégalités provinciales aux tests internationaux-nationaux de littéracie : Québec, Ontario et autres provinces canadiennes 1993-2018 [Provincial achievement gaps from literacy surveys condu," Working Papers 20-02, Research Group on Human Capital, University of Quebec in Montreal's School of Management, revised Oct 2020.
    2. Pierre Lefebvre & Philip Merrigan, 2022. "Why Subsidize Independent Schools? Estimating the Effect of a Unique Canadian Schooling Model on Educational Attainment," Mathematics, MDPI, vol. 10(4), pages 1-22, February.
    3. Pierre Lefebvre & Philip Merrigan, 2020. "Les inégalités provinciales aux tests internationaux-nationaux de littéracie : Québec, Ontario et autres provinces canadiennes 1993-2018 (Version révisée et augmentée octobre 2020)," CIRANO Working Papers 2020s-29, CIRANO.
    4. Catherine Haeck & Pierre Lefebvre, 2020. "The Evolution of Cognitive Skills Inequalities by Socioeconomic Status across Canada," Working Papers 20-04, Research Group on Human Capital, University of Quebec in Montreal's School of Management.
    5. Simon Briole, 2019. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices in the US," PSE Working Papers halshs-01993616, HAL.
    6. Falch, Torberg & Nyhus, Ole Henning & Strøm, Bjarne, 2014. "Causal effects of mathematics," Labour Economics, Elsevier, vol. 31(C), pages 174-187.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Catherine Haeck & Pierre Lefebvre & Philip Merrigan, 2011. "The Distributional Impacts of a Universal School Reform on Mathematical Achievements: a Natural Experiment from Canada (revised)," Cahiers de recherche 1135, CIRPEE.
    2. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    3. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    4. Machin, Stephen & McNally, Sandra, 2008. "The literacy hour," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1441-1462, June.
    5. Kugler Franziska & Schwerdt Guido & Wößmann Ludger, 2014. "Ökonometrische Methoden zur Evaluierung kausaler Effekte der Wirtschaftspolitik," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 15(2), pages 105-132, June.
    6. Elke Lüdemann, 2011. "Schooling and the Formation of Cognitive and Non-cognitive Outcomes," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 39.
    7. Bernal, Pedro & Mittag, Nikolas & Qureshi, Javaeria A., 2016. "Estimating effects of school quality using multiple proxies," Labour Economics, Elsevier, vol. 39(C), pages 1-10.
    8. Cabrera Hernández, Francisco-Javier, 2016. "Essays on the impact evaluation of education policies in Mexico," Economics PhD Theses 0316, Department of Economics, University of Sussex Business School.
    9. Herrero Prieto, Luis César, 2009. "La investigación en economía de la cultura en España: un estudio bibliométrico/Research in Cultural Economics in Spain: A Bibliometric Study," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 27, pages 35-62, Abril.
    10. Stephen Gibbons & Sandra McNally, 2013. "The Effects of Resources Across School Phases: A Summary of Recent Evidence," CEP Discussion Papers dp1226, Centre for Economic Performance, LSE.
    11. Francisco Cabrera-Hernandez, 2015. "Does lengthening the school day increase students’ academic achievement? Evidence from a natural experiment," Working Paper Series 7415, Department of Economics, University of Sussex Business School.
    12. Burgess, Simon & Wilson, Deborah & Worth, Jack, 2013. "A natural experiment in school accountability: The impact of school performance information on pupil progress," Journal of Public Economics, Elsevier, vol. 106(C), pages 57-67.
    13. Skoufias, Emmanuel & Shapiro, Joseph, 2006. "Evaluating the impact of Mexico's quality schools program : the pitfalls of using nonexperimental data," Policy Research Working Paper Series 4036, The World Bank.
    14. Victor Lavy & Analia Schlosser, 2005. "Targeted Remedial Education for Underperforming Teenagers: Costs and Benefits," Journal of Labor Economics, University of Chicago Press, vol. 23(4), pages 839-874, October.
    15. Nicolas R. Ziebarth & Martin Karlsson, 2014. "The Effects Of Expanding The Generosity Of The Statutory Sickness Insurance System," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(2), pages 208-230, March.
    16. Paula Salinas & Albert Solé-Ollé, 2009. "Evaluating the effects of decentralization on educational outcomes in Spain," Working Papers 2009/10, Institut d'Economia de Barcelona (IEB).
    17. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    18. Christian Volpe Martincus, 2010. "Odyssey in International Markets: An Assessment of the Effectiveness of Export Promotion in Latin America and the Caribbean," IDB Publications (Books), Inter-American Development Bank, number 16458, February.
    19. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    20. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.

    More about this item

    Keywords

    Natural experiment; Teaching reform; Math scores; Distributional effect;
    All these keywords.

    JEL classification:

    • A21 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Pre-college
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:41:y:2014:i:c:p:137-160. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.