IDEAS home Printed from https://ideas.repec.org/a/tpr/edfpol/v11y2016i1p1-42.html
   My bibliography  Save this article

Teaching to the Student: Charter School Effectiveness in Spite of Perverse Incentives

Author

Listed:
  • Sarah R. Cohodes

    (Education Policy and Social Analysis Columbia University Teachers College New York)

Abstract

Recent work has shown that Boston charter schools raise standardized test scores more than their traditional school counterparts. Critics of charter schools argue that charter schools create those achievement gains by focusing exclusively on test preparation, at the expense of deeper learning. In this paper, I test that critique by estimating the impact of charter school attendance on subscales of the Massachusetts Comprehensive Assessment System and examining them for evidence of score inflation. If charter schools are teaching to the test to a greater extent than their counterparts, one would expect to see higher scores on commonly tested standards, higher-stakes subjects, and frequently tested topics. Despite incentives to reallocate effort away from less frequently tested content to highly tested content, and to coach to item type, I find no evidence of this type of test preparation. Boston charter middle schools perform consistently across all standardized test subscales.

Suggested Citation

  • Sarah R. Cohodes, 2016. "Teaching to the Student: Charter School Effectiveness in Spite of Perverse Incentives," Education Finance and Policy, MIT Press, vol. 11(1), pages 1-42, Winter.
    • Handle: RePEc:tpr:edfpol:v:11:y:2016:i:1:p:1-42
    as

    Download full text from publisher

    File URL: http://www.mitpressjournals.org/doi/pdf/10.1162/EDFP_a_00175
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Parag A. Pathak & Christopher R. Walters, 2013. "Explaining Charter School Effectiveness," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 1-27, October.
    2. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    3. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    4. Philip Gleason & Melissa Clark & Christina Clark Tuttle & Emily Dwoyer, "undated". "The Evaluation of Charter School Impacts," Mathematica Policy Research Reports 3066da11915a4b04a77b38848, Mathematica Policy Research.
    5. Will Dobbie & Roland G. Fryer Jr., 2013. "Getting beneath the Veil of Effective Schools: Evidence from New York City," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 28-60, October.
    6. Gadi Barlevy & Derek Neal, 2012. "Pay for Percentile," American Economic Review, American Economic Association, vol. 102(5), pages 1805-1831, August.
    7. Will Dobbie & Roland G. Fryer, 2011. "Are High-Quality Schools Enough to Increase Achievement among the Poor? Evidence from the Harlem Children's Zone," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 158-187, July.
    8. repec:mpr:mprres:6676 is not listed on IDEAS
    9. repec:mpr:mprres:6210 is not listed on IDEAS
    10. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    11. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.
    12. Ron Zimmer & Brian Gill & Kevin Booker & Stephane Lavertu & Tim Sass & John Witte, "undated". "Charter Schools in Eight States: Effects on Achievement, Attainment, Integration, and Competition," Mathematica Policy Research Reports 6f5b31366ca2499e87ac2c1d0, Mathematica Policy Research.
    13. Oecd, 2013. "The App Economy," OECD Digital Economy Papers 230, OECD Publishing.
    14. Derek Neal & Diane Whitmore Schanzenbach, 2010. "Left Behind by Design: Proficiency Counts and Test-Based Accountability," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 263-283, May.
    15. repec:mpr:mprres:7293 is not listed on IDEAS
    16. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    17. Atila Abdulkadiroğlu & Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak, 2011. "Accountability and Flexibility in Public Schools: Evidence from Boston's Charters And Pilots," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 699-748.
    18. repec:mpr:mprres:6720 is not listed on IDEAS
    19. Will Dobbie & Roland G. Fryer, Jr, 2013. "The Medium-Term Impacts of High-Achieving Charter Schools on Non-Test Score Outcomes," NBER Working Papers 19581, National Bureau of Economic Research, Inc.
    20. Philip Gleason & Melissa Clark & Christina Clark Tuttle & Emily Dwoyer, 2010. "The Evaluation of Charter School Impacts (Presentation)," Mathematica Policy Research Reports 770e250b2ef343a3b1ec8c932, Mathematica Policy Research.
    21. repec:mpr:mprres:7443 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sergio Longobardi & Patrizia Falzetti & Margherita Maria Pagliuca, 2018. "Quis custiodet ipsos custodes? How to detect and correct teacher cheating in Italian student data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(3), pages 515-543, August.
    2. Bergman, Peter, 2018. "The Risks and Benefits of School Integration for Participating Students: Evidence from a Randomized Desegregation Program," IZA Discussion Papers 11602, Institute of Labor Economics (IZA).
    3. Michael Dinerstein & Isaac M. Opper, 2022. "Screening with Multitasking," CESifo Working Paper Series 9869, CESifo.
    4. Claudio Lucifora & Marco Tonello, 2020. "Monitoring and Sanctioning Cheating at School: What Works? Evidence from a National Evaluation Program," Journal of Human Capital, University of Chicago Press, vol. 14(4), pages 584-616.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eyles, Andrew & Machin, Stephen & McNally, Sandra, 2017. "Unexpected school reform: Academisation of primary schools in England," Journal of Public Economics, Elsevier, vol. 155(C), pages 108-121.
    2. Carlson, Deven & Lavertu, Stéphane, 2016. "Charter school closure and student achievement: Evidence from Ohio," Journal of Urban Economics, Elsevier, vol. 95(C), pages 31-48.
    3. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    4. Joe Regan-Stansfield, 2016. "Do good primary schools perform even better as academies?," Working Papers 141167564, Lancaster University Management School, Economics Department.
    5. Regan-Stansfield, Joseph, 2018. "Does greater primary school autonomy improve pupil attainment? Evidence from primary school converter academies in England✰," Economics of Education Review, Elsevier, vol. 63(C), pages 167-179.
    6. Philip M. Gleason & Christina Clark Tuttle & Brian Gill & Ira Nichols-Barrer & Bing-ru Teh, 2014. "Do KIPP Schools Boost Student Achievement?," Education Finance and Policy, MIT Press, vol. 9(1), pages 36-58, January.
    7. Kevin Booker & Brian Gill & Tim Sass & Ron Zimmer, "undated". "Charter High Schools' Effects on Long-Term Attainment and Earnings (Working Paper)," Mathematica Policy Research Reports cfe561a4b1924b7eafb64f918, Mathematica Policy Research.
    8. Joshua D. Angrist & Sarah R. Cohodes & Susan M. Dynarski & Parag A. Pathak & Christopher R. Walters, 2016. "Stand and Deliver: Effects of Boston's Charter High Schools on College Preparation, Entry, and Choice," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 275-318.
    9. Roland G. Fryer, Jr, 2016. "The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments," NBER Working Papers 22130, National Bureau of Economic Research, Inc.
    10. Lorenzo Neri & Elisabetta Pasini, 2020. "Heterogeneous Effects of School Autonomy in England," Discussion Paper Series, School of Economics and Finance 202010, School of Economics and Finance, University of St Andrews.
    11. Patrick L. Baude & Marcus Casey & Eric A. Hanushek & Gregory R. Phelan & Steven G. Rivkin, 2020. "The Evolution of Charter School Quality," Economica, London School of Economics and Political Science, vol. 87(345), pages 158-189, January.
    12. Felipe Barrera-Osorio & Dario Maldonado & Catherine Rodríguez, 2012. "Calidad de la educación básica y media en Colombia: diagnóstico y propuestas," Documentos de Trabajo 10078, Universidad del Rosario.
    13. Joshua M. Cowen & Marcus A. Winters, 2013. "Do Charters Retain Teachers Differently? Evidence from Elementary Schools in Florida," Education Finance and Policy, MIT Press, vol. 8(1), pages 14-42, January.
    14. Song, Yang, 2019. "Sorting, school performance and quality: Evidence from China," Journal of Comparative Economics, Elsevier, vol. 47(1), pages 238-261.
    15. repec:mpr:mprres:8005 is not listed on IDEAS
    16. Loviglio, Annalisa, 2023. "School Quality beyond Test Scores: The Role of Schools in Shaping Educational Outcomes," IZA Discussion Papers 16111, Institute of Labor Economics (IZA).
    17. Vilsa E. Curto & Roland G. Fryer Jr., 2014. "The Potential of Urban Boarding Schools for the Poor: Evidence from SEED," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 65-93.
    18. Derek Neal, 2011. "The Design of Performance Pay in Education," NBER Working Papers 16710, National Bureau of Economic Research, Inc.
    19. Dante Contreras & Jorge Rodríguez & Sergio Urzúa, 2019. "The Return to Private Education: Evidence from School-to-Work Transitions," Working Papers wp479, University of Chile, Department of Economics.
    20. Ana Inés Balsa & Alejandro Cid, 2016. "A randomized impact evaluation of a tuition-free private school targeting low income students in Uruguay," Journal of Applied Economics, Universidad del CEMA, vol. 19, pages 65-94, May.
    21. Eyles, Andrew & Hupkau, Claudia & Machin, Stephen, 2016. "School reforms and pupil performance," Labour Economics, Elsevier, vol. 41(C), pages 9-19.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tpr:edfpol:v:11:y:2016:i:1:p:1-42. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kelly McDougall (email available below). General contact details of provider: https://direct.mit.edu/journals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.