IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v58y2017icp55-67.html
   My bibliography  Save this article

Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior

Author

Listed:
  • Holbein, John B.
  • Ladd, Helen F.

Abstract

In this paper we examine how failing to make adequate yearly progress under No Child Left Behind (NCLB), and the accountability pressure that ensues, affects various non-achievement student behaviors. Using administrative data from North Carolina and leveraging a discontinuity in the determination of school failure, we examine the causal impact of this form of accountability pressure both on student behaviors that are incentivized by NCLB and on those that are not. We find evidence that, as NCLB intends, pressure encourages students to show up at school and to do so on time. Accountability pressure also appears to have the unintended effect, however, of increasing the number of student misbehaviors. Further, we find some evidence that this negative response is most pronounced among minorities and low performing students: those who are the most likely to be left behind.

Suggested Citation

  • Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
  • Handle: RePEc:eee:ecoedu:v:58:y:2017:i:c:p:55-67
    DOI: 10.1016/j.econedurev.2017.03.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775717302194
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econedurev.2017.03.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wu, De-Min, 1973. "Alternative Tests of Independence Between Stochastic Regressors and Disturbances," Econometrica, Econometric Society, vol. 41(4), pages 733-750, July.
    2. Sandra E. Black, 1999. "Do Better Schools Matter? Parental Valuation of Elementary Education," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 577-599.
    3. C. Kirabo Jackson, 2012. "Non-Cognitive Ability, Test Scores, and Teacher Quality: Evidence from 9th Grade Teachers in North Carolina," NBER Working Papers 18624, National Bureau of Economic Research, Inc.
    4. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    5. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College," NBER Working Papers 9546, National Bureau of Economic Research, Inc.
    6. Raj Chetty & John N. Friedman & Nathaniel Hilger & Emmanuel Saez & Diane Whitmore Schanzenbach & Danny Yagan, 2011. "How Does Your Kindergarten Classroom Affect Your Earnings? Evidence from Project Star," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1593-1660.
    7. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    8. Thomas S. Dee & Brian Jacob, 2011. "The impact of no Child Left Behind on student achievement," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 418-446, June.
    9. Carneiro, Pedro & Hansen, Karsten T. & Heckman, James J., 2003. "Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," IZA Discussion Papers 767, Institute of Labor Economics (IZA).
    10. Brian A. Jacob & Lars Lefgren, 2004. "Remedial Education and Student Achievement: A Regression-Discontinuity Analysis," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 226-244, February.
    11. James Heckman, 2011. "Policies to foster human capital," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 73-137.
    12. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    13. Marigee Bacolod & John DiNardo & Mireille Jacobson, 2012. "Beyond Incentives: Do Schools Use Accountability Rewards Productively?," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 149-163.
    14. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    15. Brian A. Jacob, 2002. "Where the boys aren't: Non-cognitive skills, returns to school and the gender gap in higher education," NBER Working Papers 8964, National Bureau of Economic Research, Inc.
    16. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    17. Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2003. "2001 Lawrence R. Klein Lecture Estimating Distributions of Treatment Effects with an Application to the Returns to Schooling and Measurement of the Effects of Uncertainty on College Choice," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 44(2), pages 361-422, May.
    18. Butler, Daniel M. & Butler, Matthew J., 2006. "Splitting the Difference? Causal Inference and Theories of Split-party Delegations," Political Analysis, Cambridge University Press, vol. 14(4), pages 439-455, October.
    19. Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak & Christopher R. Walters, 2012. "Who Benefits from KIPP?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(4), pages 837-860, September.
    20. Robert Gibbons, 1998. "Incentives in Organizations," Journal of Economic Perspectives, American Economic Association, vol. 12(4), pages 115-132, Fall.
    21. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    22. Jacob, Brian A., 2002. "Where the boys aren't: non-cognitive skills, returns to school and the gender gap in higher education," Economics of Education Review, Elsevier, vol. 21(6), pages 589-598, December.
    23. Lemieux, Thomas & Milligan, Kevin, 2008. "Incentive effects of social assistance: A regression discontinuity approach," Journal of Econometrics, Elsevier, vol. 142(2), pages 807-828, February.
    24. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    25. Thomas Ahn & Jacob Vigdor, 2014. "The Impact of No Child Left Behind's Accountability Sanctions on School Performance: Regression Discontinuity Evidence from North Carolina," NBER Working Papers 20511, National Bureau of Economic Research, Inc.
    26. James Heckman & Rodrigo Pinto & Peter Savelyev, 2013. "Understanding the Mechanisms through Which an Influential Early Childhood Program Boosted Adult Outcomes," American Economic Review, American Economic Association, vol. 103(6), pages 2052-2086, October.
    27. David N. Figlio & Maurice E. Lucas, 2000. "What's in a Grade? School Report Cards and House Prices," NBER Working Papers 8019, National Bureau of Economic Research, Inc.
    28. James J. Heckman & John Eric Humphries & Sergio Urzua & Gregory Veramendi, 2010. "The effects of educational choices on labor market, health, and social outcomes," Working Papers 2011-002, Human Capital and Economic Opportunity Working Group.
    29. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    30. Hanley Chiang, "undated". "How Accountability Pressure on Failing Schools Affects Student Achievement," Mathematica Policy Research Reports c58a3b537e324447b94a2bd41, Mathematica Policy Research.
    31. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    32. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    33. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    34. Gertler, Paul & Heckman, James & Pinto, Rodrigo & Zanolini, Arianna & Vermeerch, Christel & Walker, Susan & Chang, Susan M. & Grantham-McGregor, Sally, 2013. "Labor Market Returns to Early Childhood Stimulation: A 20-year Followup to an Experimental Intervention in Jamaica," Institute for Research on Labor and Employment, Working Paper Series qt8sz5p9vd, Institute of Industrial Relations, UC Berkeley.
    35. repec:pri:edures:24ers.pdf is not listed on IDEAS
    36. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    37. James Heckman & Tim Kautz, 2013. "Fostering and Measuring Skills: Interventions That Improve Character and Cognition," Working Papers 2013-019, Human Capital and Economic Opportunity Working Group.
    38. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    39. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    40. Papay, John P. & Willett, John B. & Murnane, Richard J., 2011. "Extending the regression-discontinuity approach to multiple assignment variables," Journal of Econometrics, Elsevier, vol. 161(2), pages 203-207, April.
    41. Derek Neal & Diane Whitmore Schanzenbach, 2010. "Left Behind by Design: Proficiency Counts and Test-Based Accountability," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 263-283, May.
    42. Ladd, Helen F., 1999. "The Dallas school accountability and incentive program: an evaluation of its impacts on student outcomes," Economics of Education Review, Elsevier, vol. 18(1), pages 1-16, February.
    43. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    44. repec:mpr:mprres:6364 is not listed on IDEAS
    45. Pedro Carneiro & Claire Crawford & Alissa Goodman, 2007. "The Impact of Early Cognitive and Non-Cognitive Skills on Later Outcomes," CEE Discussion Papers 0092, Centre for the Economics of Education, LSE.
    46. Holbein, John, 2016. "Left Behind? Citizen Responsiveness to Government Performance Information," American Political Science Review, Cambridge University Press, vol. 110(2), pages 353-368, May.
    47. Roland G. Fryer, Jr & Tanaya Devi & Richard T. Holden, 2012. "Vertical versus Horizontal Incentives in Education: Evidence from Randomized Trials," NBER Working Papers 17752, National Bureau of Economic Research, Inc.
    48. Matsudaira, Jordan D., 2008. "Mandatory summer school and student achievement," Journal of Econometrics, Elsevier, vol. 142(2), pages 829-850, February.
    49. repec:pri:cepsud:156rouse is not listed on IDEAS
    50. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    51. Randall Reback & Jonah Rockoff & Heather L. Schwartz, 2011. "Under Pressure: Job Security, Resource Allocation, and Productivity in Schools Under NCLB," NBER Working Papers 16745, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Machado, Anaely & Terra, Rafael & Tannuri-Pianto, Maria, 2024. "Higher education responses to accountability," Economics of Education Review, Elsevier, vol. 98(C).
    2. Rong-Ho Lin & Yu-Chuan Huang & Nai-Wen Chang & Shih-Wei Wu & Yu-Chang Ke, 2021. "The Mediating Effect of Ownership of Psychological Behavior and Tour Leader Experience on Accountability in Order to Explore the Sustainable Business Model of the Tourism Industry," Sustainability, MDPI, vol. 13(13), pages 1-19, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    2. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    3. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    4. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    5. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    6. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    7. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    8. Yiqi Liu & Yuan Qi, 2023. "Using Forests in Multivariate Regression Discontinuity Designs," Papers 2303.11721, arXiv.org, revised Jul 2024.
    9. Guido Imbens & Stefan Wager, 2019. "Optimized Regression Discontinuity Designs," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 264-278, May.
    10. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    11. Edwards, Rebecca & Gibson, Rachael & Harmon, Colm & Schurer, Stefanie, 2022. "First-in-their-family students at university: Can non-cognitive skills compensate for social origin?," Economics of Education Review, Elsevier, vol. 91(C).
    12. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    13. Marinho Bertanha & Guido W. Imbens, 2020. "External Validity in Fuzzy Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 593-612, July.
    14. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    15. Kejia Hu & Sunil Chopra & Yuche Chen, 2021. "The Effect of Tightening Standards on Automakers’ Non‐compliance," Production and Operations Management, Production and Operations Management Society, vol. 30(9), pages 3094-3115, September.
    16. Dong, Yingying, 2010. "Jumpy or Kinky? Regression Discontinuity without the Discontinuity," MPRA Paper 25461, University Library of Munich, Germany.
    17. Frandsen, Brigham R. & Frölich, Markus & Melly, Blaise, 2012. "Quantile treatment effects in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 168(2), pages 382-395.
    18. Ari Hyytinen & Jaakko Meriläinen & Tuukka Saarimaa & Otto Toivanen & Janne Tukiainen, 2018. "When does regression discontinuity design work? Evidence from random election outcomes," Quantitative Economics, Econometric Society, vol. 9(2), pages 1019-1051, July.
    19. Burgess, Simon, 2016. "Human Capital and Education: The State of the Art in the Economics of Education," IZA Discussion Papers 9885, Institute of Labor Economics (IZA).
    20. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.

    More about this item

    Keywords

    Performance-based accountability; No Child Left Behind; Non-cognitive skills; Regression discontinuity;
    All these keywords.

    JEL classification:

    • I00 - Health, Education, and Welfare - - General - - - General
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:58:y:2017:i:c:p:55-67. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.