IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v30y2011i4p702-723.html
   My bibliography  Save this article

Performance effects of failure to make Adequate Yearly Progress (AYP): Evidence from a regression discontinuity framework

Author

Listed:
  • Hemelt, Steven W.

Abstract

As the No Child Left Behind (NCLB) law moves through the reauthorization process, it is important to understand the basic performance impacts of its central structure of accountability. In this paper, I examine the effects of failure to make Adequate Yearly Progress (AYP) under NCLB on subsequent student math and reading performance at the school level. Using panel data on Maryland elementary and middle schools from 2003 to 2009, I find that the scope of failure matters: Academic performance suffers in the short run in response to school-wide failure. However, schools that meet achievement targets for the aggregate student group, yet fail to meet at least one demographic subgroup's target see between 3 and 6 percent more students in the failing subgroup score proficiently the following year, compared to if no accountability pressure were in place. I discuss alternative interpretations and policy implications of the main findings.

Suggested Citation

  • Hemelt, Steven W., 2011. "Performance effects of failure to make Adequate Yearly Progress (AYP): Evidence from a regression discontinuity framework," Economics of Education Review, Elsevier, vol. 30(4), pages 702-723, August.
    • Handle: RePEc:eee:ecoedu:v:30:y:2011:i:4:p:702-723
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775711000264
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David S. Lee & Thomas Lemieux, 2009. "Regression Discontinuity Designs In Economics," Working Papers 1118, Princeton University, Department of Economics, Industrial Relations Section..
    2. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    3. Winters, Marcus A. & Trivitt, Julie R. & Greene, Jay P., 2010. "The impact of high-stakes testing on student proficiency in low-stakes subjects: Evidence from Florida's elementary science exam," Economics of Education Review, Elsevier, vol. 29(1), pages 138-146, February.
    4. Helen F. Ladd & Edward B. Fiske, 2008. "Handbook of Research in Education Finance and Policy," Education Finance and Policy, MIT Press, vol. 3(1), pages 149-150, January.
    5. Chakrabarti Rajashri, 2013. "Impact of Voucher Design on Public School Performance: Evidence from Florida and Milwaukee Voucher Programs," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 13(1), pages 349-394, July.
    6. Eric A. Hanushek & Margaret E. Raymond, 2005. "Does school accountability lead to improved student performance?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(2), pages 297-327.
    7. Justine S. Hastings & Jeffrey M. Weinstein, 2007. "No Child Left Behind: Estimating the Impact on Choices and Student Outcomes," NBER Working Papers 13009, National Bureau of Economic Research, Inc.
    8. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    9. Martin R. West & Paul E. Peterson, 2006. "The Efficacy of Choice Threats Within School Accountability Systems: Results from Legislatively Induced Experiments," Economic Journal, Royal Economic Society, vol. 116(510), pages 46-62, March.
    10. Helen F. Ladd & Douglas L. Lauen, 2010. "Status versus growth: The distributional effects of school accountability policies," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(3), pages 426-450.
    11. Jonah Rockoff & Lesley J. Turner, 2010. "Short-Run Impacts of Accountability on School Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 2(4), pages 119-147, November.
    12. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    13. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    14. Hanley Chiang, "undated". "How Accountability Pressure on Failing Schools Affects Student Achievement," Mathematica Policy Research Reports c58a3b537e324447b94a2bd41, Mathematica Policy Research.
    15. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    16. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    17. Brian Gill & J.R. Lockwood III & Francisco Martorell & Claude Messan Setodji & Kevin Booker, "undated". "An Exploratory Analysis of Adequate Yearly Progress, Identification for Improvement, and Student Achievement in Two States and Three Cities," Mathematica Policy Research Reports 22a6c1d142b1420dbe9ba386e, Mathematica Policy Research.
    18. repec:pri:edures:24ers.pdf is not listed on IDEAS
    19. Austin Nichols, 2007. "Causal inference with observational data," Stata Journal, StataCorp LP, vol. 7(4), pages 507-541, December.
    20. Springer, Matthew G., 2008. "The influence of an NCLB accountability plan on the distribution of student test score gains," Economics of Education Review, Elsevier, vol. 27(5), pages 556-563, October.
    21. repec:mpr:mprres:6364 is not listed on IDEAS
    22. repec:pri:cepsud:156rouse is not listed on IDEAS
    23. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Evan Riehl & Meredith Welch, 2023. "Accountability, Test Prep Incentives, and the Design of Math and English Exams," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 60-96, January.
    2. Alexander Bogin & Phuong Nguyen-Hoang, 2014. "Property Left Behind: An Unintended Consequence Of A No Child Left Behind “Failing” School Designation," Journal of Regional Science, Wiley Blackwell, vol. 54(5), pages 788-805, November.
    3. Foote, Andrew & Schulkind, Lisa & Shapiro, Teny M., 2015. "Missed signals: The effect of ACT college-readiness measures on post-secondary decisions," Economics of Education Review, Elsevier, vol. 46(C), pages 39-51.
    4. Matsudaira, Jordan D. & Hosek, Adrienne & Walsh, Elias, 2012. "An integrated assessment of the effects of Title I on school behavior, resources, and student achievement," Economics of Education Review, Elsevier, vol. 31(3), pages 1-14.
    5. Sims, David P., 2013. "Can failure succeed? Using racial subgroup rules to analyze the effect of school accountability failure on student performance," Economics of Education Review, Elsevier, vol. 32(C), pages 262-274.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    2. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    3. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    4. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    5. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    6. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    7. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    8. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    9. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    10. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    11. Krieg, John M., 2011. "Which students are left behind? The racial impacts of the No Child Left Behind Act," Economics of Education Review, Elsevier, vol. 30(4), pages 654-664, August.
    12. Ferreyra, Maria Marta & Liang, Pierre Jinghong, 2012. "Information asymmetry and equilibrium monitoring in education," Journal of Public Economics, Elsevier, vol. 96(1), pages 237-254.
    13. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    14. Winters, Marcus A. & Trivitt, Julie R. & Greene, Jay P., 2010. "The impact of high-stakes testing on student proficiency in low-stakes subjects: Evidence from Florida's elementary science exam," Economics of Education Review, Elsevier, vol. 29(1), pages 138-146, February.
    15. Erwin Ooghe & Erik Schokkaert, 2016. "School accountability: can we reward schools and avoid pupil selection?," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 46(2), pages 359-387, February.
    16. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    17. Woo, Seokjin & Lee, Soohyung & Kim, Kyunghee, 2015. "Carrot and stick?: Impact of a low-stakes school accountability program on student achievement," Economics Letters, Elsevier, vol. 137(C), pages 195-199.
    18. Morozumi, Atsuyoshi & Tanaka, Ryuichi, 2020. "Should School-Level Results of National Assessments Be Made Public?," IZA Discussion Papers 13450, Institute of Labor Economics (IZA).
    19. Filer, Randall K. & Münich, Daniel, 2013. "Responses of private and public schools to voucher funding," Economics of Education Review, Elsevier, vol. 34(C), pages 269-285.
    20. Shao-Hsun Keng, 2016. "The Effect of a Stricter Academic Dismissal Policy on Course Selection, Student Effort, and Grading Leniency," Education Finance and Policy, MIT Press, vol. 11(2), pages 203-224, Spring.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:30:y:2011:i:4:p:702-723. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.