IDEAS home Printed from https://ideas.repec.org/a/taf/jnlbes/v30y2012i1p149-163.html
   My bibliography  Save this article

Beyond Incentives: Do Schools Use Accountability Rewards Productively?

Author

Listed:
  • Marigee Bacolod
  • John DiNardo
  • Mireille Jacobson

Abstract

We use a regression discontinuity design to analyze an understudied aspect of school accountability systems—how schools use financial rewards. For two years, California's accountability system financially rewarded schools based on a deterministic function of test scores. Qualifying schools received per-pupil awards amounting to about 1% of statewide per-pupil spending. Corroborating anecdotal evidence that awards were paid out as teacher bonuses, we find no evidence that winning schools purchased more instructional material, increased teacher hiring, or changed the subject-specific composition of their teaching staff. Most importantly, we find no evidence that student achievement increased in winning schools. Supplemental materials for this article are available online.

Suggested Citation

  • Marigee Bacolod & John DiNardo & Mireille Jacobson, 2012. "Beyond Incentives: Do Schools Use Accountability Rewards Productively?," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 149-163.
    • Handle: RePEc:taf:jnlbes:v:30:y:2012:i:1:p:149-163
    DOI: 10.1080/07350015.2012.637868
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/07350015.2012.637868
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/07350015.2012.637868?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. David S. Lee & Thomas Lemieux, 2009. "Regression Discontinuity Designs In Economics," Working Papers 1118, Princeton University, Department of Economics, Industrial Relations Section..
    2. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    3. Baicker, Katherine & Jacobson, Mireille, 2007. "Finders keepers: Forfeiture laws, policing incentives, and local budgets," Journal of Public Economics, Elsevier, vol. 91(11-12), pages 2113-2136, December.
    4. Kenneth Y. Chay & Patrick J. McEwan & Miguel Urquiola, 2005. "The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools," American Economic Review, American Economic Association, vol. 95(4), pages 1237-1258, September.
    5. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    6. Marigee Bacolod & John DiNardo & Mireille Jacobson, 2012. "Beyond Incentives: Do Schools Use Accountability Rewards Productively?," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 149-163.
    7. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    8. repec:pri:edures:24ers.pdf is not listed on IDEAS
    9. repec:mpr:mprres:4987 is not listed on IDEAS
    10. repec:pri:cepsud:156rouse is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    2. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    3. Camargo, Braz & Camelo, Rafael & Firpo, Sergio & Ponczek, Vladimir, 2014. "Information, Market Incentives, and Student Performance," IZA Discussion Papers 7941, Institute of Labor Economics (IZA).
    4. Rebecca Allen & Simon Burgess & Leigh McKenna, 2010. "How should we treat under-performing schools? A regression discontinuity analysis of school inspections in England," DoQSS Working Papers 10-20, Quantitative Social Science - UCL Social Research Institute, University College London.
    5. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    6. Ginger Zhe Jin & Alex Whalley, 2007. "The Power of Attention: Do Rankings Affect the Financial Resources of Public Colleges?," NBER Working Papers 12941, National Bureau of Economic Research, Inc.
    7. Marigee Bacolod & John DiNardo & Mireille Jacobson, 2012. "Beyond Incentives: Do Schools Use Accountability Rewards Productively?," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 149-163.
    8. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    9. Susanna Loeb & Patrick J. McEwan, 2010. "Education Reforms," NBER Chapters, in: Targeting Investments in Children: Fighting Poverty When Resources Are Limited, pages 145-178, National Bureau of Economic Research, Inc.
    10. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    11. Seunghoon Han & Hosung Sohn, 2020. "Impact of the Simultaneous Use of the Stigmatization and Categorical School Funding Policy on the Test and Post-Secondary Outcomes of Lower-Achieving Students," Korean Economic Review, Korean Economic Association, vol. 36, pages 319-352.
    12. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hemelt, Steven W., 2011. "Performance effects of failure to make Adequate Yearly Progress (AYP): Evidence from a regression discontinuity framework," Economics of Education Review, Elsevier, vol. 30(4), pages 702-723, August.
    2. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    3. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    4. Frandsen, Brigham R. & Frölich, Markus & Melly, Blaise, 2012. "Quantile treatment effects in the regression discontinuity design," Journal of Econometrics, Elsevier, vol. 168(2), pages 382-395.
    5. Lecce, Steven & Lepone, Andrew & McKenzie, Michael D. & Segara, Reuben, 2012. "The impact of naked short selling on the securities lending and equity market," Journal of Financial Markets, Elsevier, vol. 15(1), pages 81-107.
    6. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    7. Eibich, Peter & Siedler, Thomas, 2020. "Retirement, intergenerational time transfers, and fertility," European Economic Review, Elsevier, vol. 124(C).
    8. Stephan Litschig, 2008. "Financing local development: Quasi-experimental evidence from municipalities in Brazil, 1980-1991," Economics Working Papers 1142, Department of Economics and Business, Universitat Pompeu Fabra, revised Jun 2012.
    9. Stoeffler, Quentin & Mills, Bradford, 2014. "Households’ investments in durable and productive assets in Niger: quasi-experimental evidences from a cash transfer project," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170212, Agricultural and Applied Economics Association.
    10. Anil Kumar, 2018. "Do Restrictions on Home Equity Extraction Contribute to Lower Mortgage Defaults? Evidence from a Policy Discontinuity at the Texas Border," American Economic Journal: Economic Policy, American Economic Association, vol. 10(1), pages 268-297, February.
    11. Huang, Wei & Zhou, Yi, 2013. "Effects of education on cognition at older ages: Evidence from China's Great Famine," Social Science & Medicine, Elsevier, vol. 98(C), pages 54-62.
    12. Silvia Helena Barcellos, 2010. "Legalization and the Economic Status of Immigrants," Working Papers 754, RAND Corporation.
    13. Ceren Ertan Yörük & Barış Yörük, 2015. "Alcohol consumption and risky sexual behavior among young adults: evidence from minimum legal drinking age laws," Journal of Population Economics, Springer;European Society for Population Economics, vol. 28(1), pages 133-157, January.
    14. Lauren Lanahan & Daniel Armanios, 2018. "Does More Certification Always Benefit a Venture?," Organization Science, INFORMS, vol. 29(5), pages 931-947, October.
    15. Kaisa Kotakorpi & Panu Poutvaara & Marko Tervio, 2013. "Returns to office in national and local politics," Discussion Papers 86, Aboa Centre for Economics.
    16. Otávio Bartalotti, 2013. "Theory and Practice of Inference in Regression Discontinuity: A Fixed-Bandwidth Asymptotics Approach," Working Papers 1302, Tulane University, Department of Economics, revised Nov 2013.
    17. Beatrix Eugster & Rafael Lalive & Andreas Steinhauer & Josef Zweimüller, 2011. "The Demand for Social Insurance: Does Culture Matter?," Economic Journal, Royal Economic Society, vol. 121(556), pages 413-448, November.
    18. Jean‐Louis Arcand & Eric Djimeu Wouabe, 2010. "Teacher training and HIV/AIDS prevention in West Africa: regression discontinuity design evidence from the Cameroon," Health Economics, John Wiley & Sons, Ltd., vol. 19(S1), pages 36-54, September.
    19. Chandler, Vincent, 2018. "Short and long-term impacts of an increase in graduate funding," Economics of Education Review, Elsevier, vol. 62(C), pages 104-112.
    20. Gutierrez, Emilio, 2015. "Fighting Crime with a Little Help from my Friends: Political Alignment, Inter-Jurisdictional Cooperation and Crime in Mexico," CEPR Discussion Papers 10769, C.E.P.R. Discussion Papers.

    More about this item

    JEL classification:

    • H0 - Public Economics - - General
    • I0 - Health, Education, and Welfare - - General
    • I2 - Health, Education, and Welfare - - Education
    • J0 - Labor and Demographic Economics - - General
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlbes:v:30:y:2012:i:1:p:149-163. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UBES20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.