IDEAS home Printed from https://ideas.repec.org/p/brn/wpaper/0601.html
   My bibliography  Save this paper

Tinkering toward accolades: School gaming under a performance accountability system

Author

Listed:
  • Randall Reback

    (Barnard College, Columbia University)

  • Julie Berry Cullen

    (UC-San Diego and NBER)

Abstract

We explore the extent to which schools manipulate the composition of students in the test-taking pool in order to maximize ratings under Texas' accountability system in the 1990s. We first derive predictions from a static model of administrators' incentives given the structure of the ratings criteria, and then test these predictions by comparing differential changes in exemption rates across student subgroups within campuses and across campuses and regimes. Our analyses uncover evidence of a moderate degree of strategic behavior, so that there is some tension between designing systems that account for heterogeneity in student populations and that are manipulation-free.

Suggested Citation

  • Randall Reback & Julie Berry Cullen, 2006. "Tinkering toward accolades: School gaming under a performance accountability system," Working Papers 0601, Barnard College, Department of Economics.
    • Handle: RePEc:brn:wpaper:0601
    as

    Download full text from publisher

    File URL: http://www.econ.barnard.columbia.edu/working_papers/wp0601.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    2. Figlio, David N., 2006. "Testing, crime and punishment," Journal of Public Economics, Elsevier, vol. 90(4-5), pages 837-851, May.
    3. Eric A. Hanushek & Margaret E. Raymond, 2005. "Does school accountability lead to improved student performance?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(2), pages 297-327.
    4. Cullen, Julie Berry, 2003. "The impact of fiscal incentives on student disability rates," Journal of Public Economics, Elsevier, vol. 87(7-8), pages 1557-1589, August.
    5. Ladd, Helen F., 2001. "School-Based Educational Accountability Systems: The Promise and the Pitfalls," National Tax Journal, National Tax Association;National Tax Journal, vol. 54(2), pages 385-400, June.
    6. Ladd, Helen F., 2001. "School-Based Educational Accountability Systems: The Promise and the Pitfalls," National Tax Journal, National Tax Association, vol. 54(n. 2), pages 385-400, June.
    7. James J. Heckman & Carolyn Heinrich & Jeffrey Smith, 2002. "The Performance of Performance Standards," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 778-811.
    8. Kathryn H. Anderson & Richard V. Burkhauser & Jennie E. Raymond, 1993. "The Effect of Creaming on Placement Rates under the Job Training Partnership Act," ILR Review, Cornell University, ILR School, vol. 46(4), pages 613-624, July.
    9. James J. Heckman & Jeffrey A. Smith & Christopher Taber, 1996. "What Do Bureaucrats Do? The Effects of Performance Standards and Bureaucratic Preferences on Acceptance into the JTPA Program," NBER Working Papers 5535, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pascal Courty & Gerald Marschke, 2003. "Making Government Accountable: Lessons from a Federal Job Training Program," The Centre for Market and Public Organisation 03/083, The Centre for Market and Public Organisation, University of Bristol, UK.
    2. Courty, Pascal & Kim, Do Han & Marschke, Gerald, 2011. "Curbing cream-skimming: Evidence on enrolment incentives," Labour Economics, Elsevier, vol. 18(5), pages 643-655, October.
    3. William Duncombe & Anna Lukemeyer & John Yinger, 2008. "The No Child Left Behind Act," Public Finance Review, , vol. 36(4), pages 381-407, July.
    4. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    5. David N. Figlio & Lawrence S. Getzler, 2002. "Accountability , Ability and Disability: Gaming the System," NBER Working Papers 9307, National Bureau of Economic Research, Inc.
    6. Seth Gershenson, 2016. "Performance Standards and Employee Effort: Evidence From Teacher Absences," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(3), pages 615-638, June.
    7. Rajashri Chakrabarti, 2013. "Vouchers, Public School Response, And The Role Of Incentives: Evidence From Florida," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 500-526, January.
    8. Gershenson, Seth & Holt, Stephen B. & Papageorge, Nicholas W., 2015. "Who Believes in Me? The Effect of Student-Teacher Demographic Match on Teacher Expectations," IZA Discussion Papers 9202, Institute of Labor Economics (IZA).
    9. Pascal Courty & Gerald Marschke, 2004. "An Empirical Investigation of Gaming Responses to Explicit Performance Incentives," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 23-56, January.
    10. Jun Li, 2022. "Value‐Based Payments in Health Care: Evidence from a Nationwide Randomized Experiment in the Home Health Sector," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1090-1117, September.
    11. Hege Marie Gjefsen & Trude Gunnes, 2015. "School accountability Incentives or sorting?," Discussion Papers 815, Statistics Norway, Research Department.
    12. Carolyn J. Heinrich & Gerald Marschke, 2010. "Incentives and their dynamics in public sector performance management systems," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 183-208.
    13. Winters, Marcus A. & Trivitt, Julie R. & Greene, Jay P., 2010. "The impact of high-stakes testing on student proficiency in low-stakes subjects: Evidence from Florida's elementary science exam," Economics of Education Review, Elsevier, vol. 29(1), pages 138-146, February.
    14. Gerald Marschke & Pascal Courty, 2000. "An Empirical Investigation of Gaming Responses to Performance Incentives," Discussion Papers 00-12, University at Albany, SUNY, Department of Economics.
    15. Gjefsen, Hege Marie & Gunnes, Trude, 2016. "The effects of School Accountability on Teacher Mobility and Teacher Sorting," MPRA Paper 69664, University Library of Munich, Germany.
    16. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    17. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    18. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    19. Coelli, Michael & Foster, Gigi, 2024. "Unintended consequences of school accountability reforms: Public versus private schools," Economics of Education Review, Elsevier, vol. 99(C).
    20. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.

    More about this item

    Keywords

    school accountability; performance standard; caseload manipulation;
    All these keywords.

    JEL classification:

    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • H39 - Public Economics - - Fiscal Policies and Behavior of Economic Agents - - - Other
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:brn:wpaper:0601. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Robert O'Connor (email available below). General contact details of provider: https://edirc.repec.org/data/edclbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.