IDEAS home Printed from https://ideas.repec.org/p/ehl/lserod/102689.html
   My bibliography  Save this paper

Does evaluation distort teacher effort and decisions? Quasi-experimental evidence from a policy of retesting students

Author

Listed:
  • Aucejo, Esteban
  • Romano, Teresa
  • Taylor, Eric S.

Abstract

Performance evaluation may change employee effort and decisions in unintended ways, for example, in multitask jobs where the evaluation measure captures only a subset of (differentially weights) the job tasks. We show evidence of this multitask distortion in schools, with teachers allocating effort across students (tasks). Teachers are evaluated based on student test scores; students who fail the test are retested 2-3 weeks later; and only the higher of the two scores is used in the teachers’ evaluations. This retesting feature creates a sharp difference in the returns to teacher effort directed at failing versus passing students, even though both barely failing and barely passing students have arguably equal educational claim on (returns to) teacher effort. Using RD methods, we show that students who barely fail the end of school-year math test, and are then retested, score higher one year later (+1) compared to those who barely pass. This difference in scores occurs during the four years of the retest policy, but not in the years before or after. We find no evidence that the results arise from retesting per se, or from changes in students’ own behavior alone. The results suggest teachers give more effort to some students (tasks) simply because of the evaluation system incentives.

Suggested Citation

  • Aucejo, Esteban & Romano, Teresa & Taylor, Eric S., 2019. "Does evaluation distort teacher effort and decisions? Quasi-experimental evidence from a policy of retesting students," LSE Research Online Documents on Economics 102689, London School of Economics and Political Science, LSE Library.
  • Handle: RePEc:ehl:lserod:102689
    as

    Download full text from publisher

    File URL: http://eprints.lse.ac.uk/102689/
    File Function: Open access version.
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Aucejo, Esteban M. & Romano, Teresa Foy, 2016. "Assessing the effect of school days and absences on test score performance," Economics of Education Review, Elsevier, vol. 55(C), pages 70-87.
    2. Thomas S. Dee & Brian Jacob, 2011. "The impact of no Child Left Behind on student achievement," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 418-446, June.
    3. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    4. Simon Burgess & Carol Propper & Helen Slater & Deborah Wilson, 2005. "Who wins and who loses from school accountability? The distribution of educational gain in English secondary schools," The Centre for Market and Public Organisation 05/128, The Centre for Market and Public Organisation, University of Bristol, UK.
    5. Julie Berry Cullen & Randall Reback, 2006. "Tinkering Toward Accolades: School Gaming Under a Performance Accountability System," NBER Working Papers 12286, National Bureau of Economic Research, Inc.
    6. Baker, George P, 1992. "Incentive Contracts and Performance Measurement," Journal of Political Economy, University of Chicago Press, vol. 100(3), pages 598-614, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richardson, J.T., 2015. "Accountability incentives and academic achievement: Distributional impacts of accountability when standards are set low," Economics of Education Review, Elsevier, vol. 44(C), pages 1-16.
    2. Gershenson, Seth & Holt, Stephen B. & Papageorge, Nicholas W., 2015. "Who Believes in Me? The Effect of Student-Teacher Demographic Match on Teacher Expectations," IZA Discussion Papers 9202, Institute of Labor Economics (IZA).
    3. David J. Deming & Sarah Cohodes & Jennifer Jennings & Christopher Jencks, 2016. "School Accountability, Postsecondary Attainment, and Earnings," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 848-862, December.
    4. Will Dobbie & Roland G. Fryer, 2020. "Charter Schools and Labor Market Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 38(4), pages 915-957.
    5. Will S. Dobbie & Roland G. Fryer, Jr, 2016. "Charter Schools and Labor Market Outcomes," NBER Working Papers 22502, National Bureau of Economic Research, Inc.
    6. Seth Gershenson, 2016. "Performance Standards and Employee Effort: Evidence From Teacher Absences," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(3), pages 615-638, June.
    7. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    8. Cristina Bellés-Obrero & María Lombardi, 2022. "Teacher Performance Pay and Student Learning: Evidence from a Nationwide Program in Peru," Economic Development and Cultural Change, University of Chicago Press, vol. 70(4), pages 1631-1669.
    9. Sarah Cattan & Daniel A Kamhöfer & Martin Karlsson & Therese Nilsson, 2023. "The Long-Term Effects of Student Absence: Evidence from Sweden," The Economic Journal, Royal Economic Society, vol. 133(650), pages 888-903.
    10. Liu, Jing & Lee, Monica & Gershenson, Seth, 2021. "The short- and long-run impacts of secondary school absences," Journal of Public Economics, Elsevier, vol. 199(C).
    11. Thompson, Paul N., 2021. "Is four less than five? Effects of four-day school weeks on student achievement in Oregon," Journal of Public Economics, Elsevier, vol. 193(C).
    12. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    13. Barrios-Fernández, Andrés & Bovini, Giulia, 2021. "It’s time to learn: School institutions and returns to instruction time," Economics of Education Review, Elsevier, vol. 80(C).
    14. Hugh Macartney, 2014. "The Dynamic Effects of Educational Accountability," NBER Working Papers 19915, National Bureau of Economic Research, Inc.
    15. Jo Blanden & Matthias Doepke & Jan Stuhler, 2022. "Education inequality," CEP Discussion Papers dp1849, Centre for Economic Performance, LSE.
    16. Julie Berry Cullen & Eric A. Hanushek & Gregory Phelan & Steven G. Rivkin, 2024. "Performance Information and Personnel Decisions in the Public Sector: The Case of School Principals," Journal of Human Resources, University of Wisconsin Press, vol. 59(1), pages 109-140.
    17. Silva, Olmo, 2009. "Some Remarks on the Effectiveness of Primary Education Interventions," IZA Policy Papers 5, Institute of Labor Economics (IZA).
    18. Hugh Macartney & Robert McMillan & Uros Petronijevic, 2021. "A Quantitative Framework for Analyzing the Distributional Effects of Incentive Schemes," Working Papers tecipa-696, University of Toronto, Department of Economics.
    19. Stephen Billings & Eric J. Brunner & Stephen L. Ross, 2014. "The Housing and Educational Consequences of the School Choice Provisions of NCLB: Evidence from Charlotte, NC," Working papers 2014-21, University of Connecticut, Department of Economics.
    20. Cristina Bellés-Obrero & María Lombardi, 2020. "Teacher Performance Pay and Student Learning: Evidence from a Nationwide Program in Peru," Department of Economics Working Papers wp_gob_2020_04, Universidad Torcuato Di Tella.

    More about this item

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • M5 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ehl:lserod:102689. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: LSERO Manager (email available below). General contact details of provider: https://edirc.repec.org/data/lsepsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.