IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v70y2024i9p6220-6233.html
   My bibliography  Save this article

Too Much Information: When Does Additional Testing Benefit Schools?

Author

Listed:
  • Vanitha Virudachalam

    (Gies College of Business, University of Illinois at Urbana-Champaign, Champaign, Illinois 61820)

  • Sergei Savin

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

  • Matthew P. Steinberg

    (Accelerate, Brooklyn, New York 11217)

Abstract

U.S. K–12 school districts that traditionally utilized ongoing “formative” assessments of student progress increasingly rely on additional “interim” assessments to predict student performance on standardized tests. Moreover, some districts are experimenting with merit-based teacher bonuses tied to standardized test scores. We examine the relationship between interim assessments and teacher bonuses using a two-period principal–agent model. The school district (principal), operating under a limited budget, decides whether to implement interim assessments and how much merit pay to offer, and teachers (agents) choose how much effort to exert in each period. We use two-state (proficient versus not proficient) Markovian dynamics to describe the evolution of student test readiness, in which the transition probability in a given period depends on both teachers’ effort decisions and the starting state. Our results indicate that, despite the popularity of interim assessments, their usefulness is far from guaranteed. In particular, the accuracy promised by these assessments is a double-edged sword: positive midyear results can make it easier to incentivize second period teacher effort, but negative results can have a demotivating effect. Moreover, even when an interim assessment does result in a higher probability of the school ending the year in the proficient state, the resulting higher expected costs of merit-based bonuses for the district may exceed the available budget. Thus, even a free interim assessment might be too expensive for the school district.

Suggested Citation

  • Vanitha Virudachalam & Sergei Savin & Matthew P. Steinberg, 2024. "Too Much Information: When Does Additional Testing Benefit Schools?," Management Science, INFORMS, vol. 70(9), pages 6220-6233, September.
  • Handle: RePEc:inm:ormnsc:v:70:y:2024:i:9:p:6220-6233
    DOI: 10.1287/mnsc.2020.01547
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.01547
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.01547?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Fudenberg, Drew & Holmstrom, Bengt & Milgrom, Paul, 1990. "Short-term contracts and long-term agency relationships," Journal of Economic Theory, Elsevier, vol. 51(1), pages 1-31, June.
    2. Lewis, Tracy R. & Sappington, David E. M., 1991. "All-or-nothing information control," Economics Letters, Elsevier, vol. 37(2), pages 111-113, October.
    3. Cremer, Jacques & Khalil, Fahad & Rochet, Jean-Charles, 1998. "Contracts and Productive Information Gathering," Games and Economic Behavior, Elsevier, vol. 25(2), pages 174-193, November.
    4. Lewis Tracy R. & Sappington David E. M., 1993. "Ignorance in Agency Problems," Journal of Economic Theory, Elsevier, vol. 61(1), pages 169-183, October.
    5. Lewis, Tracy R & Sappington, David E M, 1997. "Information Management in Incentive Problems," Journal of Political Economy, University of Chicago Press, vol. 105(4), pages 796-821, August.
    6. Hao Zhang & Stefanos Zenios, 2008. "A Dynamic Principal-Agent Model with Hidden Information: Sequential Optimality Through Truthful State Revelation," Operations Research, INFORMS, vol. 56(3), pages 681-696, June.
    7. Robert A. Shumsky & Edieal J. Pinker, 2003. "Gatekeepers and Referrals in Services," Management Science, INFORMS, vol. 49(7), pages 839-856, July.
    8. Erica L. Plambeck & Stefanos A. Zenios, 2000. "Performance-Based Incentives in a Dynamic Principal-Agent Model," Manufacturing & Service Operations Management, INFORMS, vol. 2(3), pages 240-263, April.
    9. Prashant C. Fuloria & Stefanos A. Zenios, 2001. "Outcomes-Adjusted Reimbursement in a Health-Care Delivery System," Management Science, INFORMS, vol. 47(6), pages 735-751, June.
    10. Thomas S. Dee & James Wyckoff, 2015. "Incentives, Selection, and Teacher Performance: Evidence from IMPACT," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 34(2), pages 267-297, March.
    11. Randall Eberts & Kevin Hollenbeck & Joe Stone, 2002. "Teacher Performance Incentives and Student Outcomes," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 913-927.
    12. Derek Neal & Diane Whitmore Schanzenbach, 2010. "Left Behind by Design: Proficiency Counts and Test-Based Accountability," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 263-283, May.
    13. Figlio, David N. & Kenny, Lawrence W., 2007. "Individual teacher incentives and student performance," Journal of Public Economics, Elsevier, vol. 91(5-6), pages 901-914, June.
    14. Roland G. Fryer, 2013. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," Journal of Labor Economics, University of Chicago Press, vol. 31(2), pages 373-407.
    15. Matthew P. Steinberg & Morgaen L. Donaldson, 2016. "The New Educational Accountability: Understanding the Landscape of Teacher Evaluation in the Post-NCLB Era," Education Finance and Policy, MIT Press, vol. 11(3), pages 340-359, Summer.
    16. Randall W. Eberts & Kevin Hollenbeck & Joe A. Stone, 2002. "Teacher Performance Incentives, collective Bargaining, and Student Outcomes," Book chapters authored by Upjohn Institute researchers, in: Paula B. Voos (ed.),Industrial Relations Research Association (IRRA) Series, Proceedings of the 54th Annual Meeting, pages 180-192, W.E. Upjohn Institute for Employment Research.
    17. Michael J. Podgursky & Matthew G. Springer, 2007. "Teacher performance pay: A review," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(4), pages 909-950.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cremer, Jacques & Khalil, Fahad & Rochet, Jean-Charles, 1998. "Strategic Information Gathering before a Contract Is Offered," Journal of Economic Theory, Elsevier, vol. 81(1), pages 163-200, July.
    2. Jones, Michael D., 2013. "Teacher behavior under performance pay incentives," Economics of Education Review, Elsevier, vol. 37(C), pages 148-164.
    3. Timothy Bond & Kevin Mumford, 2017. "Teacher Performance Pay in the United States: Incidence and Adult Outcomes," Purdue University Economics Working Papers 1289, Purdue University, Department of Economics.
    4. Iossa, Elisabetta & Martimort, David, 2015. "Pessimistic information gathering," Games and Economic Behavior, Elsevier, vol. 91(C), pages 75-96.
    5. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    6. Cremer, Jacques & Khalil, Fahad & Rochet, Jean-Charles, 1998. "Contracts and Productive Information Gathering," Games and Economic Behavior, Elsevier, vol. 25(2), pages 174-193, November.
    7. Aoyagi, Masaki, 2014. "Strategic obscurity in the forecasting of disasters," Games and Economic Behavior, Elsevier, vol. 87(C), pages 485-496.
    8. Scott A. Imberman, 2015. "How effective are financial incentives for teachers?," IZA World of Labor, Institute of Labor Economics (IZA), pages 158-158, June.
    9. Iossa, Elisabetta & Stroffolini, Francesca, 2005. "Price cap regulation, revenue sharing and information acquisition," Information Economics and Policy, Elsevier, vol. 17(2), pages 217-230, March.
    10. Liebowitz, David D., 2021. "Teacher evaluation for accountability and growth: Should policy treat them as complements or substitutes?," Labour Economics, Elsevier, vol. 71(C).
    11. Martimort, David & Iossa, Elisabetta, 2013. "Hidden Action or Hidden Information? How Information Gathering Shapes Contract Design," CEPR Discussion Papers 9552, C.E.P.R. Discussion Papers.
    12. Hagedorn, Marcus, 2009. "The value of information for auctioneers," Journal of Economic Theory, Elsevier, vol. 144(5), pages 2197-2208, September.
    13. Schmitz, Patrick W., 2021. "Contracting under adverse selection: Certifiable vs. uncertifiable information," Journal of Economic Behavior & Organization, Elsevier, vol. 182(C), pages 100-112.
    14. Brehm, Margaret & Imberman, Scott A. & Lovenheim, Michael F., 2017. "Achievement effects of individual performance incentives in a teacher merit pay tournament," Labour Economics, Elsevier, vol. 44(C), pages 133-150.
    15. Fichera, Eleonora & Banks, James & Siciliani, Luigi & Sutton, Matt, 2018. "Does patient health behaviour respond to doctor effort?," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 225-251.
    16. Manuel Willington, 2004. "Pre-Contractual Information Acquisition," ILADES-UAH Working Papers inv154, Universidad Alberto Hurtado/School of Economics and Business.
    17. Shin, Dongsoo, 2008. "Information acquisition and optimal project management," International Journal of Industrial Organization, Elsevier, vol. 26(4), pages 1032-1043, July.
    18. Pereira, Samuel C.A., 2009. "Ignorance in a multi-agent setting," Economics Letters, Elsevier, vol. 105(3), pages 264-266, December.
    19. Pereira, Samuel C.A. & Sousa, Paulo S.A., 2008. "Uncertainty and information accuracy in adverse selection," Economics Letters, Elsevier, vol. 100(3), pages 321-325, September.
    20. Hori, Kazumi, 2008. "The role of private benefits in information acquisition," Journal of Economic Behavior & Organization, Elsevier, vol. 68(3-4), pages 626-631, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:70:y:2024:i:9:p:6220-6233. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.