IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/17752.html
   My bibliography  Save this paper

Vertical versus Horizontal Incentives in Education: Evidence from Randomized Trials

Author

Listed:
  • Roland G. Fryer, Jr
  • Tanaya Devi
  • Richard T. Holden

Abstract

This paper describes randomized field experiments in eighty-four urban public schools in two cities designed to understand the impact of aligned incentives on student achievement. In Washington DC, incentives were “horizontal” – provided to one agent (students) for various inputs in the education production function (i.e. attendance, behavior, interim assessments, homework, and uniforms). In Houston, TX, incentives were “vertical” – provided to multiple agents (parents, teachers, and students) for a single input (math objectives). On outcomes for which we provided direct incentives, there were large and statistically significant effects from both treatments. Horizontal incentives led to increases in math and reading test scores. Vertical incentives increased math achievement, but resulted in decreased reading, science, and social studies test scores. We argue that the data is consistent with agents perceiving academic achievement in various subjects as substitutes, not complements, in education production.

Suggested Citation

  • Roland G. Fryer, Jr & Tanaya Devi & Richard T. Holden, 2012. "Vertical versus Horizontal Incentives in Education: Evidence from Randomized Trials," NBER Working Papers 17752, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:17752
    Note: ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w17752.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paarsch, Harry J & Shearer, Bruce, 2000. "Piece Rates, Fixed Wages, and Incentive Effects: Statistical Evidence from Payroll Records," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(1), pages 59-92, February.
    2. Eric P. Bettinger, 2012. "Paying to Learn: The Effect of Financial Incentives on Elementary School Test Scores," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 686-698, August.
    3. Joshua Angrist & Eric Bettinger & Erik Bloom & Elizabeth King & Michael Kremer, 2002. "Vouchers for Private Schooling in Colombia: Evidence from a Randomized Natural Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1535-1558, December.
    4. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    5. Agarwal, Vikas & Daniel, Naveen D. & Naik, Narayan Y., 2009. "Role of managerial incentives and discretion in hedge fund performance," CFR Working Papers 04-04, University of Cologne, Centre for Financial Research (CFR).
    6. Alan B. Krueger, 1999. "Experimental Estimates of Education Production Functions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 497-532.
    7. Michael Kremer & Edward Miguel & Rebecca Thornton, 2009. "Incentives to Learn," The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 437-456, August.
    8. Barrera-Osorio, Felipe & Bertrand, Marianne & L. Linden, Leigh & Perez-Calle, Francisco, 2008. "Conditional cash transfers in education : design features, peer and sibling effects evidence from a randomized experiment in Colombia," Policy Research Working Paper Series 4580, The World Bank.
    9. Vikas Agarwal & Naveen D. Daniel & Narayan Y. Naik, 2009. "Role of Managerial Incentives and Discretion in Hedge Fund Performance," Journal of Finance, American Finance Association, vol. 64(5), pages 2221-2256, October.
    10. Holmstrom, Bengt & Milgrom, Paul, 1991. "Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 7(0), pages 24-52, Special I.
    11. Edward P. Lazear, 2001. "Educational Production," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(3), pages 777-803.
    12. Joshua Angrist & Eric Bettinger & Michael Kremer, 2006. "Long-Term Educational Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia," American Economic Review, American Economic Association, vol. 96(3), pages 847-862, June.
    13. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    14. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    15. Roland G. Fryer, Jr, 2010. "Financial Incentives and Student Achievement: Evidence from Randomized Trials," NBER Working Papers 15898, National Bureau of Economic Research, Inc.
    16. Behrman, Jere R & Sengupta, Piyali & Todd, Petra, 2005. "Progressing through PROGRESA: An Impact Assessment of a School Subsidy Experiment in Rural Mexico," Economic Development and Cultural Change, University of Chicago Press, vol. 54(1), pages 237-275, October.
    17. Joshua Angrist & Daniel Lang & Philip Oreopoulos, 2006. "Lead Them to Water and Pay Them to Drink: An Experiment with Services and Incentives for College Achievement," NBER Working Papers 12790, National Bureau of Economic Research, Inc.
    18. repec:feb:natura:0004 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Balmaceda, Felipe, 2018. "Optimal task assignments with loss-averse agents," European Economic Review, Elsevier, vol. 105(C), pages 1-26.
    2. Borghans, Lex & Meijers, Huub & ter Weel, Bas, 2013. "The importance of intrinsic and extrinsic motivation for measuring IQ," Economics of Education Review, Elsevier, vol. 34(C), pages 17-28.
    3. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    4. Roland Fryer & Steven Levitt & John A. List & Anya Samek, 2020. "Introducing CogX: A New Preschool Education Program Combining Parent and Child Intervention," Working Papers 2020-149, Becker Friedman Institute for Research In Economics.
    5. Guryan, Jonathan & Kim, James S. & Park, Kyung H., 2016. "Motivation and incentives in education: Evidence from a summer reading experiment," Economics of Education Review, Elsevier, vol. 55(C), pages 1-20.
    6. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roland G. Fryer, Jr, 2010. "Financial Incentives and Student Achievement: Evidence from Randomized Trials," NBER Working Papers 15898, National Bureau of Economic Research, Inc.
    2. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    3. Francesca Marchetta & Tom Dilly, 2019. "Supporting Education in Africa: Opportunities and Challenges for an Impact Investor," Working Papers hal-02288103, HAL.
    4. Uri Gneezy & Stephan Meier & Pedro Rey-Biel, 2011. "When and Why Incentives (Don't) Work to Modify Behavior," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 191-210, Fall.
    5. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    6. Maria De Paola & Vincenzo Scoppa & Rosanna Nisticò, 2012. "Monetary Incentives and Student Achievement in a Depressed Labor Market: Results from a Randomized Experiment," Journal of Human Capital, University of Chicago Press, vol. 6(1), pages 56-85.
    7. Robert Metcalfe & Simon Burgess and Steven Proud, 2011. "Student effort and educational attainment: Using the England football team to identify the education production function," Economics Series Working Papers 586, University of Oxford, Department of Economics.
    8. Roland G. Fryer, Jr, 2016. "The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments," NBER Working Papers 22130, National Bureau of Economic Research, Inc.
    9. Steven Levitt & John List & Sally Sadoff, 2016. "The Effect of Performance-Based Incentives on Educational Achievement: Evidence from a Randomized Experiment," Framed Field Experiments 00585, The Field Experiments Website.
    10. Martin Schlotter & Guido Schwerdt & Ludger Woessmann, 2011. "Econometric methods for causal evaluation of education policies and practices: a non-technical guide," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 109-137.
    11. Michael Kremer & Edward Miguel & Rebecca Thornton, 2009. "Incentives to Learn," The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 437-456, August.
    12. Foureaux Koppensteiner, Martin, 2014. "Automatic grade promotion and student performance: Evidence from Brazil," Journal of Development Economics, Elsevier, vol. 107(C), pages 277-290.
    13. Roland G. Fryer, 2011. "Teacher Incentives and Student Achievement: Evidence from New York City Public Schools," NBER Working Papers 16850, National Bureau of Economic Research, Inc.
    14. Li, Tao & Han, Li & Zhang, Linxiu & Rozelle, Scott, 2014. "Encouraging classroom peer interactions: Evidence from Chinese migrant schools," Journal of Public Economics, Elsevier, vol. 111(C), pages 29-45.
    15. Laajaj, Rachid & Moya, Andrés & Sánchez, Fabio, 2022. "Equality of opportunity and human capital accumulation: Motivational effect of a nationwide scholarship in Colombia," Journal of Development Economics, Elsevier, vol. 154(C).
    16. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    17. David K. Evans & Anna Popova, 2016. "What Really Works to Improve Learning in Developing Countries? An Analysis of Divergent Findings in Systematic Reviews," The World Bank Research Observer, World Bank, vol. 31(2), pages 242-270.
    18. Visaria, Sujata & Dehejia, Rajeev & Chao, Melody M. & Mukhopadhyay, Anirban, 2016. "Unintended consequences of rewards for student attendance: Results from a field experiment in Indian classrooms," Economics of Education Review, Elsevier, vol. 54(C), pages 173-184.
    19. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2008. "Conditional Cash Transfers in Education Design Features, Peer and Sibling Effects Evidence from a Randomized Experiment in Colombia," NBER Working Papers 13890, National Bureau of Economic Research, Inc.
    20. Javier E. Báez & Adriana Camacho, 2011. "Assessing the Long-term Effects of Conditional Cash Transfers on Human Capital: Evidence from Colombia," Documentos CEDE 8900, Universidad de los Andes, Facultad de Economía, CEDE.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:17752. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.