IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/wbe9k_v1.html
   My bibliography  Save this paper

Financial Incentives and Performance: A Meta-Analysis of Economics Evidence

Author

Listed:
  • Cala, Petr
  • Havranek, Tomas
  • Irsova, Zuzana
  • Matousek, Jindrich
  • Irsova, Zuzana
  • Novak, Jiri

Abstract

Standard economics models require that financial incentives improve performance, while leading theories in psychology allow for the opposite. Experimental results are mixed, and so far have not been corrected for publication bias and model uncertainty. We collect 1,568 economics estimates together with 46 factors capturing the context in which the estimates were obtained. We use novel nonlinear techniques to correct for publication bias and employ Bayesian model averaging to account for model uncertainty. The corrected estimates are zero or tiny across contexts of field experiments, including differences in performance measurement, task definition, reward size and framing, motivation beyond money, subject pool, and estimation technique. Laboratory experiments produce statistically significant estimates on average after correction for publication bias, but even there the effect is weak. Experimental economics evidence is inconsistent with standard economics models.

Suggested Citation

  • Cala, Petr & Havranek, Tomas & Irsova, Zuzana & Matousek, Jindrich & Irsova, Zuzana & Novak, Jiri, 2022. "Financial Incentives and Performance: A Meta-Analysis of Economics Evidence," MetaArXiv wbe9k_v1, Center for Open Science.
  • Handle: RePEc:osf:metaar:wbe9k_v1
    DOI: 10.31219/osf.io/wbe9k_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/636256f605c1e5039b1864a9/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/wbe9k_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jonathan de Quidt, 2018. "Your Loss Is My Gain: A Recruitment Experiment with Framed Incentives," Journal of the European Economic Association, European Economic Association, vol. 16(2), pages 522-559.
    2. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    3. Li, Tao & Han, Li & Zhang, Linxiu & Rozelle, Scott, 2014. "Encouraging classroom peer interactions: Evidence from Chinese migrant schools," Journal of Public Economics, Elsevier, vol. 111(C), pages 29-45.
    4. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    5. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    6. Stanley, T. D. & Jarrell, Stephen B. & Doucouliagos, Hristos, 2010. "Could It Be Better to Discard 90% of the Data? A Statistical Paradox," The American Statistician, American Statistical Association, vol. 64(1), pages 70-77.
    7. Martin Feldkircher & Stefan Zeugner, 2012. "The impact of data revisions on the robustness of growth determinants—a note on ‘determinants of economic growth: Will data tell?’," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(4), pages 686-694, June.
    8. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    9. Boyer, Pierre C. & Dwenger, Nadja & Rincke, Johannes, 2016. "Do norms on contribution behavior affect intrinsic motivation? Field-experimental evidence from Germany," Journal of Public Economics, Elsevier, vol. 144(C), pages 140-153.
    10. Daniel S. Nagin & James B. Rebitzer & Seth Sanders & Lowell J. Taylor, 2002. "Monitoring, Motivation, and Management: The Determinants of Opportunistic Behavior in a Field Experiment," American Economic Review, American Economic Association, vol. 92(4), pages 850-873, September.
    11. Ernst Fehr & Klaus M. Schmidt, 2007. "Adding a Stick to the Carrot? The Interaction of Bonuses and Fines," American Economic Review, American Economic Association, vol. 97(2), pages 177-181, May.
    12. Takahashi, Hiromasa & Shen, Junyi & Ogawa, Kazuhito, 2016. "An experimental examination of compensation schemes and level of effort in differentiated tasks," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 61(C), pages 12-19.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cala, Petr & Havranek, Tomas & Irsova, Zuzana & Matousek, Jindrich & Novak, Jiri, 2022. "Financial Incentives and Performance: A Meta-Analysis of Economics Evidence," EconStor Preprints 265535, ZBW - Leibniz Information Centre for Economics.
    2. Florian Englmaier & Stefan Grimm & Dominik Grothe & David Schindler & Simeon Schudy, 2024. "The Effect of Incentives in Nonroutine Analytical Team Tasks," Journal of Political Economy, University of Chicago Press, vol. 132(8), pages 2695-2747.
    3. James Berry, 2015. "Child Control in Education Decisions: An Evaluation of Targeted Incentives to Learn in India," Journal of Human Resources, University of Wisconsin Press, vol. 50(4), pages 1051-1080.
    4. Damon Clark & David Gill & Victoria Prowse & Mark Rush, 2020. "Using Goals to Motivate College Students: Theory and Evidence From Field Experiments," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 648-663, October.
    5. Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," Working Papers IES 2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    6. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    7. Bach, Maximilian & Fischer, Mira, 2020. "Understanding the response to high-stakes incentives in primary education," Discussion Papers, Research Unit: Market Behavior SP II 2020-202, WZB Berlin Social Science Center.
    8. Paloyo, Alfredo R. & Rogan, Sally & Siminski, Peter, 2016. "The effect of supplemental instruction on academic performance: An encouragement design experiment," Economics of Education Review, Elsevier, vol. 55(C), pages 57-69.
    9. Arora, Puneet & Musaddiq, Tareena, 2023. "Can rank-based non-monetary rewards improve student attendance? Experimental evidence from India," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    10. Martorell, Paco & Miller, Trey & Santibañez, Lucrecia & Augustine, Catherine H., 2016. "Can incentives for parents and students change educational inputs? Experimental evidence from summer school," Economics of Education Review, Elsevier, vol. 50(C), pages 113-126.
    11. Matthew C. Rousu & Jay R. Corrigan & David Harris & Jill K. Hayter & Scott Houser & Becky A. Lafrancois & Olugbenga Onafowora & Gregory Colson & Adam Hoffer, 2015. "Do Monetary Incentives Matter in Classroom Experiments? Effects on Course Performance," The Journal of Economic Education, Taylor & Francis Journals, vol. 46(4), pages 341-349, October.
    12. Adam M. Lavecchia & Heidi Liu & Philip Oreopoulos, 2014. "Behavioral Economics of Education: Progress and Possibilities," NBER Working Papers 20609, National Bureau of Economic Research, Inc.
    13. KAYABA, Yutaka & 萱場, 豊, 2016. "How do People Procrastinate to Meet a Deadline?," Discussion paper series HIAS-E-33, Hitotsubashi Institute for Advanced Study, Hitotsubashi University.
    14. Åslund, Olof & Engdahl, Mattias, 2018. "The value of earning for learning: Performance bonuses in immigrant language training," Economics of Education Review, Elsevier, vol. 62(C), pages 192-204.
    15. Tomas Havranek & Anna Sokolova, 2020. "Do Consumers Really Follow a Rule of Thumb? Three Thousand Estimates from 144 Studies Say 'Probably Not'," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 35, pages 97-122, January.
    16. Ostermaier, Andreas & Beltz, Philipp & Link, Susanne, 2013. "Do university policies matter? Effects of Course Policies on Performance," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79924, Verein für Socialpolitik / German Economic Association.
    17. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    18. Maria Apostolova‐Mihaylova & William Cooper & Gail Hoyt & Emily C. Marshall, 2015. "Heterogeneous gender effects under loss aversion in the economics classroom: A field experiment," Southern Economic Journal, John Wiley & Sons, vol. 81(4), pages 980-994, April.
    19. Gong, Jie & Liu, Tracy Xiao & Tang, Jie, 2021. "How monetary incentives improve outcomes in MOOCs: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 905-921.
    20. Andreas Ostermaier, 2018. "Incentives for students: effects of certificates and deadlines on student performance," Journal of Business Economics, Springer, vol. 88(1), pages 65-96, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:wbe9k_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.