IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/17680.html
   My bibliography  Save this paper

Financial Incentives and Performance: A Meta-Analysis of Economics Evidence

Author

Listed:
  • Cala, Petr
  • Havranek, Tomas
  • Irsova, Zuzana
  • Matousek, Jindrich
  • Novak, Jiri

Abstract

Standard economics models require that financial incentives improve performance, while leading theories in psychology allow for the opposite. Experimental results are mixed, and so far have not been corrected for publication bias and model uncertainty. We collect 1,568 economics estimates together with 46 factors capturing the context in which the estimates were obtained. We use novel nonlinear techniques to correct for publication bias and employ Bayesian model averaging to account for model uncertainty. The corrected estimates are zero or tiny across contexts of field experiments, including differences in performance measurement, task definition, reward size and framing, motivation beyond money, subject pool, and estimation technique. Laboratory experiments produce statistically significant estimates on average after correction for publication bias, but even there the effect is weak. Experimental economics evidence is inconsistent with standard economics models.

Suggested Citation

  • Cala, Petr & Havranek, Tomas & Irsova, Zuzana & Matousek, Jindrich & Novak, Jiri, 2022. "Financial Incentives and Performance: A Meta-Analysis of Economics Evidence," CEPR Discussion Papers 17680, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:17680
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP17680
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jonathan de Quidt, 2018. "Your Loss Is My Gain: A Recruitment Experiment with Framed Incentives," Journal of the European Economic Association, European Economic Association, vol. 16(2), pages 522-559.
    2. Martin Feldkircher & Stefan Zeugner, 2012. "The impact of data revisions on the robustness of growth determinants—a note on ‘determinants of economic growth: Will data tell?’," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(4), pages 686-694, June.
    3. Havranek, Tomas & Rusnak, Marek & Sokolova, Anna, 2017. "Habit formation in consumption: A meta-analysis," European Economic Review, Elsevier, vol. 95(C), pages 142-167.
    4. Iwasaki, Ichiro, 2022. "The finance-growth nexus in Latin America and the Caribbean: A meta-analytic perspective," World Development, Elsevier, vol. 149(C).
    5. Dan Ariely & Anat Bracha & Stephan Meier, 2009. "Doing Good or Doing Well? Image Motivation and Monetary Incentives in Behaving Prosocially," American Economic Review, American Economic Association, vol. 99(1), pages 544-555, March.
    6. Ernst Fehr & Klaus M. Schmidt, 2007. "Adding a Stick to the Carrot? The Interaction of Bonuses and Fines," American Economic Review, American Economic Association, vol. 97(2), pages 177-181, May.
    7. Nicola Lacetera & Mario Macis & Robert Slonim, 2012. "Will There Be Blood? Incentives and Displacement Effects in Pro-social Behavior," American Economic Journal: Economic Policy, American Economic Association, vol. 4(1), pages 186-223, February.
    8. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    9. Thomas Dohmen & Armin Falk, 2011. "Performance Pay and Multidimensional Sorting: Productivity, Preferences, and Gender," American Economic Review, American Economic Association, vol. 101(2), pages 556-590, April.
    10. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    11. Dean Karlan & John A. List, 2007. "Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment," American Economic Review, American Economic Association, vol. 97(5), pages 1774-1793, December.
    12. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    13. Ernst Fehr & Lorenz Goette, 2007. "Do Workers Work More if Wages Are High? Evidence from a Randomized Field Experiment," American Economic Review, American Economic Association, vol. 97(1), pages 298-317, March.
    14. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    15. Carl Mellström & Magnus Johannesson, 2008. "Crowding Out in Blood Donation: Was Titmuss Right?," Journal of the European Economic Association, MIT Press, vol. 6(4), pages 845-863, June.
    16. Gerber, Alan & Malhotra, Neil, 2008. "Do Statistical Reporting Standards Affect What Is Published? Publication Bias in Two Leading Political Science Journals," Quarterly Journal of Political Science, now publishers, vol. 3(3), pages 313-326, October.
    17. Stanley, T. D. & Jarrell, Stephen B. & Doucouliagos, Hristos, 2010. "Could It Be Better to Discard 90% of the Data? A Statistical Paradox," The American Statistician, American Statistical Association, vol. 64(1), pages 70-77.
    18. Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022. "Individual discount rates: a meta-analysis of experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.
    19. Edward P. Lazear, 2000. "Performance Pay and Productivity," American Economic Review, American Economic Association, vol. 90(5), pages 1346-1361, December.
    20. Li, Tao & Han, Li & Zhang, Linxiu & Rozelle, Scott, 2014. "Encouraging classroom peer interactions: Evidence from Chinese migrant schools," Journal of Public Economics, Elsevier, vol. 111(C), pages 29-45.
    21. Ernst Fehr & John A. List, 2004. "The Hidden Costs and Returns of Incentives-Trust and Trustworthiness Among CEOs," Journal of the European Economic Association, MIT Press, vol. 2(5), pages 743-771, September.
    22. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    23. Gary Charness & Daniela Grieco, 2019. "Creativity and Incentives," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 454-496.
    24. Theo S. Eicher & Chris Papageorgiou & Adrian E. Raftery, 2011. "Default priors and predictive performance in Bayesian model averaging, with application to growth determinants," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 30-55, January/F.
    25. Felipe Barrera-Osorio & Leigh L. Linden & Juan E. Saavedra, 2019. "Medium- and Long-Term Educational Consequences of Alternative Conditional Cash Transfer Designs: Experimental Evidence from Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 54-91, July.
    26. Boyer, Pierre C. & Dwenger, Nadja & Rincke, Johannes, 2016. "Do norms on contribution behavior affect intrinsic motivation? Field-experimental evidence from Germany," Journal of Public Economics, Elsevier, vol. 144(C), pages 140-153.
    27. Stephan Meier, 2007. "Do Subsidies Increase Charitable Giving in the Long Run? Matching Donations in a Field Experiment," Journal of the European Economic Association, MIT Press, vol. 5(6), pages 1203-1222, December.
    28. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    29. Lucas C. Coffman, 2011. "Intermediation Reduces Punishment (and Reward)," American Economic Journal: Microeconomics, American Economic Association, vol. 3(4), pages 77-106, November.
    30. Christiane Bradler & Susanne Neckermann & Arne Jonas Warnke, 2019. "Incentivizing Creativity: A Large-Scale Experiment with Performance Bonuses and Gifts," Journal of Labor Economics, University of Chicago Press, vol. 37(3), pages 793-851.
    31. Ugur, Mehmet & Churchill, Sefa Awaworyi & Luong, Hoang M., 2020. "What do we know about R&D spillovers and productivity? Meta-analysis evidence on heterogeneity and statistical power," Research Policy, Elsevier, vol. 49(1).
    32. Friedl, Andreas & Neyse, Levent & Schmidt, Ulrich, 2018. "Payment scheme changes and effort Adjustment: The role of 2D:4D digit ratio," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 72(C), pages 86-94.
    33. Marek Rusnak & Tomas Havranek & Roman Horvath, 2013. "How to Solve the Price Puzzle? A Meta‐Analysis," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45(1), pages 37-70, February.
    34. Deirdre Nansen McCloskey & Stephen T. Ziliak, 2019. "What quantitative methods should we teach to graduate students? A comment on Swann’s “Is precise econometrics an illusion?”," The Journal of Economic Education, Taylor & Francis Journals, vol. 50(4), pages 356-361, October.
    35. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    36. Takahashi, Hiromasa & Shen, Junyi & Ogawa, Kazuhito, 2016. "An experimental examination of compensation schemes and level of effort in differentiated tasks," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 61(C), pages 12-19.
    37. Nadja Dwenger & Henrik Kleven & Imran Rasul & Johannes Rincke, 2016. "Extrinsic and Intrinsic Motivations for Tax Compliance: Evidence from a Field Experiment in Germany," American Economic Journal: Economic Policy, American Economic Association, vol. 8(3), pages 203-232, August.
    38. Michael Kirchler & Stefan Palan, 2018. "Immaterial and monetary gifts in economic transactions: evidence from the field," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 205-230, March.
    39. Doucouliagos, Hristos (Chris), 2011. "How large is large? Preliminary and relative guidelines for interpreting partial correlations in economics," Working Papers eco_2011_5, Deakin University, Department of Economics.
    40. Sudarshan, Anant, 2017. "Nudges in the marketplace: The response of household electricity consumption to information and monetary incentives," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 320-335.
    41. Schall, Dominik L. & Wolf, Menas & Mohnen, Alwine, 2016. "Do effects of theoretical training and rewards for energy-efficient behavior persist over time and interact? A natural field experiment on eco-driving in a company fleet," Energy Policy, Elsevier, vol. 97(C), pages 291-300.
    42. Zeugner, Stefan & Feldkircher, Martin, 2015. "Bayesian Model Averaging Employing Fixed and Flexible Priors: The BMS Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 68(i04).
    43. Tatiana A. Homonoff, 2018. "Can Small Incentives Have Large Effects? The Impact of Taxes versus Bonuses on Disposable Bag Use," American Economic Journal: Economic Policy, American Economic Association, vol. 10(4), pages 177-210, November.
    44. Chaim Fershtman & Uri Gneezy, 2011. "The Tradeoff Between Performance And Quitting In High Power Tournaments," Journal of the European Economic Association, European Economic Association, vol. 9(2), pages 318-336, April.
    45. Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2024. "Publication and Attenuation Biases in Measuring Skill Substitution," The Review of Economics and Statistics, MIT Press, vol. 106(5), pages 1187-1200, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marco Clemens & Jan Sauermann, 2024. "Making the Right Call: The Heterogeneous Effects of Individual Performance Pay on Productivity," IAAEU Discussion Papers 202405, Institute of Labour Law and Industrial Relations in the European Union (IAAEU).
    2. Irsova, Zuzana & Doucouliagos, Hristos & Havranek, Tomas & Stanley, T. D., 2023. "Meta-Analysis of Social Science Research: A Practitioner’s Guide," EconStor Preprints 273719, ZBW - Leibniz Information Centre for Economics.
    3. Clemens, Marco & Sauermann, Jan, 2024. "Making the Right Call: The Heterogeneous Effects of Individual Performance Pay on Productivity," IZA Discussion Papers 17119, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.
    2. Ali Elminejad & Tomas Havranek & Roman Horvath & Zuzana Irsova, 2023. "Intertemporal Substitution in Labor Supply: A Meta-Analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 1095-1113, December.
    3. Roman Horvath & Ali Elminejad & Tomas Havranek, 2020. "Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor Supply," Working Papers IES 2020/32, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    4. Zigraiova, Diana & Havranek, Tomas & Irsova, Zuzana & Novak, Jiri, 2021. "How puzzling is the forward premium puzzle? A meta-analysis," European Economic Review, Elsevier, vol. 134(C).
    5. Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022. "Individual discount rates: a meta-analysis of experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.
    6. Sebastian Gechert & Tomas Havranek & Zuzana Irsova & Dominika Kolcunova, 2022. "Measuring Capital-Labor Substitution: The Importance of Method Choices and Publication Bias," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 45, pages 55-82, July.
    7. Tomas Havranek & Zuzana Irsova & Lubica Laslopova & Olesia Zeynalova, 2020. "Skilled and Unskilled Labor Are Less Substitutable than Commonly Thought," Working Papers IES 2020/29, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2020.
    8. Ashraf, Nava & Bandiera, Oriana & Jack, B. Kelsey, 2014. "No margin, no mission? A field experiment on incentives for public service delivery," Journal of Public Economics, Elsevier, vol. 120(C), pages 1-17.
    9. Florian Englmaier & Stefan Grimm & Dominik Grothe & David Schindler & Simeon Schudy, 2024. "The Effect of Incentives in Nonroutine Analytical Team Tasks," Journal of Political Economy, University of Chicago Press, vol. 132(8), pages 2695-2747.
    10. Samuel Bowles & Sandra Polania-Reyes, 2011. "Economic incentives and social preferences: substitutes or complements?," Department of Economics University of Siena 617, Department of Economics, University of Siena.
    11. Bajzik, Josef & Havranek, Tomas & Irsova, Zuzana & Schwarz, Jiri, 2020. "Estimating the Armington elasticity: The importance of study design and publication bias," Journal of International Economics, Elsevier, vol. 127(C).
    12. Katarina Gomoryova, 2024. "Female Leadership and Financial Performance: A Meta-Analysis," Working Papers IES 2024/6, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Jan 2024.
    13. Bajzik, Josef, 2021. "Trading volume and stock returns: A meta-analysis," International Review of Financial Analysis, Elsevier, vol. 78(C).
    14. Tomas Havranek & Anna Sokolova, 2020. "Do Consumers Really Follow a Rule of Thumb? Three Thousand Estimates from 144 Studies Say 'Probably Not'," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 35, pages 97-122, January.
    15. Anna Sokolova, 2023. "Marginal Propensity to Consume and Unemployment: a Meta-analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 813-846, December.
    16. Irsova, Zuzana & Doucouliagos, Hristos & Havranek, Tomas & Stanley, T. D., 2023. "Meta-Analysis of Social Science Research: A Practitioner’s Guide," EconStor Preprints 273719, ZBW - Leibniz Information Centre for Economics.
    17. Gric, Zuzana & Bajzík, Josef & Badura, Ondřej, 2023. "Does sentiment affect stock returns? A meta-analysis across survey-based measures," International Review of Financial Analysis, Elsevier, vol. 89(C).
    18. Havranek, Tomas & Irsova, Zuzana & Laslopova, Lubica & Zeynalova, Olesia, 2020. "The Elasticity of Substitution between Skilled and Unskilled Labor: A Meta-Analysis," MPRA Paper 102598, University Library of Munich, Germany.
    19. Dominika Ehrenbergerova & Josef Bajzik, 2020. "The Effect of Monetary Policy on House Prices - How Strong is the Transmission?," Working Papers 2020/14, Czech National Bank.
    20. Matej Opatrny & Tomas Havranek & Zuzana Irsova & Milan Scasny, 2023. "Publication Bias and Model Uncertainty in Measuring the Effect of Class Size on Achievement," Working Papers IES 2023/19, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised May 2023.

    More about this item

    Keywords

    Incentives;

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • M52 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics - - - Compensation and Compensation Methods and Their Effects

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:17680. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.