IDEAS home Printed from https://ideas.repec.org/a/eee/joepsy/v93y2022ics0167487022000642.html
   My bibliography  Save this article

Incentives in surveys

Author

Listed:
  • Baillon, Aurélien
  • Bleichrodt, Han
  • Granic, Georg D.

Abstract

Surveys typically use hypothetical questions to measure subjective and unverifiable concepts like happiness and quality of life. We test whether this is problematic using a large survey experiment on health and subjective well-being. We use Prelec’s Bayesian truth serum to incentivize the experiment and defaults to introduce biases in responses. Without defaults, the data quality was good and incentives had no impact. With defaults, incentives reduced default biases in the subjective well-being questions by inducing participants to spend more effort. Incentives had no impact on the health questions regardless of whether defaults were used.

Suggested Citation

  • Baillon, Aurélien & Bleichrodt, Han & Granic, Georg D., 2022. "Incentives in surveys," Journal of Economic Psychology, Elsevier, vol. 93(C).
    • Handle: RePEc:eee:joepsy:v:93:y:2022:i:c:s0167487022000642
    DOI: 10.1016/j.joep.2022.102552
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167487022000642
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joep.2022.102552?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    2. Angus Deaton & Arthur A. Stone, 2013. "Two Happiness Puzzles," American Economic Review, American Economic Association, vol. 103(3), pages 591-597, May.
      • Arthur A. Stone & Angus Deaton, 2013. "Two happiness puzzles," Working Papers 2013-3, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    3. Nolan Miller & Paul Resnick & Richard Zeckhauser, 2005. "Eliciting Informative Feedback: The Peer-Prediction Method," Management Science, INFORMS, vol. 51(9), pages 1359-1373, September.
    4. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    5. Amos Tversky & Daniel Kahneman, 1991. "Loss Aversion in Riskless Choice: A Reference-Dependent Model," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 1039-1061.
    6. repec:pri:cepsud:125krueger is not listed on IDEAS
    7. Daniel Kahneman & Alan B. Krueger & David Schkade & Norbert Schwarz & Arthur A. Stone, 2006. "Would You Be Happier If You Were Richer? A Focusing Illusion," Working Papers 77, Princeton University, Department of Economics, Center for Economic Policy Studies..
    8. Sonja Radas & Drazen Prelec, 2019. "Whose data can we trust: How meta-predictions can be used to uncover credible respondents in survey data," PLOS ONE, Public Library of Science, vol. 14(12), pages 1-16, December.
    9. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    10. Anja Achtziger & Carlos Alós-Ferrer, 2014. "Fast or Rational? A Response-Times Study of Bayesian Updating," Management Science, INFORMS, vol. 60(4), pages 923-938, April.
    11. Borodin A. D., 2016. "World experience of state influence on the economy," Visnyk of National University of Civil Protection of Ukraine. Public Administration series., National University of Civil Protection of Ukraine, vol. 4(1), pages 37-43, January.
    12. Ariel Rubinstein, 2016. "A Typology of Players: Between Instinctive and Contemplative," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(2), pages 859-890.
    13. Daniel Read, 2005. "Monetary incentives, what are they good for?," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(2), pages 265-276.
    14. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    15. Jakša Cvitanić & Dražen Prelec & Blake Riley & Benjamin Tereick, 2019. "Honesty via Choice-Matching," American Economic Review: Insights, American Economic Association, vol. 1(2), pages 179-192, September.
    16. Johannes Abeler & Daniele Nosenzo & Collin Raymond, 2019. "Preferences for Truth‐Telling," Econometrica, Econometric Society, vol. 87(4), pages 1115-1153, July.
    17. Beattie, Jane & Loomes, Graham, 1997. "The Impact of Incentives upon Risky Choice Experiments," Journal of Risk and Uncertainty, Springer, vol. 14(2), pages 155-168, March.
    18. Uri Gneezy & Aldo Rustichini, 2000. "Pay Enough or Don't Pay at All," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 791-810.
    19. Vlaev, Ivo, 2012. "How different are real and hypothetical decisions? Overestimation, contrast and assimilation in social interaction," Journal of Economic Psychology, Elsevier, vol. 33(5), pages 963-972.
    20. Grebitus, Carola & Lusk, Jayson L. & Nayga, Rodolfo M., 2013. "Explaining differences in real and hypothetical experimental auctions and choice experiments with personality," Journal of Economic Psychology, Elsevier, vol. 36(C), pages 11-26.
    21. John F. Helliwell & Haifang Huang, 2014. "New Measures Of The Costs Of Unemployment: Evidence From The Subjective Well-Being Of 3.3 Million Americans," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1485-1502, October.
    22. Samuelson, William & Zeckhauser, Richard, 1988. "Status Quo Bias in Decision Making," Journal of Risk and Uncertainty, Springer, vol. 1(1), pages 7-59, March.
    23. Johnson, Eric J & Hershey, John & Meszaros, Jacqueline & Kunreuther, Howard, 1993. "Framing, Probability Distortions, and Insurance Decisions," Journal of Risk and Uncertainty, Springer, vol. 7(1), pages 35-51, August.
    24. Grether, David M & Plott, Charles R, 1979. "Economic Theory of Choice and the Preference Reversal Phenomenon," American Economic Review, American Economic Association, vol. 69(4), pages 623-638, September.
    25. Daniel Kahneman & Alan B. Krueger & David Schkade & Norbert Schwarz & Arthur A. Stone, 2006. "Would You Be Happier If You Were Richer? A Focusing Illusion," Working Papers 77, Princeton University, Department of Economics, Center for Economic Policy Studies..
    26. Han Bleichrodt & Jose Luis Pinto Prades, 2009. "New evidence of preference reversals in health utility measurement," Health Economics, John Wiley & Sons, Ltd., vol. 18(6), pages 713-726, June.
    27. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521853408.
    28. Dolan, P. & Gudex, C. & Kind, P. & Williams, A., 1996. "Valuing health states: A comparison of methods," Journal of Health Economics, Elsevier, vol. 15(2), pages 209-231, April.
    29. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    30. Guala,Francesco, 2005. "The Methodology of Experimental Economics," Cambridge Books, Cambridge University Press, number 9780521618618.
    31. Mørkbak, Morten Raun & Olsen, Søren Bøye & Campbell, Danny, 2014. "Behavioral implications of providing real incentives in stated choice experiments," Journal of Economic Psychology, Elsevier, vol. 45(C), pages 102-116.
    32. Drummond, Michael F. & Sculpher, Mark J. & Claxton, Karl & Stoddart, Greg L. & Torrance, George W., 2015. "Methods for the Economic Evaluation of Health Care Programmes," OUP Catalogue, Oxford University Press, edition 4, number 9780199665884.
    33. Palan, Stefan & Schitter, Christian, 2018. "Prolific.ac—A subject pool for online experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 17(C), pages 22-27.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    2. Emin Karagözoğlu & Ümit Barış Urhan, 2017. "The Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey," Group Decision and Negotiation, Springer, vol. 26(2), pages 285-325, March.
    3. Sophie Massin & Antoine Nebout & Bruno Ventelou, 2018. "Predicting medical practices using various risk attitude measures," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(6), pages 843-860, July.
    4. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).
    5. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2019. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics," Research Memorandum 029, Maastricht University, Graduate School of Business and Economics (GSBE).
    6. Andreas Hackethal & Michael Kirchler & Christine Laudenbach & Michael Razen & Annika Weber, 2023. "On the role of monetary incentives in risk preference elicitation experiments," Journal of Risk and Uncertainty, Springer, vol. 66(2), pages 189-213, April.
    7. Andrea Hackethal & Michael Kirchler & Christine Laudenbach & Michael Razen & Annika Weber, 2020. "On the role of monetary incentives in risk preference elicitation experiments," Working Papers 2020-29, Faculty of Economics and Statistics, Universität Innsbruck.
    8. Matthias Buchholz & Oliver Musshoff, 2021. "Tax or green nudge? An experimental analysis of pesticide policies in Germany [A psychological study of the inverse relationship between perceived risk and perceived benefit]," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 48(4), pages 940-982.
    9. Booij, Adam S. & van de Kuilen, Gijs, 2009. "A parameter-free analysis of the utility of money for the general population under prospect theory," Journal of Economic Psychology, Elsevier, vol. 30(4), pages 651-666, August.
    10. Emmanouil Mentzakis & Jana Sadeh, 2021. "Experimental evidence on the effect of incentives and domain in risk aversion and discounting tasks," Journal of Risk and Uncertainty, Springer, vol. 62(3), pages 203-224, June.
    11. Dennis D. Fehrenbacher & Claudia R Schneider & Elke U. Weber, 2017. "Catch me if I fall: Cross-national differences in willingness to take financial risks as a function of social and state ‘cushioning’," LWS Working papers 16, LIS Cross-National Data Center in Luxembourg.
    12. Jinkwon Lee, 2007. "Repetition And Financial Incentives In Economics Experiments," Journal of Economic Surveys, Wiley Blackwell, vol. 21(3), pages 628-681, July.
    13. Wiebke Roß & Jens Weghake, 2018. "Wa(h)re Liebe: Was Online-Dating-Plattformen über zweiseitige Märkte lehren," TUC Working Papers in Economics 0017, Abteilung für Volkswirtschaftslehre, Technische Universität Clausthal (Department of Economics, Technical University Clausthal).
    14. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    15. Andreas Ortmann & Ralph Hertwig, 2006. "Monetary Incentives: Usually Neither Necessary Nor Sufficient?," CERGE-EI Working Papers wp307, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    16. Thomas Kourouxous & Thomas Bauer, 2019. "Violations of dominance in decision-making," Business Research, Springer;German Academic Association for Business Research, vol. 12(1), pages 209-239, April.
    17. Han Bleichrodt & José Luis Pinto, 2000. "An experimental test of loss aversion and scale compatibility," Working Papers, Research Center on Health and Economics 467, Department of Economics and Business, Universitat Pompeu Fabra.
    18. Attema, Arthur E. & Brouwer, Werner B.F., 2013. "In search of a preferred preference elicitation method: A test of the internal consistency of choice and matching tasks," Journal of Economic Psychology, Elsevier, vol. 39(C), pages 126-140.
    19. Nathalie Etchart-Vincent & Olivier l’Haridon, 2011. "Monetary incentives in the loss domain and behavior toward risk: An experimental comparison of three reward schemes including real losses," Journal of Risk and Uncertainty, Springer, vol. 42(1), pages 61-83, February.
    20. Eric Johnson & Suzanne Shu & Benedict Dellaert & Craig Fox & Daniel Goldstein & Gerald Häubl & Richard Larrick & John Payne & Ellen Peters & David Schkade & Brian Wansink & Elke Weber, 2012. "Beyond nudges: Tools of a choice architecture," Marketing Letters, Springer, vol. 23(2), pages 487-504, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joepsy:v:93:y:2022:i:c:s0167487022000642. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joep .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.