IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp12395.html
   My bibliography  Save this paper

Do Measures of Risk Attitude in the Laboratory Predict Behavior under Risk in and outside of the Laboratory?

Author

Listed:
  • Charness, Gary

    (University of California, Santa Barbara)

  • Garcia, Thomas

    (GATE, University of Lyon)

  • Offerman, Theo

    (University of Amsterdam)

  • Villeval, Marie Claire

    (CNRS, GATE)

Abstract

We consider the external validity of laboratory measures of risk attitude. Based on a large-scale experiment using a representative panel of the Dutch population, we test if these measures can explain two different types of behavior: (i) behavior in laboratory risky financial decisions, and (ii) behavior in naturally-occurring field behavior under risk (financial, health and employment decisions). We find that measures of risk attitude are related to behavior in laboratory financial decisions and the most complex measures are outperformed by simpler measures. However, measures of risk attitude are not related to risk-taking in the field, calling into question the methods currently used for the purpose of measuring actual risk preferences. We conclude that while the external validity of measures of risk attitude holds in closely related frameworks, this validity is compromised in more remote settings.

Suggested Citation

  • Charness, Gary & Garcia, Thomas & Offerman, Theo & Villeval, Marie Claire, 2019. "Do Measures of Risk Attitude in the Laboratory Predict Behavior under Risk in and outside of the Laboratory?," IZA Discussion Papers 12395, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp12395
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp12395.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. W. Viscusi & Owen Phillips & Stephan Kroll, 2011. "Risky investment decisions: How are individuals influenced by their groups?," Journal of Risk and Uncertainty, Springer, vol. 43(2), pages 81-106, October.
    2. Jason R.V. Franken & Joost M.E. Pennings & Philip Garcia, 2017. "Risk attitudes and the structure of decision†making: evidence from the Illinois hog industry," Agricultural Economics, International Association of Agricultural Economists, vol. 48(1), pages 41-50, January.
    3. Hans P. Binswanger, 1980. "Attitudes Toward Risk: Experimental Measurement in Rural India," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(3), pages 395-407.
    4. Linda Thunström & Chian Jones Ritten, 2019. "Endogenous attention to costs," Journal of Risk and Uncertainty, Springer, vol. 59(1), pages 1-22, August.
    5. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    6. Matthias Sutter & Martin G. Kocher & Daniela Glätzle-Rützler & Stefan T. Trautmann, 2013. "Impatience and Uncertainty: Experimental Decisions Predict Adolescents' Field Behavior," American Economic Review, American Economic Association, vol. 103(1), pages 510-531, February.
    7. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2012. "Experimental methods: Between-subject and within-subject design," Journal of Economic Behavior & Organization, Elsevier, vol. 81(1), pages 1-8.
    8. Paolo Crosetto & Antonio Filippin, 2013. "The “bomb” risk elicitation task," Journal of Risk and Uncertainty, Springer, vol. 47(1), pages 31-65, August.
    9. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    10. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2005. "Individual Risk Attitudes: New Evidence from a Large, Representative, Experimentally-Validated Survey," Discussion Papers of DIW Berlin 511, DIW Berlin, German Institute for Economic Research.
    11. Arnaud Reynaud & Stéphane Couture, 2012. "Stability of risk preference measures: results from a field experiment on French farmers," Theory and Decision, Springer, vol. 73(2), pages 203-221, August.
    12. Charles N. Noussair & Stefan T. Trautmann & Gijs van de Kuilen, 2014. "Higher Order Risk Attitudes, Demographics, and Financial Decisions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(1), pages 325-355.
    13. Peter P. Wakker, 2008. "Explaining the characteristics of the power (CRRA) utility family," Health Economics, John Wiley & Sons, Ltd., vol. 17(12), pages 1329-1344, December.
    14. Gary Charness & Uri Gneezy, 2010. "Portfolio Choice And Risk Attitudes: An Experiment," Economic Inquiry, Western Economic Association International, vol. 48(1), pages 133-146, January.
    15. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    16. Uwe Dulleck & Jonas Fooken & Jacob Fell, 2015. "Within-Subject Intra- and Inter-Method Consistency of Two Experimental Risk Attitude Elicitation Methods," German Economic Review, Verein für Socialpolitik, vol. 16(1), pages 104-121, February.
    17. Xiaohao Ding & Joop Hartog & Yuze Sun, 2010. "Can we measure Individual Risk Attitudes in a Survey?," Tinbergen Institute Discussion Papers 10-027/3, Tinbergen Institute.
    18. Luigi Guiso & Monica Paiella, 2008. "Risk Aversion, Wealth, and Background Risk," Journal of the European Economic Association, MIT Press, vol. 6(6), pages 1109-1150, December.
    19. Alma Cohen & Liran Einav, 2007. "Estimating Risk Preferences from Deductible Choice," American Economic Review, American Economic Association, vol. 97(3), pages 745-788, June.
    20. Ann-Renée Blais & Elke U. Weber, 2006. "A Domain-Specific Risk-Taking (DOSPERT)Scale for Adult Populations," CIRANO Working Papers 2006s-24, CIRANO.
    21. Herbert A. Simon, 1955. "A Behavioral Model of Rational Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 69(1), pages 99-118.
    22. Levon Barseghyan & Francesca Molinari & Ted O'Donoghue & Joshua C. Teitelbaum, 2013. "The Nature of Risk Preferences: Evidence from Insurance Choices," American Economic Review, American Economic Association, vol. 103(6), pages 2499-2529, October.
    23. Pan He & Marcella Veronesi & Stefanie Engel, 2018. "Consistency of Risk Preference Measures: An Artefactual Field Experiment from Rural China," Journal of Development Studies, Taylor & Francis Journals, vol. 54(11), pages 1955-1973, November.
    24. Quang Nguyen & Colin Camerer & Tomomi Tanaka, 2010. "Risk and Time Preferences Linking Experimental and Household Data from Vietnam," Post-Print halshs-00547090, HAL.
    25. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    26. Bernd Hardeweg & Lukas Menkhoff & Hermann Waibel, 2013. "Experimentally Validated Survey Evidence on Individual Risk Attitudes in Rural Thailand," Economic Development and Cultural Change, University of Chicago Press, vol. 61(4), pages 859-888.
    27. Marco Caliendo & Frank Fossen & Alexander Kritikos, 2009. "Risk attitudes of nascent entrepreneurs–new evidence from an experimentally validated survey," Small Business Economics, Springer, vol. 32(2), pages 153-167, February.
    28. Uri Gneezy & Jan Potters, 1997. "An Experiment on Risk Taking and Evaluation Periods," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 631-645.
    29. Cary Deck & Jungmin Lee & Javier Reyes, 2008. "Risk attitudes in large stake gambles: evidence from a game show," Applied Economics, Taylor & Francis Journals, vol. 40(1), pages 41-52.
    30. repec:cup:judgdm:v:1:y:2006:i::p:33-47 is not listed on IDEAS
    31. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David B. Huffman & Uwe Sunde, 2017. "Global Evidence on Economic Preferences," NBER Working Papers 23943, National Bureau of Economic Research, Inc.
    32. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    33. Catherine C. Eckel & Philip J. Grossman, 2008. "Forecasting Risk Attitudes: An Experimental Study Using Actual and Forecast Gamble Choices," Monash Economics Working Papers archive-01, Monash University, Department of Economics.
    34. Verschoor, Arjan & D’Exelle, Ben & Perez-Viana, Borja, 2016. "Lab and life: Does risky choice behaviour observed in experiments reflect that in the real world?," Journal of Economic Behavior & Organization, Elsevier, vol. 128(C), pages 134-148.
    35. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1645-1692.
    36. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    37. Charness, Gary & Gneezy, Uri & Imas, Alex, 2013. "Experimental methods: Eliciting risk preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 87(C), pages 43-51.
    38. Graham Loomes & Ganna Pogrebna, 2014. "Measuring Individual Risk Attitudes when Preferences are Imprecise," Economic Journal, Royal Economic Society, vol. 0(576), pages 569-593, May.
    39. Sarah Jacobson & Ragan Petrie, 2009. "Learning from mistakes: What do inconsistent choices over risk tell us?," Journal of Risk and Uncertainty, Springer, vol. 38(2), pages 143-158, April.
    40. Linda Thunström & Jonas Nordström & Jason F. Shogren & Mariah Ehmke & Klaas Veld, 2016. "Strategic self-ignorance," Journal of Risk and Uncertainty, Springer, vol. 52(2), pages 117-136, April.
    41. Liran Einav & Amy Finkelstein & Iuliana Pascu & Mark R. Cullen, 2012. "How General Are Risk Preferences? Choices under Uncertainty in Different Domains," American Economic Review, American Economic Association, vol. 102(6), pages 2606-2638, October.
    42. Jayson L. Lusk & Keith H. Coble, 2005. "Risk Perceptions, Risk Preference, and Acceptance of Risky Food," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 393-405.
    43. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    44. Mark Egan & Gregor Matvos & Amit Seru, 2019. "The Market for Financial Adviser Misconduct," Journal of Political Economy, University of Chicago Press, vol. 127(1), pages 233-295.
    45. Paolo Crosetto & Antonio Filippin, 2016. "A theoretical and experimental appraisal of four risk elicitation methods," Experimental Economics, Springer;Economic Science Association, vol. 19(3), pages 613-641, September.
    46. Paolo Crosetto & Antonio Filippin, 2013. "A Theoretical and Experimental Appraisal of Five Risk Elicitation Methods," SOEPpapers on Multidisciplinary Panel Data Research 547, DIW Berlin, The German Socio-Economic Panel (SOEP).
    47. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    48. Deck, Cary & Lee, Jungmin & Reyes, Javier A. & Rosen, Christopher C., 2013. "A failed attempt to explain within subject variation in risk taking behavior using domain specific risk attitudes," Journal of Economic Behavior & Organization, Elsevier, vol. 87(C), pages 1-24.
    49. Tomomi Tanaka & Colin F. Camerer & Quang Nguyen, 2010. "Risk and Time Preferences: Linking Experimental and Household Survey Data from Vietnam," American Economic Review, American Economic Association, vol. 100(1), pages 557-571, March.
    50. Hakan J. Holm & Sonja Opper & Victor Nee, 2013. "Entrepreneurs Under Uncertainty: An Economic Experiment in China," Management Science, INFORMS, vol. 59(7), pages 1671-1687, July.
    51. Heiner, Ronald A, 1983. "The Origin of Predictable Behavior," American Economic Review, American Economic Association, vol. 73(4), pages 560-595, September.
    52. Lönnqvist, Jan-Erik & Verkasalo, Markku & Walkowitz, Gari & Wichardt, Philipp C., 2015. "Measuring individual risk attitudes in the lab: Task or ask? An empirical comparison," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 254-266.
    53. Andreas Pedroni & Renato Frey & Adrian Bruhin & Gilles Dutilh & Ralph Hertwig & Jörg Rieskamp, 2017. "The risk elicitation puzzle," Nature Human Behaviour, Nature, vol. 1(11), pages 803-809, November.
    54. Fairley, Kim & Weitzel, Utz, 2017. "Ambiguity and risk measures in the lab and students’ real-life borrowing behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 67(C), pages 85-98.
    55. Drerup, Tilman & Enke, Benjamin & von Gaudecker, Hans-Martin, 2017. "The precision of subjective data and the explanatory power of economic models," Journal of Econometrics, Elsevier, vol. 200(2), pages 378-389.
    56. Ding, Xiaohao & Hartog, Joop & Sun, Yuze, 2010. "Can We Measure Individual Risk Attitudes in a Survey?," IZA Discussion Papers 4807, Institute of Labor Economics (IZA).
    57. Drazen Prelec, 1998. "The Probability Weighting Function," Econometrica, Econometric Society, vol. 66(3), pages 497-528, May.
    58. Offerman, Theo & Schotter, Andrew, 2009. "Imitation and luck: An experimental study on social sampling," Games and Economic Behavior, Elsevier, vol. 65(2), pages 461-502, March.
    59. Peter P. Wakker, 2008. "Explaining the characteristics of the power (CRRA) utility family," Health Economics, John Wiley & Sons, Ltd., vol. 17(12), pages 1329-1344.
    60. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    61. Justin Sydnor, 2010. "(Over)insuring Modest Risks," American Economic Journal: Applied Economics, American Economic Association, vol. 2(4), pages 177-199, October.
    62. Ferdinand M. Vieider & Mathieu Lefebvre & Ranoua Bouchouicha & Thorsten Chmura & Rustamdjan Hakimov & Michal Krawczyk & Peter Martinsson, 2015. "Common Components Of Risk And Uncertainty Attitudes Across Contexts And Domains: Evidence From 30 Countries," Journal of the European Economic Association, European Economic Association, vol. 13(3), pages 421-452, June.
    63. Steffen Andersen & Amalia Girolamo & Glenn Harrison & Morten Lau, 2014. "Risk and time preferences of entrepreneurs: evidence from a Danish field experiment," Theory and Decision, Springer, vol. 77(3), pages 341-357, October.
    64. Friedman, Daniel & Isaac, R. Mark & James, Duncan & Sunder, Shyam, 2014. "Risky Curves: On the Empirical Failure of Expected Utility," Santa Cruz Department of Economics, Working Paper Series qt87v8k86z, Department of Economics, UC Santa Cruz.
    65. Elke U. Weber & Christopher Hsee, 1998. "Cross-Cultural Differences in Risk Perception, but Cross-Cultural Similarities in Attitudes Towards Perceived Risk," Management Science, INFORMS, vol. 44(9), pages 1205-1217, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    2. Naranjo, Maria A. & Alpízar, Francisco & Martinsson, Peter, 2019. "Alternatives for Risk Elicitation in the Field: Evidence from Coffee Farmers in Costa Rica," EfD Discussion Paper 19-21, Environment for Development, University of Gothenburg.
    3. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    4. Holzmeister, Felix & Stefan, Matthias, 2019. "The Risk Elicitation Puzzle Revisited: Across-Methods (In)consistency?," OSF Preprints pj9u2, Center for Open Science.
    5. Felix Holzmeister & Matthias Stefan, 2019. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Working Papers 2019-19, Faculty of Economics and Statistics, Universität Innsbruck.
    6. Menkhoff, Lukas & Sakha, Sahra, 2017. "Estimating risky behavior with multiple-item risk measures," Journal of Economic Psychology, Elsevier, vol. 59(C), pages 59-86.
    7. Ranganathan, Kavitha & Lejarraga, Tomás, 2021. "Elicitation of risk preferences through satisficing," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    8. Felix Holzmeister & Matthias Stefan, 2021. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 593-616, June.
    9. Menkhoff, Lukas & Sakha, Sahra, 2014. "Multiple-item risk measures," Kiel Working Papers 1980, Kiel Institute for the World Economy (IfW Kiel).
    10. Eriksen, Kristoffer W. & Kvaløy, Ola & Luzuriaga, Miguel, 2020. "Risk-taking on behalf of others," Journal of Behavioral and Experimental Finance, Elsevier, vol. 26(C).
    11. Pan He & Marcella Veronesi & Stefanie Engel, 2016. "Consistency of Risk Preference Measures and the Role of Ambiguity: An Artefactual Field Experiment from China," Working Papers 03/2016, University of Verona, Department of Economics.
    12. Thomas Meissner & Xavier Gassmann & Corinne Faure & Joachim Schleich, 2023. "Individual characteristics associated with risk and time preferences: A multi country representative survey," Journal of Risk and Uncertainty, Springer, vol. 66(1), pages 77-107, February.
    13. Michele Garagnani, 2023. "The predictive power of risk elicitation tasks," Journal of Risk and Uncertainty, Springer, vol. 67(2), pages 165-192, October.
    14. Rafaï, Ismaël & Blayac, Thierry & Dubois, Dimitri & Duchêne, Sébastien & Nguyen-Van, Phu & Ventelou, Bruno & Willinger, Marc, 2023. "Stated preferences outperform elicited preferences for predicting reported compliance with COVID-19 prophylactic measures," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    15. Paolo Crosetto & Antonio Filippin, 2016. "A theoretical and experimental appraisal of four risk elicitation methods," Experimental Economics, Springer;Economic Science Association, vol. 19(3), pages 613-641, September.
    16. Ihli, Hanna Julia & Chiputwa, Brian & Musshoff, Oliver, 2016. "Do Changing Probabilities or Payoffs in Lottery-Choice Experiments Affect Risk Preference Outcomes? Evidence from Rural Uganda," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 41(2), May.
    17. Schneider, Sebastian O. & Sutter, Matthias, 2020. "Higher Order Risk Preferences: Experimental Measures, Determinants and Related Field Behavior," VfS Annual Conference 2020 (Virtual Conference): Gender Economics 224643, Verein für Socialpolitik / German Economic Association.
    18. Giuseppe Attanasi & Nikolaos Georgantzís & Valentina Rotondi & Daria Vigani, 2018. "Lottery- and survey-based risk attitudes linked through a multichoice elicitation task," Theory and Decision, Springer, vol. 84(3), pages 341-372, May.
    19. Aurélien Baillon & Owen O'Donnell & Stella Quimbo & Kim van Wilgenburg, 2022. "Do time preferences explain low health insurance take‐up?," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 89(4), pages 951-983, December.
    20. Colasante, Annarita & Marini, Matteo M. & Russo, Alberto, 2017. "Incidental emotions and risk-taking: An experimental analysis," MPRA Paper 76992, University Library of Munich, Germany.

    More about this item

    Keywords

    elicitation methods; lab-in-the-field experiment; risk preferences;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp12395. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.