IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i2p1149-1173.html
   My bibliography  Save this article

The Performance of Time-Preference and Risk-Preference Measures in Surveys

Author

Listed:
  • Joshua Tasoff

    (Department of Economics, Claremont Graduate University, Claremont, California 91711)

  • Wenjie Zhang

    (Department of Economics, Claremont Graduate University, Claremont, California 91711)

Abstract

Time preferences and risk preferences play an important role in a wide range of behavior, including financial decisions, entrepreneurship, and the proper incentivizing of agents. Numerous methods have been developed to measure these preferences hypothetically in surveys, but they have yielded inconsistent results. We analyze a panel data set in which subjects have collectively answered more than 400 surveys including 15 time-preference and 36 risk-preference elicitations. We evaluate the performance of these measures using the criteria of (1) ability to predict economically important behavior and (2) distinctness from other observables. We find substantial heterogeneity in the predictiveness of the measures. The best performing measure for time-preference is a titration method, in which a sequence of adaptive binary-choice questions narrows in on a subject’s indifference point, and for risk-preference it is a self-report measure of risk aversion. Using factor analysis, we find that time preferences are well explained by a single factor, but risk preferences load on multiple factors. However, the first factor loads almost entirely on self-reported risk-preference measures, and this factor explains much of the variation. The evidence can help inform researchers about which elicitation methods to include in their surveys.

Suggested Citation

  • Joshua Tasoff & Wenjie Zhang, 2022. "The Performance of Time-Preference and Risk-Preference Measures in Surveys," Management Science, INFORMS, vol. 68(2), pages 1149-1173, February.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:2:p:1149-1173
    DOI: 10.1287/mnsc.2020.3939
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2020.3939
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2020.3939?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Charles Courtemanche & Garth Heutel & Patrick McAlvanah, 2015. "Impatience, Incentives and Obesity," Economic Journal, Royal Economic Society, vol. 125(582), pages 1-31, February.
    2. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2010. "Are Risk Aversion and Impatience Related to Cognitive Ability?," American Economic Review, American Economic Association, vol. 100(3), pages 1238-1260, June.
    3. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    4. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1645-1692.
    5. Andreas Pedroni & Renato Frey & Adrian Bruhin & Gilles Dutilh & Ralph Hertwig & Jörg Rieskamp, 2017. "The risk elicitation puzzle," Nature Human Behaviour, Nature, vol. 1(11), pages 803-809, November.
    6. Annamaria Lusardi & Olivia S. Mitchell, 2014. "The Economic Importance of Financial Literacy: Theory and Evidence," Journal of Economic Literature, American Economic Association, vol. 52(1), pages 5-44, March.
    7. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.
    8. Bonin, Holger & Dohmen, Thomas & Falk, Armin & Huffman, David & Sunde, Uwe, 2007. "Cross-sectional earnings risk and occupational sorting: The role of risk attitudes," Labour Economics, Elsevier, vol. 14(6), pages 926-937, December.
    9. Anderson, Lisa R. & Mellor, Jennifer M., 2008. "Predicting health behaviors with an experimental measure of risk preference," Journal of Health Economics, Elsevier, vol. 27(5), pages 1260-1274, September.
    10. Quang Nguyen & Colin Camerer & Tomomi Tanaka, 2010. "Risk and Time Preferences Linking Experimental and Household Data from Vietnam," Post-Print halshs-00547090, HAL.
    11. David Bradford & Charles Courtemanche & Garth Heutel & Patrick McAlvanah & Christopher Ruhm, 2017. "Time preferences and consumer behavior," Journal of Risk and Uncertainty, Springer, vol. 55(2), pages 119-145, December.
    12. Stephan Meier & Charles Sprenger, 2010. "Present-Biased Preferences and Credit Card Borrowing," American Economic Journal: Applied Economics, American Economic Association, vol. 2(1), pages 193-210, January.
    13. van Rooij, Maarten & Lusardi, Annamaria & Alessie, Rob, 2011. "Financial literacy and stock market participation," Journal of Financial Economics, Elsevier, vol. 101(2), pages 449-472, August.
    14. Christopher Chabris & David Laibson & Carrie Morris & Jonathon Schuldt & Dmitry Taubinsky, 2008. "Individual laboratory-measured discount rates predict field behavior," Journal of Risk and Uncertainty, Springer, vol. 37(2), pages 237-269, December.
    15. Martina MENON & Federico PERALI, 2009. "Eliciting Risk and Time Preferences in Field Experiments: Are They Related to Cognitive and Non-Cognitive Outcomes? Are Circumstances Important?," Rivista Internazionale di Scienze Sociali, Vita e Pensiero, Pubblicazioni dell'Universita' Cattolica del Sacro Cuore, vol. 117(3), pages 593-630.
    16. Angela Hung & Andrew Parker & Joanne K. Yoong, 2009. "Defining and Measuring Financial Literacy," Working Papers 708, RAND Corporation.
    17. Andreoni, James & Kuhn, Michael A. & Sprenger, Charles, 2015. "Measuring time preferences: A comparison of experimental methods," Journal of Economic Behavior & Organization, Elsevier, vol. 116(C), pages 451-464.
    18. James Andreoni & Charles Sprenger, 2012. "Estimating Time Preferences from Convex Budgets," American Economic Review, American Economic Association, vol. 102(7), pages 3333-3356, December.
    19. Joshua Blumenstock & Michael Callen & Tarek Ghani, 2018. "Why Do Defaults Affect Behavior? Experimental Evidence from Afghanistan," American Economic Review, American Economic Association, vol. 108(10), pages 2868-2901, October.
    20. Ned Augenblick & Muriel Niederle & Charles Sprenger, 2015. "Editor's Choice Working over Time: Dynamic Inconsistency in Real Effort Tasks," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1067-1115.
    21. Angela A. Hung & Andrew M. Parker & Joanne K. Yoong, 2009. "Defining and Measuring Financial Literacy," Working Papers WR-708, RAND Corporation.
    22. Borghans, Lex & Golsteyn, Bart H.H., 2006. "Time discounting and the body mass index: Evidence from the Netherlands," Economics & Human Biology, Elsevier, vol. 4(1), pages 39-61, January.
    23. Robert B. Barsky & F. Thomas Juster & Miles S. Kimball & Matthew D. Shapiro, 1997. "Preference Parameters and Behavioral Heterogeneity: An Experimental Approach in the Health and Retirement Study," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 537-579.
    24. Michael Daly & Liam Delaney & Colm P. Harmon, 2009. "Psychological and Biological Foundations of Time Preference," Journal of the European Economic Association, MIT Press, vol. 7(2-3), pages 659-669, 04-05.
    25. Nava Ashraf & Dean Karlan & Wesley Yin, 2006. "Tying Odysseus to the Mast: Evidence From a Commitment Savings Product in the Philippines," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(2), pages 635-672.
    26. Gopi Shah Goda & Matthew Levy & Colleen Flaherty Manchester & Aaron Sojourner & Joshua Tasoff, 2019. "Predicting Retirement Savings Using Survey Measures Of Exponential‐Growth Bias And Present Bias," Economic Inquiry, Western Economic Association International, vol. 57(3), pages 1636-1658, July.
    27. repec:cup:judgdm:v:1:y:2006:i::p:33-47 is not listed on IDEAS
    28. Khwaja, Ahmed & Sloan, Frank & Salm, Martin, 2006. "Evidence on preferences and subjective beliefs of risk takers: The case of smokers," International Journal of Industrial Organization, Elsevier, vol. 24(4), pages 667-682, July.
    29. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David B. Huffman & Uwe Sunde, 2017. "Global Evidence on Economic Preferences," NBER Working Papers 23943, National Bureau of Economic Research, Inc.
    30. Catherine C. Eckel & Philip J. Grossman, 2008. "Forecasting Risk Attitudes: An Experimental Study Using Actual and Forecast Gamble Choices," Monash Economics Working Papers archive-01, Monash University, Department of Economics.
    31. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    32. Joseph Eisenhauer & Luigi Ventura, 2006. "The prevalence of hyperbolic discounting: some European evidence," Applied Economics, Taylor & Francis Journals, vol. 38(11), pages 1223-1234.
    33. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    34. Chuang, Yating & Schechter, Laura, 2015. "Stability of experimental and survey measures of risk, time, and social preferences: A review and some new results," Journal of Development Economics, Elsevier, vol. 117(C), pages 151-170.
    35. Supreet Kaur & Michael Kremer & Sendhil Mullainathan, 2015. "Self-Control at Work," Journal of Political Economy, University of Chicago Press, vol. 123(6), pages 1227-1277.
    36. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    37. Tomomi Tanaka & Colin F. Camerer & Quang Nguyen, 2010. "Risk and Time Preferences: Linking Experimental and Household Survey Data from Vietnam," American Economic Review, American Economic Association, vol. 100(1), pages 557-571, March.
    38. Ahn, Taehyun, 2010. "Attitudes toward risk and self-employment of young workers," Labour Economics, Elsevier, vol. 17(2), pages 434-442, April.
    39. Jonathan P. Beauchamp & David Cesarini & Magnus Johannesson, 2017. "The psychometric and empirical properties of measures of risk preferences," Journal of Risk and Uncertainty, Springer, vol. 54(3), pages 203-237, June.
    40. Annamaria Lusardi & Olivia Mitchell, 2007. "Financial Literacy and Retirement Planning: New Evidence from the Rand American Life Panel," Working Papers wp157, University of Michigan, Michigan Retirement Research Center.
    41. Rui Mata & Renato Frey & David Richter & Jürgen Schupp & Ralph Hertwig, 2018. "Risk Preference: A View from Psychology," Journal of Economic Perspectives, American Economic Association, vol. 32(2), pages 155-172, Spring.
    42. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    43. Chetan Dave & Catherine Eckel & Cathleen Johnson & Christian Rojas, 2010. "Eliciting risk preferences: When is simple better?," Journal of Risk and Uncertainty, Springer, vol. 41(3), pages 219-243, December.
    44. Ann-Renée Blais & Elke U. Weber, 2006. "A Domain-Specific Risk-Taking (DOSPERT)Scale for Adult Populations," CIRANO Working Papers 2006s-24, CIRANO.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jammernegg, Werner & Kischka, Peter & Silbermayr, Lena, 2024. "Risk preferences, newsvendor orders and supply chain coordination using the Mean-CVaR model," International Journal of Production Economics, Elsevier, vol. 270(C).
    2. Greiner, Ben & Grünwald, Philipp & Lindner, Thomas & Lintner, Georg & Wiernsperger, Martin, 2024. "Incentives, Framing, and Reliance on Algorithmic Advice: An Experimental Study," Department for Strategy and Innovation Working Paper Series 01/2024, WU Vienna University of Economics and Business.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dániel Horn & Hubert János Kiss, 2020. "Time preferences and their life outcome correlates: Evidence from a representative survey," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-26, July.
    2. Pablo Brañas-Garza & Diego Jorrat & Antonio M. Espín & Angel Sánchez, 2023. "Paid and hypothetical time preferences are the same: lab, field and online evidence," Experimental Economics, Springer;Economic Science Association, vol. 26(2), pages 412-434, April.
    3. Victor Stango & Joanne Yoong & Jonathan Zinman, 2017. "The Quest for Parsimony in Behavioral Economics: New Methods and Evidence on Three Fronts," NBER Working Papers 23057, National Bureau of Economic Research, Inc.
    4. Victor Stango & Joanne Yoong & Jonathan Zinman, 2017. "Quicksand or Bedrock for Behavioral Economics? Assessing Foundational Empirical Questions," NBER Working Papers 23625, National Bureau of Economic Research, Inc.
    5. Holzmeister, Felix & Stefan, Matthias, 2019. "The Risk Elicitation Puzzle Revisited: Across-Methods (In)consistency?," OSF Preprints pj9u2, Center for Open Science.
    6. Kureishi, Wataru & Paule-Paludkiewicz, Hannah & Tsujiyama, Hitoshi & Wakabayashi, Midori, 2021. "Time preferences over the life cycle and household saving puzzles," Journal of Monetary Economics, Elsevier, vol. 124(C), pages 123-139.
    7. Felix Holzmeister & Matthias Stefan, 2019. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Working Papers 2019-19, Faculty of Economics and Statistics, Universität Innsbruck.
    8. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    9. Felix Holzmeister & Matthias Stefan, 2021. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 593-616, June.
    10. Andrej Gill & Florian Hett & Johannes Tischer, 2022. "Time Inconsistency and Overdraft Use: Evidence from Transaction Data and Behavioral Measurement Experiments," Working Papers 2205, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
    11. Kawamura, Tetsuya & Mori, Tomoharu & Motonishi, Taizo & Ogawa, Kazuhito, 2021. "Is Financial Literacy Dangerous? Financial Literacy, Behavioral Factors, and Financial Choices of Households," Journal of the Japanese and International Economies, Elsevier, vol. 60(C).
    12. Preuss, Malte, 2021. "Intra-individual stability of two survey measures on forward-looking attitude," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 201-227.
    13. Gill, Andrej & Hett, Florian & Tischer, Johannes, 2022. "Time inconsistency and overdraft use: Evidence from transaction data and behavioral measurement experiments," SAFE Working Paper Series 347, Leibniz Institute for Financial Research SAFE.
    14. Thomas Meissner & Xavier Gassmann & Corinne Faure & Joachim Schleich, 2023. "Individual characteristics associated with risk and time preferences: A multi country representative survey," Journal of Risk and Uncertainty, Springer, vol. 66(1), pages 77-107, February.
    15. Kureishi, Wataru & Paule-Paludkiewicz, Hannah & Tsujiyama, Hitoshi & Wakabayashi, Midori, 2020. "Time preferences over the life cycle," SAFE Working Paper Series 267, Leibniz Institute for Financial Research SAFE, revised 2020.
    16. Jonathan Chapman & Erik Snowberg & Stephanie Wang & Colin Camerer, 2018. "Loss Attitudes in the U.S. Population: Evidence from Dynamically Optimized Sequential Experimentation (DOSE)," NBER Working Papers 25072, National Bureau of Economic Research, Inc.
    17. Lena Detlefsen & Andreas Friedl & Katharina Lima Miranda & Ulrich Schmidt & Matthias Sutter, 2024. "Are economic preferences shaped by the family context? The relation of birth order and siblings’ gender composition to economic preferences," Journal of Risk and Uncertainty, Springer, vol. 69(1), pages 1-31, August.
    18. David Bradford & Charles Courtemanche & Garth Heutel & Patrick McAlvanah & Christopher Ruhm, 2017. "Time preferences and consumer behavior," Journal of Risk and Uncertainty, Springer, vol. 55(2), pages 119-145, December.
    19. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    20. Zexuan Wang & Ismaël Rafaï & Marc Willinger, 2023. "Does age affect the relation between risk and time preferences? Evidence from a representative sample," Southern Economic Journal, John Wiley & Sons, vol. 90(2), pages 341-368, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:2:p:1149-1173. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.