IDEAS home Printed from https://ideas.repec.org/a/kap/expeco/v27y2024i3d10.1007_s10683-024-09837-x.html
   My bibliography  Save this article

Measuring decision confidence

Author

Listed:
  • Sara Arts

    (Radboud University)

  • Qiyan Ong

    (Radboud University)

  • Jianying Qiu

    (Radboud University)

Abstract

We examine whether the way individuals randomize between options captures their decision confidence. In two experiments in which subjects faced pairs of options (a lottery and a varying sure payment), we allowed subjects to choose randomization probabilities according to which they would receive each option. Separately, we obtained two measures of self-reported confidence - confidence statements and probabilistic confidence - for choosing between the two options. Consistent with the predictions of two theoretical frameworks incorporating preference uncertainty, the randomization probabilities correlated strongly with both self-reported measures (median Spearman correlations between 0.86 to 0.89) and corresponded in absolute levels to probabilistic confidence. This relationship is robust to two exogenous manipulations of decision confidence, where we varied the complexity of the lottery and subjects’ experience with the lottery.

Suggested Citation

  • Sara Arts & Qiyan Ong & Jianying Qiu, 2024. "Measuring decision confidence," Experimental Economics, Springer;Economic Science Association, vol. 27(3), pages 582-603, July.
    • Handle: RePEc:kap:expeco:v:27:y:2024:i:3:d:10.1007_s10683-024-09837-x
    DOI: 10.1007/s10683-024-09837-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10683-024-09837-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10683-024-09837-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Benjamin Enke & Thomas W. Graeber, 2021. "Cognitive Uncertainty in Intertemporal Choice," CESifo Working Paper Series 9472, CESifo.
    2. Simone Cerreia‐Vioglio & David Dillenberger & Pietro Ortoleva, 2015. "Cautious Expected Utility and the Certainty Effect," Econometrica, Econometric Society, vol. 83, pages 693-728, March.
    3. Jose Apesteguia & Miguel A. Ballester, 2018. "Monotone Stochastic Choice Models: The Case of Risk and Time Preferences," Journal of Political Economy, University of Chicago Press, vol. 126(1), pages 74-106.
    4. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    5. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    6. Myagkov, Mikhail & Plott, Charles R, 1997. "Exchange Economies and Loss Exposure: Experiments Exploring Prospect Theory and Competitive Equilibria in Market Environments," American Economic Review, American Economic Association, vol. 87(5), pages 801-828, December.
    7. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    8. Jehoshua Eliashberg & John R. Hauser, 1985. "A Measurement Error Approach for Modeling Consumer Risk Preference," Management Science, INFORMS, vol. 31(1), pages 1-25, January.
    9. Dubourg & Jones‐Lee & Graham Loomes, 1997. "Imprecise Preferences and Survey Design in Contingent Valuation," Economica, London School of Economics and Political Science, vol. 64(256), pages 681-702, November.
    10. Quiggin, John, 1982. "A theory of anticipated utility," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 323-343, December.
    11. Arts, Sara & Ong, Qiyan & Qiu, Jianying, 2020. "Measuring subjective decision confidence," MPRA Paper 117907, University Library of Munich, Germany.
    12. Robin Cubitt & Orestis Kopsacheilis & Chris Starmer, 2022. "An inquiry into the nature and causes of the Description - Experience gap," Journal of Risk and Uncertainty, Springer, vol. 65(2), pages 105-137, October.
    13. Robin Cubitt & Daniel Navarro-Martinez & Chris Starmer, 2015. "On preference imprecision," Journal of Risk and Uncertainty, Springer, vol. 50(1), pages 1-34, February.
    14. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    15. Drew Fudenberg & Ryota Iijima & Tomasz Strzalecki, 2015. "Stochastic Choice and Revealed Perturbed Utility," Econometrica, Econometric Society, vol. 83, pages 2371-2409, November.
    16. Yoram Halevy, 2007. "Ellsberg Revisited: An Experimental Study," Econometrica, Econometric Society, vol. 75(2), pages 503-536, March.
    17. Peter Klibanoff & Massimo Marinacci & Sujoy Mukerji, 2005. "A Smooth Model of Decision Making under Ambiguity," Econometrica, Econometric Society, vol. 73(6), pages 1849-1892, November.
    18. Ilke Aydogan & Yu Gao, 2020. "Experience and rationality under risk: re-examining the impact of sampling experience," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1100-1128, December.
    19. Marina Agranov & Pietro Ortoleva, 2017. "Stochastic Choice and Preferences for Randomization," Journal of Political Economy, University of Chicago Press, vol. 125(1), pages 40-68.
    20. Machina, Mark J, 1985. "Stochastic Choice Functions Generated from Deterministic Preferences over Lotteries," Economic Journal, Royal Economic Society, vol. 95(379), pages 575-594, September.
    21. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    22. Simone Cerreia-Vioglio & David Dillenberger & Pietro Ortoleva & Gil Riella, 2019. "Deliberately Stochastic," American Economic Review, American Economic Association, vol. 109(7), pages 2425-2445, July.
      • Simone Cerreia-Vioglio & David Dillenberger & Pietro Ortoleva & Gil Riella, 2012. "Deliberately Stochastic," PIER Working Paper Archive 17-013, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 25 May 2017.
    23. David J. Butler & Graham C. Loomes, 2007. "Imprecision as an Account of the Preference Reversal Phenomenon," American Economic Review, American Economic Association, vol. 97(1), pages 277-297, March.
    24. Arts, Sara & Ong, Qiyan & Qiu, Jianying, 2020. "Measuring subjective decision confidence," MPRA Paper 106811, University Library of Munich, Germany.
    25. Robin Cubitt & Gijs van de Kuilen & Sujoy Mukerji, 2020. "Discriminating Between Models of Ambiguity Attitude: a Qualitative Test," Journal of the European Economic Association, European Economic Association, vol. 18(2), pages 708-749.
    26. Graham Loomes & Ganna Pogrebna, 2017. "Do Preference Reversals Disappear When We Allow for Probabilistic Choice?," Management Science, INFORMS, vol. 63(1), pages 166-184, January.
    27. Butler, David & Loomes, Graham, 2011. "Imprecision as an account of violations of independence and betweenness," Journal of Economic Behavior & Organization, Elsevier, vol. 80(3), pages 511-522.
    28. Chew, Soo Hong, 1983. "A Generalization of the Quasilinear Mean with Applications to the Measurement of Income Inequality and Decision Theory Resolving the Allais Paradox," Econometrica, Econometric Society, vol. 51(4), pages 1065-1092, July.
    29. Rubinstein, Ariel, 2002. "Irrational diversification in multiple decision problems," European Economic Review, Elsevier, vol. 46(8), pages 1369-1378, September.
    30. Charles R. Plott & Kathryn Zeiler, 2005. "The Willingness to Pay–Willingness to Accept Gap, the "Endowment Effect," Subject Misconceptions, and Experimental Procedures for Eliciting Valuations," American Economic Review, American Economic Association, vol. 95(3), pages 530-545, June.
    31. Qiyan Ong & Jianying Qiu, 2023. "Paying for randomization and indecisiveness," Journal of Risk and Uncertainty, Springer, vol. 67(1), pages 45-72, August.
    32. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    33. Faruk Gul & Wolfgang Pesendorfer, 2006. "Random Expected Utility," Econometrica, Econometric Society, vol. 74(1), pages 121-146, January.
    34. Frederick Mosteller & Philip Nogee, 1951. "An Experimental Measurement of Utility," Journal of Political Economy, University of Chicago Press, vol. 59(5), pages 371-371.
    35. Gijs Kuilen, 2009. "Subjective Probability Weighting and the Discovered Preference Hypothesis," Theory and Decision, Springer, vol. 67(1), pages 1-22, July.
    36. Benjamin Enke & Thomas Graeber, 2021. "Cognitive Uncertainty in Intertemporal Choice," NBER Working Papers 29577, National Bureau of Economic Research, Inc.
    37. Bin Miao & Songfa Zhong, 2018. "Probabilistic social preference: how Machina’s Mom randomizes her choice," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 65(1), pages 1-24, January.
    38. Gijs Kuilen & Peter Wakker, 2006. "Learning in the Allais paradox," Journal of Risk and Uncertainty, Springer, vol. 33(3), pages 155-164, December.
    39. Dubourg, W R & Jones-Lee, M W & Loomes, Graham, 1994. "Imprecise Preferences and the WTP-WTA Disparity," Journal of Risk and Uncertainty, Springer, vol. 9(2), pages 115-133, October.
    40. Mel Win Khaw & Ziang Li & Michael Woodford, 2021. "Cognitive Imprecision and Small-Stakes Risk Aversion [Linear Mapping of Numbers onto Space Requires Attention]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(4), pages 1979-2013.
    41. Dekel, Eddie, 1986. "An axiomatic characterization of preferences under uncertainty: Weakening the independence axiom," Journal of Economic Theory, Elsevier, vol. 40(2), pages 304-318, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Duffy, Sean & Smith, John, 2024. "The random thickness of indifference," MPRA Paper 122165, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu Shi & Jianying Qiu & Jiangyan Li & Frank Bohn, 2024. "Consciously stochastic in preference reversals," Journal of Risk and Uncertainty, Springer, vol. 68(3), pages 255-297, June.
    2. Chew, Soo Hong & Miao, Bin & Shen, Qiang & Zhong, Songfa, 2022. "Multiple-switching behavior in choice-list elicitation of risk preference," Journal of Economic Theory, Elsevier, vol. 204(C).
    3. Qiyan Ong & Jianying Qiu, 2023. "Paying for randomization and indecisiveness," Journal of Risk and Uncertainty, Springer, vol. 67(1), pages 45-72, August.
    4. Arts, Sara & Ong, Qiyan & Qiu, Jianying, 2020. "Measuring subjective decision confidence," MPRA Paper 117907, University Library of Munich, Germany.
    5. Arts, Sara & Ong, Qiyan & Qiu, Jianying, 2020. "Measuring subjective decision confidence," MPRA Paper 106811, University Library of Munich, Germany.
    6. Duffy, Sean & Gussman, Steven & Smith, John, 2021. "Visual judgments of length in the economics laboratory: Are there brains in stochastic choice?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 93(C).
    7. Heydari, Pedram, 2024. "Regret, responsibility, and randomization: A theory of stochastic choice," Journal of Economic Theory, Elsevier, vol. 217(C).
    8. Guo, Liang, 2021. "Contextual deliberation and the choice-valuation preference reversal," Journal of Economic Theory, Elsevier, vol. 195(C).
    9. Qiu, Jianying, 2015. "Completing incomplete preferences," MPRA Paper 91692, University Library of Munich, Germany, revised 18 Jul 2016.
    10. Marina Agranov & Pietro Ortoleva, 2021. "Ranges of Randomization," Working Papers 2021-72, Princeton University. Economics Department..
    11. Dean, Mark & Ortoleva, Pietro, 2017. "Allais, Ellsberg, and preferences for hedging," Theoretical Economics, Econometric Society, vol. 12(1), January.
    12. Duffy, Sean & Smith, John, 2020. "An economist and a psychologist form a line: What can imperfect perception of length tell us about stochastic choice?," MPRA Paper 99417, University Library of Munich, Germany.
    13. Wei Ma, 2023. "Random dual expected utility," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 75(2), pages 293-315, February.
    14. Nathaniel T. Wilcox, 2017. "Random expected utility and certainty equivalents: mimicry of probability weighting functions," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(2), pages 161-173, December.
    15. Oben K. Bayrak & John D. Hey, 2020. "Decisions under risk: Dispersion and skewness," Journal of Risk and Uncertainty, Springer, vol. 61(1), pages 1-24, August.
    16. Yoram Halevy & David Walker-Jones & Lanny Zrill, 2023. "Difficult Decisions," Working Papers tecipa-753, University of Toronto, Department of Economics.
    17. Carlos Alós-Ferrer & Johannes Buckenmaier & Michele Garagnani, 2020. "Stochastic choice and preference reversals," ECON - Working Papers 370, Department of Economics - University of Zurich, revised Jul 2021.
    18. Qiu, Jianying, 2015. "Completing incomplete preferences," MPRA Paper 72933, University Library of Munich, Germany, revised 18 Jul 2016.
    19. Cettolin, Elena & Riedl, Arno, 2019. "Revealed preferences under uncertainty: Incomplete preferences and preferences for randomization," Journal of Economic Theory, Elsevier, vol. 181(C), pages 547-585.
    20. Oben K Bayrak & Bengt Kriström, 2016. "Is there a valuation gap? The case of interval valuations," Economics Bulletin, AccessEcon, vol. 36(1), pages 218-236.

    More about this item

    Keywords

    Decision confidence; Randomization; Incentivized approach; Preference uncertainty;
    All these keywords.

    JEL classification:

    • B40 - Schools of Economic Thought and Methodology - - Economic Methodology - - - General
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:expeco:v:27:y:2024:i:3:d:10.1007_s10683-024-09837-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.