IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v44y2015i4p636-676.html
   My bibliography  Save this article

On the Measurement and Properties of Ambiguity in Probabilistic Expectations

Author

Listed:
  • Justin T. Pickett
  • Thomas A. Loughran
  • Shawn Bushway

Abstract

Survey respondents’ probabilistic expectations are now widely used in many fields to study risk perceptions, decision-making processes, and behavior. Researchers have developed several methods to account for the fact that the probability of an event may be more ambiguous for some respondents than others, but few prior studies have empirically compared the approaches. This article contrasts two of the most prominent methods using data from an experiment embedded in a recent Web survey of 926 volunteer panelists. Specifically, we comparatively evaluate the descriptive and relational properties of ambiguity scores obtained by placing follow-up questions after items eliciting expectations that ask either for (1) a range of probabilities that the respondent is confident to contain the true probability or for (2) a verbal response indicating assuredness. Our results show that these two methods produce measures that have more similarities than differences. Both methods yield ambiguity scores that (1) are not strongly associated with exposure to sources of relevant information, (2) are correlated across seemingly unrelated events, and (3) are consistently related to the level of reported risk.

Suggested Citation

  • Justin T. Pickett & Thomas A. Loughran & Shawn Bushway, 2015. "On the Measurement and Properties of Ambiguity in Probabilistic Expectations," Sociological Methods & Research, , vol. 44(4), pages 636-676, November.
    • Handle: RePEc:sae:somere:v:44:y:2015:i:4:p:636-676
    DOI: 10.1177/0049124114546902
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124114546902
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0049124114546902?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ansolabehere, Stephen & Schaffner, Brian F., 2014. "Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison," Political Analysis, Cambridge University Press, vol. 22(3), pages 285-303, July.
    2. van Santen, Peter & Alessie, Rob & Kalwij, Adriaan, 2012. "Probabilistic survey questions and incorrect answers: Retirement income replacement rates," Journal of Economic Behavior & Organization, Elsevier, vol. 82(1), pages 267-280.
    3. Fabian Gouret & Guillaume Hollard, 2011. "When Kahneman meets Manski: Using dual systems of reasoning to interpret subjective expectations of equity returns," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(3), pages 371-392, April.
    4. Péter Hudomiet & Robert J. Willis, 2013. "Estimating Second Order Probability Beliefs from Subjective Survival Data," Decision Analysis, INFORMS, vol. 10(2), pages 152-170, June.
    5. Wändi Bruine de Bruin & Katherine G. Carman, 2012. "Measuring Risk Perceptions," Medical Decision Making, , vol. 32(2), pages 232-236, March.
    6. Wändi Bruine de Bruin & Julie S. Downs & Pamela Murray & Baruch Fischhoff, 2010. "Can Female Adolescents Tell Whether They Will Test Positive for Chlamydia Infection?," Medical Decision Making, , vol. 30(2), pages 189-193, March.
    7. Gábor Kézdi & Robert J. Willis, 2003. "Who Becomes a Stockholder? Expectations, SUbjective Uncertainty, and Asset Allocation," Working Papers wp039, University of Michigan, Michigan Retirement Research Center.
    8. Adeline Delavande & Susann Rohwedder, 2011. "Differential Survival in Europe and the United States: Estimates Based on Subjective Probabilities of Survival," Demography, Springer;Population Association of America (PAA), vol. 48(4), pages 1377-1400, November.
    9. Berinsky, Adam J. & Huber, Gregory A. & Lenz, Gabriel S., 2012. "Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk," Political Analysis, Cambridge University Press, vol. 20(3), pages 351-368, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Teresa Bago d'Uva & Esen Erdogan Ciftci & Owen O'Donnell & Eddy van Doorslaer, 2015. "Who can predict their Own Demise? Accuracy of Longevity Expectations by Education and Cognition," Tinbergen Institute Discussion Papers 15-052/V, Tinbergen Institute.
    2. Bago d'Uva, Teresa & O'Donnell, Owen & van Doorslaer, Eddy, 2020. "Who can predict their own demise? Heterogeneity in the accuracy and value of longevity expectations☆," The Journal of the Economics of Ageing, Elsevier, vol. 17(C).
    3. Binder, Carola C., 2017. "Measuring uncertainty based on rounding: New method and application to inflation expectations," Journal of Monetary Economics, Elsevier, vol. 90(C), pages 1-12.
    4. Vesile Kutlu-Koc & Adriaan Kalwij, 2017. "Individual Survival Expectations and Actual Mortality: Evidence from Dutch Survey and Administrative Data," European Journal of Population, Springer;European Association for Population Studies, vol. 33(4), pages 509-532, October.
    5. Fabian Gouret, 2017. "What can we learn from the fifties?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(7), pages 756-775, November.
    6. Hudomiet, Péter & Hurd, Michael D. & Rohwedder, Susann, 2021. "Forecasting mortality inequalities in the U.S. based on trends in midlife health," Journal of Health Economics, Elsevier, vol. 80(C).
    7. Diaz-Serrano, Luis & Nilsson, William, 2022. "The reliability of students’ earnings expectations," Labour Economics, Elsevier, vol. 76(C).
    8. Leonardo Becchetti & Fabio Pisani & Berkan Acar, 2023. "Eudaimonic wellbeing and life expectancy," Kyklos, Wiley Blackwell, vol. 76(2), pages 179-195, May.
    9. Post, Thomas & Hanewald, Katja, 2013. "Longevity risk, subjective survival expectations, and individual saving behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 200-220.
    10. Wändi Bruine de Bruin & Katherine G. Carman, 2018. "Measuring Subjective Probabilities: The Effect of Response Mode on the Use of Focal Responses, Validity, and Respondents’ Evaluations," Risk Analysis, John Wiley & Sons, vol. 38(10), pages 2128-2143, October.
    11. Binswanger, Johannes & Salm, Martin, 2013. "Does Everyone Use Probabilities? Intuitive and Rational Decisions about Stockholding," IZA Discussion Papers 7265, Institute of Labor Economics (IZA).
    12. Radford, Jason & Green, Jon & Quintana, Alexi & Safarpour, Alauna & Simonson, Matthew D & Baum, Matthew & Lazer, David & Ognyanova, Katherine & Druckman, James & Perlis, Roy, 2022. "Evaluating the generalizability of the COVID States survey — a large-scale, non-probability survey," OSF Preprints cwkg7, Center for Open Science.
    13. Joachim Winter & Amelie Wuppermann, 2014. "Do They Know What Is At Risk? Health Risk Perception Among The Obese," Health Economics, John Wiley & Sons, Ltd., vol. 23(5), pages 564-585, May.
    14. Drerup, Tilman & Enke, Benjamin & von Gaudecker, Hans-Martin, 2017. "The precision of subjective data and the explanatory power of economic models," Journal of Econometrics, Elsevier, vol. 200(2), pages 378-389.
    15. Péter Hudomiet & Michael D. Hurd & Susann Rohwedder, 2019. "Trends in Health and Mortality Inequalities in the United States," Working Papers wp401, University of Michigan, Michigan Retirement Research Center.
    16. Péter Hudomiet & Michael D. Hurd & Susann Rohwedder, 2020. "The Impact of Growing Health and Mortality Inequalities on Lifetime Social Security Payouts," Working Papers wp412, University of Michigan, Michigan Retirement Research Center.
    17. Lisa Maria Dellmuth & Jonas Tallberg, 2020. "Why national and international legitimacy beliefs are linked: Social trust as an antecedent factor," The Review of International Organizations, Springer, vol. 15(2), pages 311-337, April.
    18. Linden, Mikael & Väänänen, Niko, 2023. "Mean survival times and retirement ages," MPRA Paper 119344, University Library of Munich, Germany.
    19. Frank Sloan & Lindsey Eldred & Tong Guo & Yanzhi Xu, 2013. "Are people overoptimistic about the effects of heavy drinking?," Journal of Risk and Uncertainty, Springer, vol. 47(1), pages 93-127, August.
    20. Robbett, Andrea & Matthews, Peter Hans, 2018. "Partisan bias and expressive voting," Journal of Public Economics, Elsevier, vol. 157(C), pages 107-120.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:44:y:2015:i:4:p:636-676. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.