IDEAS home Printed from https://ideas.repec.org/a/inm/ordeca/v6y2009i1p38-46.html
   My bibliography  Save this article

Combining the Opinions of Experts Who Partition Events Differently

Author

Listed:
  • Robert F. Bordley

    (General Motors Research Laboratories and University of Michigan, Ann Arbor, Michigan 48109)

Abstract

This paper focuses on updating a client's beliefs about an event based on information about the different probabilities that various experts assess for that event. A substantial literature solves this problem when all experts assess their probabilities over the same partitioning of the possible outcomes of an event. But different experts often think about the same problem in quite different ways. This can lead to differences in how experts prefer to partition the possible outcomes of an event. Forcing the experts to use a common partition could lead to less informative probability assessments. Thus, this paper presents a new approach for combining probability assessments from different experts, which allows experts to assess their probability assessments across different partitionings.

Suggested Citation

  • Robert F. Bordley, 2009. "Combining the Opinions of Experts Who Partition Events Differently," Decision Analysis, INFORMS, vol. 6(1), pages 38-46, March.
    • Handle: RePEc:inm:ordeca:v:6:y:2009:i:1:p:38-46
    DOI: 10.1287/deca.1080.0127
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/deca.1080.0127
    Download Restriction: no
    File URL: https://libkey.io/10.1287/deca.1080.0127?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Craig R. Fox & Robert T. Clemen, 2005. "Subjective Probability Assessment in Decision Analysis: Partition Dependence and Bias Toward the Ignorance Prior," Management Science, INFORMS, vol. 51(9), pages 1417-1432, September.
    2. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    3. Johnson, Eric J & Hershey, John & Meszaros, Jacqueline & Kunreuther, Howard, 1993. "Framing, Probability Distortions, and Insurance Decisions," Journal of Risk and Uncertainty, Springer, vol. 7(1), pages 35-51, August.
    4. Joel B. Predd & Daniel N. Osherson & Sanjeev R. Kulkarni & H. Vincent Poor, 2008. "Aggregating Probabilistic Forecasts from Incoherent and Abstaining Experts," Decision Analysis, INFORMS, vol. 5(4), pages 177-189, December.
    5. Sandra Hoffmann & Paul Fischbeck & Alan Krupnick & Michael McWilliams, 2007. "Elicitation from Large, Heterogeneous Expert Panels: Using Multiple Uncertainty Measures to Characterize Information Quality for Decision Analysis," Decision Analysis, INFORMS, vol. 4(2), pages 91-109, June.
    6. Robert T. Clemen, 1987. "Combining Overlapping Information," Management Science, INFORMS, vol. 33(3), pages 373-380, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. L. Robin Keller, 2009. "From the Editor..," Decision Analysis, INFORMS, vol. 6(1), pages 1-3, March.
    2. L. Robin Keller & Kelly M. Kophazi, 2012. "From the Editors ---Copulas, Group Preferences, Multilevel Defenders, Sharing Rewards, and Communicating Analytics," Decision Analysis, INFORMS, vol. 9(3), pages 213-218, September.
    3. L. Robin Keller & Kelly M. Kophazi, 2011. "From the Editors---Deterrence, Multiattribute Utility, and Probability and Bayes' Updating," Decision Analysis, INFORMS, vol. 8(2), pages 83-87, June.
    4. Jason R. W. Merrick & Fabrizio Ruggeri & Refik Soyer & L. Robin Keller, 2012. "From the Editors---Games and Decisions in Reliability and Risk," Decision Analysis, INFORMS, vol. 9(2), pages 81-85, June.
    5. Erin Baker & Olaitan Olaleye, 2013. "Combining Experts: Decomposition and Aggregation Order," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1116-1127, June.
    6. L. Robin Keller & Ali Abbas & J. Eric Bickel & Vicki M. Bier & David V. Budescu & John C. Butler & Enrico Diecidue & Robin L. Dillon-Merrill & Raimo P. Hämäläinen & Kenneth C. Lichtendahl & Jason R. W, 2012. "From the Editors ---Brainstorming, Multiplicative Utilities, Partial Information on Probabilities or Outcomes, and Regulatory Focus," Decision Analysis, INFORMS, vol. 9(4), pages 297-302, December.
    7. Yucheng Dong & Yao Li & Ying He & Xia Chen, 2021. "Preference–Approval Structures in Group Decision Making: Axiomatic Distance and Aggregation," Decision Analysis, INFORMS, vol. 18(4), pages 273-295, December.
    8. L. Robin Keller, 2011. "From the Editor ---Multiattribute and Intertemporal Preferences, Probability, and Stochastic Processes: Models and Assessment," Decision Analysis, INFORMS, vol. 8(3), pages 165-169, September.
    9. Robert F. Bordley, 2011. "Using Bayes' Rule to Update an Event's Probabilities Based on the Outcomes of Partially Similar Events," Decision Analysis, INFORMS, vol. 8(2), pages 117-127, June.
    10. Robert F. Bordley & Elena Katok & L. Robin Keller, 2010. "Honoring Michael H. Rothkopf's Legacy of Rigor and Relevance in Auction Theory: From the Editors," Decision Analysis, INFORMS, vol. 7(1), pages 1-4, March.
    11. Rakesh K. Sarin & L. Robin Keller, 2013. "From the Editors: Probability Approximations, Anti-Terrorism Strategy, and Bull's-Eye Display for Performance Feedback," Decision Analysis, INFORMS, vol. 10(1), pages 1-5, March.
    12. Rakesh K. Sarin & L. Robin Keller, 2013. "From the Editors ---Group Decisions, Preference Elicitation, Experienced Utility, Survival Probabilities, and Portfolio Value of Information," Decision Analysis, INFORMS, vol. 10(2), pages 99-102, June.
    13. Ralph L. Keeney, 2013. "Foundations for Group Decision Analysis," Decision Analysis, INFORMS, vol. 10(2), pages 103-120, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:cup:judgdm:v:13:y:2018:i:6:p:607-621 is not listed on IDEAS
    2. Jason R. W. Merrick, 2008. "Getting the Right Mix of Experts," Decision Analysis, INFORMS, vol. 5(1), pages 43-52, March.
    3. Erin Baker & Olaitan Olaleye, 2013. "Combining Experts: Decomposition and Aggregation Order," Risk Analysis, John Wiley & Sons, vol. 33(6), pages 1116-1127, June.
    4. David J. Johnstone, 2007. "The Parimutuel Kelly Probability Scoring Rule," Decision Analysis, INFORMS, vol. 4(2), pages 66-75, June.
    5. Botzen, W.J.W. & van den Bergh, J.C.J.M., 2012. "Risk attitudes to low-probability climate change risks: WTP for flood insurance," Journal of Economic Behavior & Organization, Elsevier, vol. 82(1), pages 151-166.
    6. Guanchun Wang & Sanjeev R. Kulkarni & H. Vincent Poor & Daniel N. Osherson, 2011. "Aggregating Large Sets of Probabilistic Forecasts by Weighted Coherent Adjustment," Decision Analysis, INFORMS, vol. 8(2), pages 128-144, June.
    7. Jason R. W. Merrick & J. Rene van Dorp & Amita Singh, 2005. "Analysis of Correlated Expert Judgments from Extended Pairwise Comparisons," Decision Analysis, INFORMS, vol. 2(1), pages 17-29, March.
    8. Eric Johnson & Suzanne Shu & Benedict Dellaert & Craig Fox & Daniel Goldstein & Gerald Häubl & Richard Larrick & John Payne & Ellen Peters & David Schkade & Brian Wansink & Elke Weber, 2012. "Beyond nudges: Tools of a choice architecture," Marketing Letters, Springer, vol. 23(2), pages 487-504, June.
    9. Yuyu Fan & David V. Budescu & David Mandel & Mark Himmelstein, 2019. "Improving Accuracy by Coherence Weighting of Direct and Ratio Probability Judgments," Decision Analysis, INFORMS, vol. 16(3), pages 197-217, September.
    10. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    11. L. Robin Keller, 2009. "From the Editor..," Decision Analysis, INFORMS, vol. 6(1), pages 1-3, March.
    12. Christopher W. Karvetski & David R. Mandel & Daniel Irwin, 2020. "Improving Probability Judgment in Intelligence Analysis: From Structured Analysis to Statistical Aggregation," Risk Analysis, John Wiley & Sons, vol. 40(5), pages 1040-1057, May.
    13. Christopher W. Karvetski & Kenneth C. Olson & David R. Mandel & Charles R. Twardy, 2013. "Probabilistic Coherence Weighting for Optimizing Expert Forecasts," Decision Analysis, INFORMS, vol. 10(4), pages 305-326, December.
    14. David R. Mandel & Christopher W. Karvetski & Mandeep K. Dhami, 2018. "Boosting intelligence analysts’ judgment accuracy: What works, what fails?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 13(6), pages 607-621, November.
    15. Avner Engel & Shalom Shachar, 2006. "Measuring and optimizing systems' quality costs and project duration," Systems Engineering, John Wiley & Sons, vol. 9(3), pages 259-280, September.
    16. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    17. Jidong Zhou, 2011. "Reference Dependence and Market Competition," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 20(4), pages 1073-1097, December.
    18. Charles Changchuan Jiang & Liana Fraenkel, 2017. "The Influence of Varying Cost Formats on Preferences," Medical Decision Making, , vol. 37(1), pages 17-26, January.
    19. Ellison, Martin & Macaulay, Alistair, 2021. "A rational inattention unemployment trap," Journal of Economic Dynamics and Control, Elsevier, vol. 131(C).
    20. Franz Dietrich & Christian List, 2017. "Probabilistic opinion pooling generalized. Part one: general agendas," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 48(4), pages 747-786, April.
    21. Robert Bordley & Joseph Kadane, 1999. "Experiment-dependent priors in psychology and physics," Theory and Decision, Springer, vol. 47(3), pages 213-227, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ordeca:v:6:y:2009:i:1:p:38-46. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.