IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v12y1992i1p83-93.html
   My bibliography  Save this article

Expert Judgment in Risk Analysis and Management: Process, Context, and Pitfalls

Author

Listed:
  • Harry Otway
  • Detlof von Winterfeldt

Abstract

The regulation and management of hazardous industrial activities increasingly rely on formal expert judgment processes to provide wisdom in areas of science and technology where traditional “good science” is, in practice, unable to supply unambiguous “facts.” Expert judgment has always played a significant, if often unrecognized, role in analysis; however, recent trends are to make it formal, explicit, and documented so it can be identified and reviewed by others. We propose four categories of expert judgment and present three case studies which illustrate some of the pitfalls commonly encountered in its use. We conclude that there will be an expanding policy role for formal expert judgment and that the openness, transparency, and documentation that it requires have implications for enhanced public involvement in scientific and technical affairs.

Suggested Citation

  • Harry Otway & Detlof von Winterfeldt, 1992. "Expert Judgment in Risk Analysis and Management: Process, Context, and Pitfalls," Risk Analysis, John Wiley & Sons, vol. 12(1), pages 83-93, March.
    • Handle: RePEc:wly:riskan:v:12:y:1992:i:1:p:83-93
    DOI: 10.1111/j.1539-6924.1992.tb01310.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1539-6924.1992.tb01310.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1539-6924.1992.tb01310.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Miley W. Merkhofer & Ralph L. Keeney, 1987. "A Multiattribute Utility Analysis of Alternative Sites for the Disposal of Nuclear Waste," Risk Analysis, John Wiley & Sons, vol. 7(2), pages 173-194, June.
    2. Martin Weber & Franz Eisenführ & Detlof von Winterfeldt, 1988. "The Effects of Splitting Attributes on Weights in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 34(4), pages 431-445, April.
    3. Harry Otway & Aniello Amendola, 1989. "Major Hazard Information Policy in the European Community: Implications for Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 9(4), pages 505-512, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Prager, Fynnwin & Rhoads, Mohja & Martínez, Jose N., 2022. "The COVID-19 economic shutdown and the future of flexible workplace practices in the South Bay region of Los Angeles County," Transport Policy, Elsevier, vol. 125(C), pages 241-255.
    2. Henrik Hassel & Alexander Cedergren, 2019. "Exploring the Conceptual Foundation of Continuity Management in the Context of Societal Safety," Risk Analysis, John Wiley & Sons, vol. 39(7), pages 1503-1519, July.
    3. Roland W. Scholz & Ralf Hansmann, 2007. "Combining Experts' Risk Judgments on Technology Performance of Phytoremediation: Self‐Confidence Ratings, Averaging Procedures, and Formative Consensus Building," Risk Analysis, John Wiley & Sons, vol. 27(1), pages 225-240, February.
    4. Damian Morgan & Joan Ozanne-Smith, 2019. "A configural model of expert judgement as a preliminary epidemiological study of injury problems: An application to drowning," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-17, October.
    5. Mario P. Brito & Ian G. J. Dawson, 2020. "Predicting the Validity of Expert Judgments in Assessing the Impact of Risk Mitigation Through Failure Prevention and Correction," Risk Analysis, John Wiley & Sons, vol. 40(10), pages 1928-1943, October.
    6. Gregory F. Nemet & Laura Diaz Anadon & Elena Verdolini, 2017. "Quantifying the Effects of Expert Selection and Elicitation Design on Experts’ Confidence in Their Judgments About Future Energy Technologies," Risk Analysis, John Wiley & Sons, vol. 37(2), pages 315-330, February.
    7. Hoffmann, Sandra & Fischbeck, Paul & Krupnick, Alan & McWilliams, Michael, 2008. "Informing risk-mitigation priorities using uncertainty measures derived from heterogeneous expert panels: A demonstration using foodborne pathogens," Reliability Engineering and System Safety, Elsevier, vol. 93(5), pages 687-698.
    8. Radboud J. Duintjer Tebbens & Mark A. Pallansch & Konstantin M. Chumakov & Neal A. Halsey & Tapani Hovi & Philip D. Minor & John F. Modlin & Peter A. Patriarca & Roland W. Sutter & Peter F. Wright & S, 2013. "Review and Assessment of Poliovirus Immunity and Transmission: Synthesis of Knowledge Gaps and Identification of Research Needs," Risk Analysis, John Wiley & Sons, vol. 33(4), pages 606-646, April.
    9. Julia Reis & Julie Shortridge, 2020. "Impact of Uncertainty Parameter Distribution on Robust Decision Making Outcomes for Climate Change Adaptation under Deep Uncertainty," Risk Analysis, John Wiley & Sons, vol. 40(3), pages 494-511, March.
    10. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    11. Mario Paulo Brito & Gwyn Griffiths & Peter Challenor, 2010. "Risk Analysis for Autonomous Underwater Vehicle Operations in Extreme Environments," Risk Analysis, John Wiley & Sons, vol. 30(12), pages 1771-1788, December.
    12. A. Procter & T. McDaniels & R. Vignola, 2017. "Using expert judgments to inform economic evaluation of ecosystem-based adaptation decisions: watershed management for enhancing water supply for Tegucigalpa, Honduras," Environment Systems and Decisions, Springer, vol. 37(4), pages 410-422, December.
    13. Roland W. Scholz & Yann B. Blumer & Fridolin S. Brand, 2012. "Risk, vulnerability, robustness, and resilience from a decision-theoretic perspective," Journal of Risk Research, Taylor & Francis Journals, vol. 15(3), pages 313-330, March.
    14. George M. Gray & Jon C. Allen & David E. Burmaster & Stuart H. Gage & James K. Hammitt & Stanley Kaplan & Ralph L. Keeney & Joseph G. Morse & D. Warner North & Jan P. Nyrop & Alina Stahevitch & Richar, 1998. "Principles for Conduct of Pest Risk Analyses: Report of an Expert Work hop," Risk Analysis, John Wiley & Sons, vol. 18(6), pages 773-780, December.
    15. Brito, Mario & Griffiths, Gwyn, 2016. "A Bayesian approach for predicting risk of autonomous underwater vehicle loss during their missions," Reliability Engineering and System Safety, Elsevier, vol. 146(C), pages 55-67.
    16. Luca Podofillini & Vinh Dang & Enrico Zio & Piero Baraldi & Massimo Librizzi, 2010. "Using Expert Models in Human Reliability Analysis—A Dependence Assessment Method Based on Fuzzy Logic," Risk Analysis, John Wiley & Sons, vol. 30(8), pages 1277-1297, August.
    17. Gillenwater, Michael, 2013. "Probabilistic decision model of wind power investment and influence of green power market," Energy Policy, Elsevier, vol. 63(C), pages 1111-1125.
    18. Sjöberg, Lennart, 2003. "Risk communication between experts and the public: perceptions and intentions," SSE/EFI Working Paper Series in Business Administration 2003:13, Stockholm School of Economics.
    19. Ine H. J. Van Der Fels‐Klerx & Louis H. J. Goossens & Helmut W. Saatkamp & Suzan H. S. Horst, 2002. "Elicitation of Quantitative Data from a Heterogeneous Expert Panel: Formal Process and Application in Animal Health," Risk Analysis, John Wiley & Sons, vol. 22(1), pages 67-81, February.
    20. Paoletti, J. Mitchell & Shortridge, Julie E., 2020. "Improved representation of uncertainty in farm-level financial cost-benefit analyses of supplemental irrigation in humid regions," Agricultural Water Management, Elsevier, vol. 239(C).
    21. John S. Evans & John D. Graham & George M. Gray & Robert L. Sielken, 1994. "A Distributional Approach to Characterizing Low‐Dose Cancer Risk," Risk Analysis, John Wiley & Sons, vol. 14(1), pages 25-34, February.
    22. A. H. S. Garmabaki & Adithya Thaduri & Stephen Famurewa & Uday Kumar, 2021. "Adapting Railway Maintenance to Climate Change," Sustainability, MDPI, vol. 13(24), pages 1-27, December.
    23. Robert J. Budnitz & George Apostolakis & David M. Boore & Lloyd S. Cluff & Kevin J. Coppersmith & C. Allin Cornell & Peter A. Morris, 1998. "Use of Technical Expert Panels: Applications to Probabilistic Seismic Hazard Analysis," Risk Analysis, John Wiley & Sons, vol. 18(4), pages 463-469, August.
    24. Justin M. Ross & Sarah E. Larson & Chad Wall, 2012. "Are Surveys Of Experts Unbiased? Evidence From College Football Rankings," Contemporary Economic Policy, Western Economic Association International, vol. 30(4), pages 502-522, October.
    25. Mostafa Aliyari & Yonas Z Ayele & Abbas Barabadi & Enrique Lopez Droguett, 2019. "Risk analysis in low-voltage distribution systems," Journal of Risk and Reliability, , vol. 233(2), pages 118-138, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Craig R. Fox & Robert T. Clemen, 2005. "Subjective Probability Assessment in Decision Analysis: Partition Dependence and Bias Toward the Ignorance Prior," Management Science, INFORMS, vol. 51(9), pages 1417-1432, September.
    2. Marcelo Firpo de Souza Porto & Carlos Machado de Freitas, 1996. "Major Chemical Accidents in Industrializing Countries: The Socio‐Political Amplification of Risk," Risk Analysis, John Wiley & Sons, vol. 16(1), pages 19-29, February.
    3. Kimberly M. Thompson & Radboud J. Duintjer Tebbens & Mark A. Pallansch & Olen M. Kew & Roland W. Sutter & R. Bruce Aylward & Margaret Watkins & Howard Gary & James P. Alexander & Linda Venczel & Denis, 2006. "Development and Consideration of Global Policies for Managing the Future Risks of Poliovirus Outbreaks: Insights and Lessons Learned Through Modeling," Risk Analysis, John Wiley & Sons, vol. 26(6), pages 1571-1580, December.
    4. Humphrey, Steven J., 2000. "The common consequence effect: testing a unified explanation of recent mixed evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 41(3), pages 239-262, March.
    5. Dertwinkel-Kalt, Markus & Köster, Mats, 2015. "Violations of first-order stochastic dominance as salience effects," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 59(C), pages 42-46.
    6. Helmut Jungermann & Hans‐Rüdiger Pfister & Katrin Fischer, 1996. "Credibility, Information Preferences, and Information Interests," Risk Analysis, John Wiley & Sons, vol. 16(2), pages 251-261, April.
    7. Lahtinen, Tuomas J. & Hämäläinen, Raimo P., 2016. "Path dependence and biases in the even swaps decision analysis method," European Journal of Operational Research, Elsevier, vol. 249(3), pages 890-898.
    8. David A. Hensher, 2006. "How do respondents process stated choice experiments? Attribute consideration under varying information load," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 861-878, September.
    9. Richard M. Anderson & Robert Clemen, 2013. "Toward an Improved Methodology to Construct and Reconcile Decision Analytic Preference Judgments," Decision Analysis, INFORMS, vol. 10(2), pages 121-134, June.
    10. Starmer, Chris & Sugden, Robert, 1993. "Testing for Juxtaposition and Event-Splitting Effects," Journal of Risk and Uncertainty, Springer, vol. 6(3), pages 235-254, June.
    11. James S. Dyer & James E. Smith, 2021. "Innovations in the Science and Practice of Decision Analysis: The Role of Management Science," Management Science, INFORMS, vol. 67(9), pages 5364-5378, September.
    12. George E. Apostolakis & Susan E. Pickett, 1998. "Deliberation: Integrating Analytical Results into Environmental Decisions Involving Multiple Stakeholders," Risk Analysis, John Wiley & Sons, vol. 18(5), pages 621-634, October.
    13. Wakker, Peter P., 2023. "A criticism of Bernheim & Sprenger's (2020) tests of rank dependence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    14. Montibeller, Gilberto & Franco, L. Alberto & Lord, Ewan & Iglesias, Aline, 2009. "Structuring resource allocation decisions: A framework for building multi-criteria portfolio models with area-grouped options," European Journal of Operational Research, Elsevier, vol. 199(3), pages 846-856, December.
    15. Rex Brown, 2005. "The Operation Was a Success but the Patient Died: Aider Priorities Influence Decision Aid Usefulness," Interfaces, INFORMS, vol. 35(6), pages 511-521, December.
    16. Mika Marttunen & Jyri Mustajoki, 2018. "Use of Analyst-Generated Stakeholder Preference Profiles in Multi-Criteria Decision Analysis — Experiences from an Urban Planning Case," Journal of Environmental Assessment Policy and Management (JEAPM), World Scientific Publishing Co. Pte. Ltd., vol. 20(03), pages 1-29, September.
    17. Ralph L. Keeney, 1995. "Understanding Life‐Threatening Risks," Risk Analysis, John Wiley & Sons, vol. 15(6), pages 627-637, December.
    18. M. Elisabeth Paté-Cornell & Robin L. Dillon, 2006. "The Respective Roles of Risk and Decision Analyses in Decision Support," Decision Analysis, INFORMS, vol. 3(4), pages 220-232, December.
    19. Vincent T. Covello, 1987. "Decision Analysis and Risk Management Decision Making: Issues and Methods," Risk Analysis, John Wiley & Sons, vol. 7(2), pages 131-139, June.
    20. Vicki Bier, 2020. "The Role of Decision Analysis in Risk Analysis: A Retrospective," Risk Analysis, John Wiley & Sons, vol. 40(S1), pages 2207-2217, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:12:y:1992:i:1:p:83-93. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.