IDEAS home Printed from https://ideas.repec.org/a/wly/riskan/v18y1998i4p463-469.html
   My bibliography  Save this article

Use of Technical Expert Panels: Applications to Probabilistic Seismic Hazard Analysis

Author

Listed:
  • Robert J. Budnitz
  • George Apostolakis
  • David M. Boore
  • Lloyd S. Cluff
  • Kevin J. Coppersmith
  • C. Allin Cornell
  • Peter A. Morris

Abstract

Probabilistic Seismic Hazard Analysis (PSHA) is a methodology that estimates the likelihood that various levels of earthquake‐caused ground motions will be exceeded at a given location in a given future time period. Due to large uncertainties in all of the geosciences data and in their modeling, multiple model interpretations are often possible. This leads to disagreements among the experts, which in the past has led to disagreement on the selection of a ground motion for design at a given site. This paper reports on a project, co‐sponsored by the U.S. Nuclear Regulatory Commission, the U.S. Department of Energy, and the Electric Power Research Institute, that was undertaken to review the state‐of‐the‐art and improve on the overall stability of the PSHA process, by providing methodological guidance on how to perform a PSHA. The project reviewed past studies and examined ways to improve on the present state‐of‐the‐art. In analyzing past PSHA studies, the most important conclusion is that differences in PSHA results are commonly due to process rather than technical differences. Thus, the project concentrated heavily on developing process recommendations, especially on the use of multiple experts, and this paper reports on those process recommendations. The problem of facilitating and integrating the judgments of a diverse group of experts is analyzed in detail. The authors believe that the concepts and process principles apply just as well to non‐earthquake fields such as volcanic hazard, flood risk, nuclear‐plant safety, and climate change.

Suggested Citation

  • Robert J. Budnitz & George Apostolakis & David M. Boore & Lloyd S. Cluff & Kevin J. Coppersmith & C. Allin Cornell & Peter A. Morris, 1998. "Use of Technical Expert Panels: Applications to Probabilistic Seismic Hazard Analysis," Risk Analysis, John Wiley & Sons, vol. 18(4), pages 463-469, August.
  • Handle: RePEc:wly:riskan:v:18:y:1998:i:4:p:463-469
    DOI: 10.1111/j.1539-6924.1998.tb00361.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1539-6924.1998.tb00361.x
    Download Restriction: no

    File URL: https://libkey.io/10.1111/j.1539-6924.1998.tb00361.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Peter A. Morris, 1974. "Decision Analysis Expert Use," Management Science, INFORMS, vol. 20(9), pages 1233-1241, May.
    2. Robert T. Clemen, 1987. "Combining Overlapping Information," Management Science, INFORMS, vol. 33(3), pages 373-380, March.
    3. Robert T. Clemen & Robert L. Winkler, 1985. "Limits for the Precision and Value of Information from Dependent Sources," Operations Research, INFORMS, vol. 33(2), pages 427-442, April.
    4. Robert L. Winkler & Thomas S. Wallsten & Ronald G. Whitfield & Harvey M. Richmond & Stanley R. Hayes & Arlene S. Rosenbaum, 1995. "An Assessment of the Risk of Chronic Lung Injury Attributable to Long-Term Ozone Exposure," Operations Research, INFORMS, vol. 43(1), pages 19-28, February.
    5. Robert L. Winkler, 1981. "Combining Probability Distributions from Dependent Information Sources," Management Science, INFORMS, vol. 27(4), pages 479-488, April.
    6. Harry Otway & Detlof von Winterfeldt, 1992. "Expert Judgment in Risk Analysis and Management: Process, Context, and Pitfalls," Risk Analysis, John Wiley & Sons, vol. 12(1), pages 83-93, March.
    7. Robert L. Winkler, 1968. "The Consensus of Subjective Probability Distributions," Management Science, INFORMS, vol. 15(2), pages 61-75, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. George E. Apostolakis, 2004. "How Useful Is Quantitative Risk Assessment?," Risk Analysis, John Wiley & Sons, vol. 24(3), pages 515-520, June.
    2. Robert L. Winkler*, 2015. "Equal Versus Differential Weighting in Combining Forecasts," Risk Analysis, John Wiley & Sons, vol. 35(1), pages 16-18, January.
    3. Elisabeth Paté‐Cornell, 2002. "Finding and Fixing Systems Weaknesses: Probabilistic Methods and Applications of Engineering Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 22(2), pages 319-334, April.
    4. J. C. Helton & F. J. Davis, 2002. "Illustration of Sampling‐Based Methods for Uncertainty and Sensitivity Analysis," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 591-622, June.
    5. D. Warner North, 2010. "Probability Theory and Consistent Reasoning," Risk Analysis, John Wiley & Sons, vol. 30(3), pages 377-380, March.
    6. Luca Zanetti & Daniele Chiffi & Lorenza Petrini, 2023. "Philosophical aspects of probabilistic seismic hazard analysis (PSHA): a critical review," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 117(2), pages 1193-1212, June.
    7. Tianyang Wang & James S. Dyer & John C. Butler, 2016. "Modeling Correlated Discrete Uncertainties in Event Trees with Copulas," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 396-410, February.
    8. George E. Apostolakis & Douglas M. Lemon, 2005. "A Screening Methodology for the Identification and Ranking of Infrastructure Vulnerabilities Due to Terrorism," Risk Analysis, John Wiley & Sons, vol. 25(2), pages 361-376, April.
    9. Elisabeth Paté‐Cornell, 2002. "Risk and Uncertainty Analysis in Government Safety Decisions," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 633-646, June.
    10. Edoardo Tosoni & Ahti Salo & Enrico Zio, 2018. "Scenario Analysis for the Safety Assessment of Nuclear Waste Repositories: A Critical Review," Risk Analysis, John Wiley & Sons, vol. 38(4), pages 755-776, April.
    11. D. Warner North, 2010. "Quantifying and Controlling Catastrophic Risks by B. John Garrick," Risk Analysis, John Wiley & Sons, vol. 30(10), pages 1623-1625, October.
    12. Ine H. J. Van Der Fels‐Klerx & Louis H. J. Goossens & Helmut W. Saatkamp & Suzan H. S. Horst, 2002. "Elicitation of Quantitative Data from a Heterogeneous Expert Panel: Formal Process and Application in Animal Health," Risk Analysis, John Wiley & Sons, vol. 22(1), pages 67-81, February.
    13. Helton, Jon C. & Brooks, Dusty M. & Sallaberry, Cédric J., 2020. "Margins associated with loss of assured safety for systems with multiple weak links and strong links," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    14. M. Elisabeth Paté‐Cornell, 1999. "Conditional Uncertainty Analysis and Implications for Decision Making: The Case of WIPP," Risk Analysis, John Wiley & Sons, vol. 19(5), pages 995-1002, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert T. Clemen & Robert L. Winkler, 1999. "Combining Probability Distributions From Experts in Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 19(2), pages 187-203, April.
    2. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    3. Li, Yongquan & Zhu, Kaijie, 2009. "Information acquisition in new product introduction," European Journal of Operational Research, Elsevier, vol. 198(2), pages 618-625, October.
    4. Fu, Qi & Zhu, Kaijie, 2010. "Endogenous information acquisition in supply chain management," European Journal of Operational Research, Elsevier, vol. 201(2), pages 454-462, March.
    5. Knut Are Aastveit & James Mitchell & Francesco Ravazzolo & Herman van Dijk, 2018. "The Evolution of Forecast Density Combinations in Economics," Tinbergen Institute Discussion Papers 18-069/III, Tinbergen Institute.
    6. James E. Smith & Detlof von Winterfeldt, 2004. "Anniversary Article: Decision Analysis in Management Science," Management Science, INFORMS, vol. 50(5), pages 561-574, May.
    7. Patrizio Frederic & Mario Di Bacco & Frank Lad, 2012. "Combining expert probabilities using the product of odds," Theory and Decision, Springer, vol. 73(4), pages 605-619, October.
    8. Jason R. W. Merrick & J. Rene van Dorp & Amita Singh, 2005. "Analysis of Correlated Expert Judgments from Extended Pairwise Comparisons," Decision Analysis, INFORMS, vol. 2(1), pages 17-29, March.
    9. Christian Kascha & Francesco Ravazzolo, 2010. "Combining inflation density forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 231-250.
    10. Paola Monari & Patrizia Agati, 2001. "Fiducial inference in combining expert judgements," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 10(1), pages 81-97, January.
    11. Jason R. W. Merrick, 2008. "Getting the Right Mix of Experts," Decision Analysis, INFORMS, vol. 5(1), pages 43-52, March.
    12. David M. Pennock & Michael P. Wellman, 2005. "Graphical Models for Groups: Belief Aggregation and Risk Sharing," Decision Analysis, INFORMS, vol. 2(3), pages 148-164, September.
    13. Neil A. Stiber & Mitchell J. Small & Marina Pantazidou, 2004. "Site‐Specific Updating and Aggregation of Bayesian Belief Network Models for Multiple Experts," Risk Analysis, John Wiley & Sons, vol. 24(6), pages 1529-1538, December.
    14. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    15. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    16. Ali Mosleh & George Apostolakis, 1986. "The Assessment of Probability Distributions from Expert Opinions with an Application to Seismic Fragility Curves," Risk Analysis, John Wiley & Sons, vol. 6(4), pages 447-461, December.
    17. Jaspersen, Johannes G., 2022. "Convex combinations in judgment aggregation," European Journal of Operational Research, Elsevier, vol. 299(2), pages 780-794.
    18. Robert L. Winkler & Robert T. Clemen, 2004. "Multiple Experts vs. Multiple Methods: Combining Correlation Assessments," Decision Analysis, INFORMS, vol. 1(3), pages 167-176, September.
    19. Dr. James Mitchell, 2009. "Measuring Output Gap Uncertainty," National Institute of Economic and Social Research (NIESR) Discussion Papers 342, National Institute of Economic and Social Research.
    20. Mark Freeman & Ben Groom, 2015. "Using equity premium survey data to estimate future wealth," Review of Quantitative Finance and Accounting, Springer, vol. 45(4), pages 665-693, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:riskan:v:18:y:1998:i:4:p:463-469. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1539-6924 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.