IDEAS home Printed from https://ideas.repec.org/a/oup/biomet/v89y2002i4p769-784.html
   My bibliography  Save this article

Bayesian inference for the uncertainty distribution of computer model outputs

Author

Listed:
  • Jeremy Oakley

Abstract

We consider a problem of inference for the output of a computationally expensive computer model. We suppose that the model is to be used in a context where the values of one or more inputs are uncertain, so that the input configuration is a random variable. We require to make inference about the induced distribution of the output. This distribution is called the uncertainty distribution, and the general problem is known to users of computer models as uncertainty analysis. To be specific, we develop Bayesian inference for the distribution and density functions of the model output. Modelling the output, as a function of its inputs, as a Gaussian process, we derive expressions for the posterior mean and variance of the distribution and density functions, based on data comprising observed outputs at a sample of input configurations. We show that direct computation of these expressions may encounter numerical difficulties. We develop an alternative approach based on simulating approximate realisations from the posterior distribution of the output function. Two examples are given to illustrate our methods. Copyright Biometrika Trust 2002, Oxford University Press.

Suggested Citation

  • Jeremy Oakley, 2002. "Bayesian inference for the uncertainty distribution of computer model outputs," Biometrika, Biometrika Trust, vol. 89(4), pages 769-784, December.
  • Handle: RePEc:oup:biomet:v:89:y:2002:i:4:p:769-784
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Priscilla Avegliano & Jaime Simão Sichman, 2023. "Equation-Based Versus Agent-Based Models: Why Not Embrace Both for an Efficient Parameter Calibration?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 26(4), pages 1-3.
    2. Jakub Bijak & Jason D. Hilton & Eric Silverman & Viet Dung Cao, 2013. "Reforging the Wedding Ring," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 29(27), pages 729-766.
    3. Simon Nanty & Céline Helbert & Amandine Marrel & Nadia Pérot & Clémentine Prieur, 2017. "Uncertainty quantification for functional dependent random variables," Computational Statistics, Springer, vol. 32(2), pages 559-583, June.
    4. Marrel, A. & Marie, N. & De Lozzo, M., 2015. "Advanced surrogate model and sensitivity analysis methods for sodium fast reactor accident assessment," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 232-241.
    5. Lorenzo Tomassini & Peter Reichert & Hans R. Künsch & Christoph Buser & Reto Knutti & Mark E. Borsuk, 2009. "A smoothing algorithm for estimating stochastic, continuous time model parameters and its application to a simple climate model," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 58(5), pages 679-704, December.
    6. Sonia Petrone & Michele Guindani & Alan E. Gelfand, 2009. "Hybrid Dirichlet mixture models for functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(4), pages 755-782, September.
    7. Evan Baker & Peter Challenor & Matt Eames, 2021. "Future proofing a building design using history matching inspired level‐set techniques," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(2), pages 335-350, March.
    8. Petropoulos, G. & Wooster, M.J. & Carlson, T.N. & Kennedy, M.C. & Scholze, M., 2009. "A global Bayesian sensitivity analysis of the 1d SimSphere soil–vegetation–atmospheric transfer (SVAT) model using Gaussian model emulation," Ecological Modelling, Elsevier, vol. 220(19), pages 2427-2440.
    9. repec:jss:jstsof:46:i08 is not listed on IDEAS
    10. V. J. Roelofs & M. C. Kennedy, 2011. "Sensitivity Analysis and Estimation of Extreme Tail Behavior in Two‐Dimensional Monte Carlo Simulation," Risk Analysis, John Wiley & Sons, vol. 31(10), pages 1597-1609, October.
    11. Montserrat Fuentes & Peter Guttorp & Peter Challenor, 2003. "Statistical Assessment of Numerical Models," International Statistical Review, International Statistical Institute, vol. 71(2), pages 201-221, August.
    12. Storlie, Curtis B. & Reich, Brian J. & Helton, Jon C. & Swiler, Laura P. & Sallaberry, Cedric J., 2013. "Analysis of computationally demanding models with continuous and categorical inputs," Reliability Engineering and System Safety, Elsevier, vol. 113(C), pages 30-41.
    13. Yawen Guan & Christian Sampson & J. Derek Tucker & Won Chang & Anirban Mondal & Murali Haran & Deborah Sulsky, 2019. "Computer Model Calibration Based on Image Warping Metrics: An Application for Sea Ice Deformation," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(3), pages 444-463, September.
    14. Wei Xie & Barry L. Nelson & Russell R. Barton, 2014. "A Bayesian Framework for Quantifying Uncertainty in Stochastic Simulation," Operations Research, INFORMS, vol. 62(6), pages 1439-1452, December.
    15. McFarland, John & DeCarlo, Erin, 2020. "A Monte Carlo framework for probabilistic analysis and variance decomposition with distribution parameter uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
    16. Reichert, P. & White, G. & Bayarri, M.J. & Pitman, E.B., 2011. "Mechanism-based emulation of dynamic simulation models: Concept and application in hydrology," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1638-1655, April.
    17. SungKu Kang & Ran Jin & Xinwei Deng & Ron S. Kenett, 2023. "Challenges of modeling and analysis in cybermanufacturing: a review from a machine learning and computation perspective," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 415-428, February.
    18. Guo, Tiexin & Wang, Hongji & Li, Jinglai & Wang, Hongqiao, 2024. "Sampling-based adaptive design strategy for failure probability estimation," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    19. Betancourt, José & Bachoc, François & Klein, Thierry & Idier, Déborah & Pedreros, Rodrigo & Rohmer, Jérémy, 2020. "Gaussian process metamodeling of functional-input code for coastal flood hazard assessment," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    20. Geoffrey Fairchild & Kyle S. Hickmann & Susan M. Mniszewski & Sara Y. Del Valle & James M. Hyman, 2014. "Optimizing human activity patterns using global sensitivity analysis," Computational and Mathematical Organization Theory, Springer, vol. 20(4), pages 394-416, December.
    21. repec:jss:jstsof:14:i16 is not listed on IDEAS
    22. O’Hagan, A., 2006. "Bayesian analysis of computer code outputs: A tutorial," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1290-1300.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:biomet:v:89:y:2002:i:4:p:769-784. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/biomet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.