IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v94y2009i7p1183-1193.html
   My bibliography  Save this article

Hierarchical adaptive experimental design for Gaussian process emulators

Author

Listed:
  • Busby, Daniel

Abstract

Large computer simulators have usually complex and nonlinear input output functions. This complicated input output relation can be analyzed by global sensitivity analysis; however, this usually requires massive Monte Carlo simulations. To effectively reduce the number of simulations, statistical techniques such as Gaussian process emulators can be adopted. The accuracy and reliability of these emulators strongly depend on the experimental design where suitable evaluation points are selected. In this paper a new sequential design strategy called hierarchical adaptive design is proposed to obtain an accurate emulator using the least possible number of simulations. The hierarchical design proposed in this paper is tested on various standard analytic functions and on a challenging reservoir forecasting application. Comparisons with standard one-stage designs such as maximin latin hypercube designs show that the hierarchical adaptive design produces a more accurate emulator with the same number of computer experiments. Moreover a stopping criterion is proposed that enables to perform the number of simulations necessary to obtain required approximation accuracy.

Suggested Citation

  • Busby, Daniel, 2009. "Hierarchical adaptive experimental design for Gaussian process emulators," Reliability Engineering and System Safety, Elsevier, vol. 94(7), pages 1183-1193.
  • Handle: RePEc:eee:reensy:v:94:y:2009:i:7:p:1183-1193
    DOI: 10.1016/j.ress.2008.07.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832008001968
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2008.07.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jeremy E. Oakley & Anthony O'Hagan, 2004. "Probabilistic sensitivity analysis of complex models: a Bayesian approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 751-769, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Amo-Salas, M. & López-Fidalgo, J. & Pedregal, D.J., 2015. "Experimental designs for autoregressive models applied to industrial maintenance," Reliability Engineering and System Safety, Elsevier, vol. 133(C), pages 87-94.
    2. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    3. Echard, B. & Gayton, N. & Lemaire, M. & Relun, N., 2013. "A combined Importance Sampling and Kriging reliability method for small failure probabilities with time-demanding numerical models," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 232-240.
    4. Sun, Zhili & Wang, Jian & Li, Rui & Tong, Cao, 2017. "LIF: A new Kriging based learning function and its application to structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 152-165.
    5. Manfren, Massimiliano & Aste, Niccolò & Moshksar, Reza, 2013. "Calibration and uncertainty analysis for computer models – A meta-model based approach for integrated building energy simulation," Applied Energy, Elsevier, vol. 103(C), pages 627-641.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    2. Jakub Bijak & Jason D. Hilton & Eric Silverman & Viet Dung Cao, 2013. "Reforging the Wedding Ring," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 29(27), pages 729-766.
    3. Acharki, Naoufal & Bertoncello, Antoine & Garnier, Josselin, 2023. "Robust prediction interval estimation for Gaussian processes by cross-validation method," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    4. Xueping Chen & Yujie Gai & Xiaodi Wang, 2023. "A-optimal designs for non-parametric symmetrical global sensitivity analysis," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(2), pages 219-237, February.
    5. Matieyendou Lamboni, 2020. "Uncertainty quantification: a minimum variance unbiased (joint) estimator of the non-normalized Sobol’ indices," Statistical Papers, Springer, vol. 61(5), pages 1939-1970, October.
    6. Isaac Corro Ramos & Maureen P. M. H. Rutten-van Mölken & Maiwenn J. Al, 2013. "The Role of Value-of-Information Analysis in a Health Care Research Priority Setting," Medical Decision Making, , vol. 33(4), pages 472-489, May.
    7. Veiga, Sébastien Da & Marrel, Amandine, 2020. "Gaussian process regression with linear inequality constraints," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    8. Petropoulos, G. & Wooster, M.J. & Carlson, T.N. & Kennedy, M.C. & Scholze, M., 2009. "A global Bayesian sensitivity analysis of the 1d SimSphere soil–vegetation–atmospheric transfer (SVAT) model using Gaussian model emulation," Ecological Modelling, Elsevier, vol. 220(19), pages 2427-2440.
    9. Lu, Xuefei & Borgonovo, Emanuele, 2023. "Global sensitivity analysis in epidemiological modeling," European Journal of Operational Research, Elsevier, vol. 304(1), pages 9-24.
    10. Tianyang Wang & James S. Dyer & Warren J. Hahn, 2017. "Sensitivity analysis of decision making under dependent uncertainties using copulas," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 5(1), pages 117-139, November.
    11. Hemez, François M. & Atamturktur, Sezer, 2011. "The dangers of sparse sampling for the quantification of margin and uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1220-1231.
    12. Al Ali, Hannah & Daneshkhah, Alireza & Boutayeb, Abdesslam & Malunguza, Noble Jahalamajaha & Mukandavire, Zindoga, 2022. "Exploring dynamical properties of a Type 1 diabetes model using sensitivity approaches," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 201(C), pages 324-342.
    13. Zhai, Qingqing & Yang, Jun & Zhao, Yu, 2014. "Space-partition method for the variance-based sensitivity analysis: Optimal partition scheme and comparative study," Reliability Engineering and System Safety, Elsevier, vol. 131(C), pages 66-82.
    14. Andrew Gelman & Christian Hennig, 2017. "Beyond subjective and objective in statistics," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 967-1033, October.
    15. Pesenti, Silvana M. & Millossovich, Pietro & Tsanakas, Andreas, 2019. "Reverse sensitivity testing: What does it take to break the model?," European Journal of Operational Research, Elsevier, vol. 274(2), pages 654-670.
    16. Ioannis Andrianakis & Ian R Vernon & Nicky McCreesh & Trevelyan J McKinley & Jeremy E Oakley & Rebecca N Nsubuga & Michael Goldstein & Richard G White, 2015. "Bayesian History Matching of Complex Infectious Disease Models Using Emulation: A Tutorial and a Case Study on HIV in Uganda," PLOS Computational Biology, Public Library of Science, vol. 11(1), pages 1-18, January.
    17. Emanuele Borgonovo, 2006. "Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches," Risk Analysis, John Wiley & Sons, vol. 26(5), pages 1349-1361, October.
    18. Ge, Qiao & Menendez, Monica, 2017. "Extending Morris method for qualitative global sensitivity analysis of models with dependent inputs," Reliability Engineering and System Safety, Elsevier, vol. 162(C), pages 28-39.
    19. Lambert, Romain S.C. & Lemke, Frank & Kucherenko, Sergei S. & Song, Shufang & Shah, Nilay, 2016. "Global sensitivity analysis using sparse high dimensional model representations generated by the group method of data handling," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 128(C), pages 42-54.
    20. Marc Kennedy & Clive Anderson & Anthony O'Hagan & Mark Lomas & Ian Woodward & John Paul Gosling & Andreas Heinemeyer, 2008. "Quantifying uncertainty in the biospheric carbon flux for England and Wales," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(1), pages 109-135, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:94:y:2009:i:7:p:1183-1193. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.