IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i16p4014-d1455478.html
   My bibliography  Save this article

Calibration under Uncertainty Using Bayesian Emulation and History Matching: Methods and Illustration on a Building Energy Model

Author

Listed:
  • Dario Domingo

    (Department of Mathematical Sciences, Durham University, Durham DH1 3LE, UK)

  • Mohammad Royapoor

    (RED Engineering Design Ltd., London WC1A 1HB, UK)

  • Hailiang Du

    (Department of Mathematical Sciences, Durham University, Durham DH1 3LE, UK)

  • Aaron Boranian

    (Big Ladder Software, Denver, CO 80202, USA)

  • Sara Walker

    (School of Engineering, Newcastle University, Newcastle upon Tyne NE1 7RU, UK
    Current address: Birmingham Energy Institute, Birmingham University, Birmingham B15 2TT, UK.)

  • Michael Goldstein

    (Department of Mathematical Sciences, Durham University, Durham DH1 3LE, UK)

Abstract

Energy models require accurate calibration to deliver reliable predictions. This study offers statistical guidance for a systematic treatment of uncertainty before and during model calibration. Statistical emulation and history matching are introduced. An energy model of a domestic property and a full year of observed data are used as a case study. Emulators, Bayesian surrogates of the energy model, are employed to provide statistical approximations of the energy model outputs and explore the input parameter space efficiently. The emulator’s predictions, alongside quantified uncertainties, are then used to rule out parameter configurations that cannot lead to a match with the observed data. The process is automated within an iterative procedure known as history matching (HM), in which simulated gas consumption and temperature data are simultaneously matched with observed values. The results show that only a small percentage of parameter configurations (0.3% when only gas consumption is matched, and 0.01% when both gas and temperature are matched) yielded outputs matching the observed data. This demonstrates HM’s effectiveness in pinpointing the precise region where model outputs align with observations. The proposed method is intended to offer analysts a robust solution to rapidly explore a model’s response across the entire input space, rule out regions where a match with observed data cannot be achieved, and account for uncertainty, enhancing the confidence in energy models and their viability as a decision support tool.

Suggested Citation

  • Dario Domingo & Mohammad Royapoor & Hailiang Du & Aaron Boranian & Sara Walker & Michael Goldstein, 2024. "Calibration under Uncertainty Using Bayesian Emulation and History Matching: Methods and Illustration on a Building Energy Model," Energies, MDPI, vol. 17(16), pages 1-28, August.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:16:p:4014-:d:1455478
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/16/4014/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/16/4014/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marc C. Kennedy & Anthony O'Hagan, 2001. "Bayesian calibration of computer models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(3), pages 425-464.
    2. Tamsin L. Edwards & Mark A. Brandon & Gael Durand & Neil R. Edwards & Nicholas R. Golledge & Philip B. Holden & Isabel J. Nias & Antony J. Payne & Catherine Ritz & Andreas Wernecke, 2019. "Revisiting Antarctic ice loss due to marine ice-cliff instability," Nature, Nature, vol. 566(7742), pages 58-64, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vanslette, Kevin & Tohme, Tony & Youcef-Toumi, Kamal, 2020. "A general model validation and testing tool," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    2. Matthias Katzfuss & Joseph Guinness & Wenlong Gong & Daniel Zilber, 2020. "Vecchia Approximations of Gaussian-Process Predictions," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 25(3), pages 383-414, September.
    3. Jakub Bijak & Viet Dung Cao & Eric Silverman & Jason Hilton, 2013. "Reforging the Wedding Ring," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 29(27), pages 729-766.
    4. Hao Wu & Michael Browne, 2015. "Random Model Discrepancy: Interpretations and Technicalities (A Rejoinder)," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 619-624, September.
    5. Jun-Young Park & Fabian Schloesser & Axel Timmermann & Dipayan Choudhury & June-Yi Lee & Arjun Babu Nellikkattil, 2023. "Future sea-level projections with a coupled atmosphere-ocean-ice-sheet model," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    6. Villez, Kris & Del Giudice, Dario & Neumann, Marc B. & Rieckermann, Jörg, 2020. "Accounting for erroneous model structures in biokinetic process models," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    7. Xiaoyu Xiong & Benjamin D. Youngman & Theodoros Economou, 2021. "Data fusion with Gaussian processes for estimation of environmental hazard events," Environmetrics, John Wiley & Sons, Ltd., vol. 32(3), May.
    8. Petropoulos, G. & Wooster, M.J. & Carlson, T.N. & Kennedy, M.C. & Scholze, M., 2009. "A global Bayesian sensitivity analysis of the 1d SimSphere soil–vegetation–atmospheric transfer (SVAT) model using Gaussian model emulation," Ecological Modelling, Elsevier, vol. 220(19), pages 2427-2440.
    9. David Breitenmoser & Francesco Cerutti & Gernot Butterweck & Malgorzata Magdalena Kasprzak & Sabine Mayer, 2023. "Emulator-based Bayesian inference on non-proportional scintillation models by compton-edge probing," Nature Communications, Nature, vol. 14(1), pages 1-12, December.
    10. Drignei, Dorin, 2011. "A general statistical model for computer experiments with time series output," Reliability Engineering and System Safety, Elsevier, vol. 96(4), pages 460-467.
    11. Yuan, Jun & Nian, Victor & Su, Bin & Meng, Qun, 2017. "A simultaneous calibration and parameter ranking method for building energy models," Applied Energy, Elsevier, vol. 206(C), pages 657-666.
    12. Barde, Sylvain, 2024. "Bayesian estimation of large-scale simulation models with Gaussian process regression surrogates," Computational Statistics & Data Analysis, Elsevier, vol. 196(C).
    13. Gross, Eitan, 2015. "Effect of environmental stress on regulation of gene expression in the yeast," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 430(C), pages 224-235.
    14. Hwang, Youngdeok & Kim, Hang J. & Chang, Won & Yeo, Kyongmin & Kim, Yongku, 2019. "Bayesian pollution source identification via an inverse physics model," Computational Statistics & Data Analysis, Elsevier, vol. 134(C), pages 76-92.
    15. Choi, Wonjun & Menberg, Kathrin & Kikumoto, Hideki & Heo, Yeonsook & Choudhary, Ruchi & Ooka, Ryozo, 2018. "Bayesian inference of structural error in inverse models of thermal response tests," Applied Energy, Elsevier, vol. 228(C), pages 1473-1485.
    16. Yuan, Jun & Ng, Szu Hui, 2013. "A sequential approach for stochastic computer model calibration and prediction," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 273-286.
    17. Edward Boone & Jan Hannig & Ryad Ghanam & Sujit Ghosh & Fabrizio Ruggeri & Serge Prudhomme, 2022. "Model Validation of a Single Degree-of-Freedom Oscillator: A Case Study," Stats, MDPI, vol. 5(4), pages 1-17, November.
    18. Overstall, Antony M. & Woods, David C. & Martin, Kieran J., 2019. "Bayesian prediction for physical models with application to the optimization of the synthesis of pharmaceutical products using chemical kinetics," Computational Statistics & Data Analysis, Elsevier, vol. 132(C), pages 126-142.
    19. Abokersh, Mohamed Hany & Vallès, Manel & Cabeza, Luisa F. & Boer, Dieter, 2020. "A framework for the optimal integration of solar assisted district heating in different urban sized communities: A robust machine learning approach incorporating global sensitivity analysis," Applied Energy, Elsevier, vol. 267(C).
    20. Campbell, Katherine, 2006. "Statistical calibration of computer simulations," Reliability Engineering and System Safety, Elsevier, vol. 91(10), pages 1358-1363.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:16:p:4014-:d:1455478. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.