IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v237y2023ics0951832023002302.html
   My bibliography  Save this article

Multicanonical sequential Monte Carlo sampler for uncertainty quantification

Author

Listed:
  • Millar, Robert
  • Li, Hui
  • Li, Jinglai

Abstract

In many real-world engineering systems, the performance or reliability of the system is characterised by a scalar variable. The distribution of this performance variable is important in many uncertainty quantification problems, ranging from risk management to utility optimisation. In practice, this distribution usually cannot be derived analytically and has to be obtained numerically by simulations. To this end, standard Monte Carlo simulations are often used, however, they cannot efficiently reconstruct the tail of the distribution which is essential in many applications. One possible remedy is to use the Multicanonical Monte Carlo method, an adaptive importance sampling scheme. In this method, one draws samples from an importance sampling distribution in a nonstandard form in each iteration, which is usually done via Markov chain Monte Carlo (MCMC). MCMC is inherently serial and therefore struggles with parallelism. In this paper, we present a new approach, which uses the Sequential Monte Carlo sampler to draw from the importance sampling distribution, which is particularly suited for parallel implementation. With both mathematical and practical examples, we demonstrate the competitive performance of the proposed method.

Suggested Citation

  • Millar, Robert & Li, Hui & Li, Jinglai, 2023. "Multicanonical sequential Monte Carlo sampler for uncertainty quantification," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
  • Handle: RePEc:eee:reensy:v:237:y:2023:i:c:s0951832023002302
    DOI: 10.1016/j.ress.2023.109316
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023002302
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109316?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. El Masri, Maxime & Morio, Jérôme & Simatos, Florian, 2021. "Improvement of the cross-entropy method in high dimension for failure probability estimation through a one-dimensional projection without gradient estimation," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    3. Zhou, Jin & Li, Jie, 2022. "An enhanced method for improving the accuracy of small failure probability of structures," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    4. Chan, Joshua C.C. & Kroese, Dirk P., 2010. "Efficient estimation of large portfolio loss probabilities in t-copula models," European Journal of Operational Research, Elsevier, vol. 205(2), pages 361-367, September.
    5. Liu, Wang-Sheng & Cheung, Sai Hung, 2017. "Reliability based design optimization with approximate failure probability function in partitioned design space," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 602-611.
    6. Yuan, Xiukai & Qian, Yugeng & Chen, Jingqiang & Faes, Matthias G.R. & Valdebenito, Marcos A. & Beer, Michael, 2023. "Global failure probability function estimation based on an adaptive strategy and combination algorithm," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    7. Beskos, Alexandros & Jasra, Ajay & Law, Kody & Tempone, Raul & Zhou, Yan, 2017. "Multilevel sequential Monte Carlo samplers," Stochastic Processes and their Applications, Elsevier, vol. 127(5), pages 1417-1440.
    8. Yukito Iba & Nen Saito & Akimasa Kitajima, 2014. "Multicanonical MCMC for sampling rare events: an illustrative review," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(3), pages 611-645, June.
    9. Achal Bassamboo & Sandeep Juneja & Assaf Zeevi, 2008. "Portfolio Credit Risk with Extremal Dependence: Asymptotic Analysis and Efficient Simulation," Operations Research, INFORMS, vol. 56(3), pages 593-606, June.
    10. Breitung, Karl, 2019. "The geometry of limit state function graphs and subset simulation: Counterexamples," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 98-106.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guan, Xuefei, 2024. "Sparse moment quadrature for uncertainty modeling and quantification," Reliability Engineering and System Safety, Elsevier, vol. 241(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. İsmail Başoğlu & Wolfgang Hörmann & Halis Sak, 2018. "Efficient simulations for a Bernoulli mixture model of portfolio credit risk," Annals of Operations Research, Springer, vol. 260(1), pages 113-128, January.
    2. Mohamed A. Ayadi & Hatem Ben-Ameur & Nabil Channouf & Quang Khoi Tran, 2019. "NORTA for portfolio credit risk," Annals of Operations Research, Springer, vol. 281(1), pages 99-119, October.
    3. Hengxin Cui & Ken Seng Tan & Fan Yang, 2024. "Portfolio credit risk with Archimedean copulas: asymptotic analysis and efficient simulation," Papers 2411.06640, arXiv.org.
    4. Rongda Chen & Ze Wang & Lean Yu, 2017. "Importance Sampling for Credit Portfolio Risk with Risk Factors Having t-Copula," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 16(04), pages 1101-1124, July.
    5. Dimitrov, Daniel & van Wijnbergen, Sweder, 2023. "Quantifying Systemic Risk in the Presence of Unlisted Banks: Application to the European Banking Sector," CEPR Discussion Papers 17992, C.E.P.R. Discussion Papers.
    6. Dasgupta, Agnimitra & Johnson, Erik A., 2024. "REIN: Reliability Estimation via Importance sampling with Normalizing flows," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    7. Pierre E. Jacob & John O’Leary & Yves F. Atchadé, 2020. "Unbiased Markov chain Monte Carlo methods with couplings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 543-600, July.
    8. Erik Hintz & Marius Hofert & Christiane Lemieux & Yoshihiro Taniguchi, 2022. "Single-Index Importance Sampling with Stratification," Methodology and Computing in Applied Probability, Springer, vol. 24(4), pages 3049-3073, December.
    9. Ferrer, Alex & Casals, José & Sotoca, Sonia, 2016. "Efficient estimation of unconditional capital by Monte Carlo simulation," Finance Research Letters, Elsevier, vol. 16(C), pages 75-84.
    10. Chiron, Marie & Genest, Christian & Morio, Jérôme & Dubreuil, Sylvain, 2023. "Failure probability estimation through high-dimensional elliptical distribution modeling with multiple importance sampling," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    11. Huang, Zhenzhen & Kwok, Yue Kuen & Xu, Ziqing, 2024. "Efficient algorithms for calculating risk measures and risk contributions in copula credit risk models," Insurance: Mathematics and Economics, Elsevier, vol. 115(C), pages 132-150.
    12. Sunggon Kim & Jisu Yu, 2023. "Stratified importance sampling for a Bernoulli mixture model of portfolio credit risk," Annals of Operations Research, Springer, vol. 322(2), pages 819-849, March.
    13. Tim J. Brereton & Dirk P. Kroese & Joshua C. Chan, 2012. "Monte Carlo Methods for Portfolio Credit Risk," ANU Working Papers in Economics and Econometrics 2012-579, Australian National University, College of Business and Economics, School of Economics.
    14. Cheng-Der Fuh & Chuan-Ju Wang, 2017. "Efficient Exponential Tilting for Portfolio Credit Risk," Papers 1711.03744, arXiv.org, revised Apr 2019.
    15. Tang, Qihe & Tang, Zhaofeng & Yang, Yang, 2019. "Sharp asymptotics for large portfolio losses under extreme risks," European Journal of Operational Research, Elsevier, vol. 276(2), pages 710-722.
    16. Warne, David J. & Baker, Ruth E. & Simpson, Matthew J., 2018. "Multilevel rejection sampling for approximate Bayesian computation," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 71-86.
    17. Hai‐Dang Dau & Nicolas Chopin, 2022. "Waste‐free sequential Monte Carlo," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(1), pages 114-148, February.
    18. Tang, Qihe & Tong, Zhiwei & Yang, Yang, 2021. "Large portfolio losses in a turbulent market," European Journal of Operational Research, Elsevier, vol. 292(2), pages 755-769.
    19. Ajay Jasra & Kody Law & Carina Suciu, 2020. "Advanced Multilevel Monte Carlo Methods," International Statistical Review, International Statistical Institute, vol. 88(3), pages 548-579, December.
    20. Gerardo Manzo & Antonio Picca, 2020. "The Impact of Sovereign Shocks," Management Science, INFORMS, vol. 66(7), pages 3113-3132, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:237:y:2023:i:c:s0951832023002302. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.