IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v231y2023ics0951832022005865.html
   My bibliography  Save this article

An expected integrated error reduction function for accelerating Bayesian active learning of failure probability

Author

Listed:
  • Wei, Pengfei
  • Zheng, Yu
  • Fu, Jiangfeng
  • Xu, Yuannan
  • Gao, Weikai

Abstract

The combination of active learning with surrogate model (e.g., Gaussian Process Regression, GPR) for structural reliability analysis has been extensively studied and proved to be of superiority due to the high efficiency. The performance of an active learning algorithm is determined by the utilized acquisition function, to a great extent, as it dominates the generation of the training data. The traditional acquisition functions usually fail to incorporate the spatial correlation information revealed by the surrogate model, thus still have plenty of room for improvement. We propose a new acquisition function, named as Expected Integrated Error Reduction (EIER) function, for active learning of the failure probability with a smaller number of simulator calls. Mathematically, the value of the EIER function at an unobserved point measures the expected integrated reduction of the probability of mis-classifying all points over the full input space, once this point is added to train the GPR model. The numerical error of the failure probability is evaluated with the posterior confidence intervals and/or coefficient of variation, numerically computed with an efficient sampling strategy, and is then served as the stopping criteria. The superiority of the proposed improvements is demonstrated with a set of numerical and engineering examples.

Suggested Citation

  • Wei, Pengfei & Zheng, Yu & Fu, Jiangfeng & Xu, Yuannan & Gao, Weikai, 2023. "An expected integrated error reduction function for accelerating Bayesian active learning of failure probability," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
  • Handle: RePEc:eee:reensy:v:231:y:2023:i:c:s0951832022005865
    DOI: 10.1016/j.ress.2022.108971
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832022005865
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2022.108971?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sun, Zhili & Wang, Jian & Li, Rui & Tong, Cao, 2017. "LIF: A new Kriging based learning function and its application to structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 157(C), pages 152-165.
    2. Zhou, Changcong & Zhang, Hanlin & Valdebenito, Marcos A. & Zhao, Haodong, 2022. "A general hierarchical ensemble-learning framework for structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    3. Echard, B. & Gayton, N. & Lemaire, M. & Relun, N., 2013. "A combined Importance Sampling and Kriging reliability method for small failure probabilities with time-demanding numerical models," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 232-240.
    4. Zhan, Hongyou & Xiao, Ning-Cong & Ji, Yuxiang, 2022. "An adaptive parallel learning dependent Kriging model for small failure probability problems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    5. Xiao, Ning-Cong & Zuo, Ming J. & Zhou, Chengning, 2018. "A new adaptive sequential sampling method to construct surrogate models for efficient reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 330-338.
    6. Ameryan, Ala & Ghalehnovi, Mansour & Rashki, Mohsen, 2022. "AK-SESC: a novel reliability procedure based on the integration of active learning kriging and sequential space conversion method," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    7. Chan, Jianpeng & Papaioannou, Iason & Straub, Daniel, 2022. "An adaptive subset simulation algorithm for system reliability analysis with discontinuous limit states," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    8. Xu, Yanwen & Renteria, Anabel & Wang, Pingfeng, 2022. "Adaptive surrogate models with partially observed information," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    9. Peter Frazier & Warren Powell & Savas Dayanik, 2009. "The Knowledge-Gradient Policy for Correlated Normal Beliefs," INFORMS Journal on Computing, INFORMS, vol. 21(4), pages 599-613, November.
    10. Chen, Zequan & Li, Guofa & He, Jialong & Yang, Zhaojun & Wang, Jili, 2022. "Adaptive structural reliability analysis method based on confidence interval squeezing," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    11. Zhang, Jinhao & Xiao, Mi & Gao, Liang, 2019. "An active learning reliability method combining Kriging constructed with exploration and exploitation of failure region and subset simulation," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 90-102.
    12. Dang, Chao & Wei, Pengfei & Faes, Matthias G.R. & Valdebenito, Marcos A. & Beer, Michael, 2022. "Parallel adaptive Bayesian quadrature for rare event estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    13. Yang, Seonghyeok & Jo, Hwisang & Lee, Kyungeun & Lee, Ikjin, 2022. "Expected system improvement (ESI): A new learning function for system reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    14. Saraygord Afshari, Sajad & Enayatollahi, Fatemeh & Xu, Xiangyang & Liang, Xihui, 2022. "Machine learning-based methods in structural reliability analysis: A review," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    15. Xiao, Sinan & Oladyshkin, Sergey & Nowak, Wolfgang, 2020. "Reliability analysis with stratified importance sampling based on adaptive Kriging," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Bohua & Wang, Weigang & Lei, Haoran & Hu, Xiancun & Li, Chun-Qing, 2024. "An improved analytical solution to outcrossing rate for scalar nonstationary and non-gaussian processes," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    2. Pei, Pei & Zhou, Tong, 2023. "One-step look-ahead policy for active learning reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    3. Zhou, Tong & Guo, Tong & Dong, You & Yang, Fan & Frangopol, Dan M., 2024. "Look-ahead active learning reliability analysis based on stepwise margin reduction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    4. Wang, Jinsheng & Xu, Guoji & Yuan, Peng & Li, Yongle & Kareem, Ahsan, 2024. "An efficient and versatile Kriging-based active learning method for structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    5. Hong, Fangqi & Wei, Pengfei & Fu, Jiangfeng & Beer, Michael, 2024. "A sequential sampling-based Bayesian numerical method for reliability-based design optimization," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    6. Chang, Leilei & Zhang, Limao & Xu, Xiaobin, 2023. "Causality-based multi-model ensemble learning for safety assessment in metro tunnel construction," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    7. Song, Jingwen & Cui, Yifan & Wei, Pengfei & Valdebenito, Marcos A. & Zhang, Weihong, 2024. "Constrained Bayesian optimization algorithms for estimating design points in structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 241(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xin, Fukang & Wang, Pan & Wang, Qirui & Li, Lei & Cheng, Lei & Lei, Huajin & Ma, Fangyun, 2024. "Parallel adaptive ensemble of metamodels combined with hypersphere sampling for rare failure events," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    2. Dhulipala, Somayajulu L.N. & Shields, Michael D. & Chakroborty, Promit & Jiang, Wen & Spencer, Benjamin W. & Hales, Jason D. & Labouré, Vincent M. & Prince, Zachary M. & Bolisetti, Chandrakanth & Che, 2022. "Reliability estimation of an advanced nuclear fuel using coupled active learning, multifidelity modeling, and subset simulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    3. Teixeira, Rui & Martinez-Pastor, Beatriz & Nogal, Maria & O’Connor, Alan, 2021. "Reliability analysis using a multi-metamodel complement-basis approach," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    4. Zhang, Jinhao & Gao, Liang & Xiao, Mi, 2020. "A composite-projection-outline-based approximation method for system reliability analysis with hybrid uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    5. Huang, Shi-Ya & Zhang, Shao-He & Liu, Lei-Lei, 2022. "A new active learning Kriging metamodel for structural system reliability analysis with multiple failure modes," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    6. Li, Guofa & Wang, Tianzhe & Chen, Zequan & He, Jialong & Wang, Xiaoye & Du, Xuejiao, 2023. "RBIK-SS: A parallel adaptive structural reliability analysis method for rare failure events," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    7. Dong, Manman & Cheng, Yongbo & Wan, Liangqi, 2024. "A new adaptive multi-kernel relevance vector regression for structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    8. Chen, Jiahui & Chen, Zhicheng & Xu, Yang & Li, Hui, 2021. "Efficient reliability analysis combining kriging and subset simulation with two-stage convergence criterion," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    9. Wang, Lei & Hu, Zhuo & Dang, Chao & Beer, Michael, 2024. "Refined parallel adaptive Bayesian quadrature for estimating small failure probabilities," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    10. Wang, Run-Zi & Gu, Hang-Hang & Zhu, Shun-Peng & Li, Kai-Shang & Wang, Ji & Wang, Xiao-Wei & Hideo, Miura & Zhang, Xian-Cheng & Tu, Shan-Tung, 2022. "A data-driven roadmap for creep-fatigue reliability assessment and its implementation in low-pressure turbine disk at elevated temperatures," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    11. Xiao, Mi & Zhang, Jinhao & Gao, Liang, 2020. "A system active learning Kriging method for system reliability-based design optimization with a multiple response model," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    12. Wang, Jinsheng & Xu, Guoji & Yuan, Peng & Li, Yongle & Kareem, Ahsan, 2024. "An efficient and versatile Kriging-based active learning method for structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    13. Song, Kunling & Zhang, Yugang & Shen, Linjie & Zhao, Qingyan & Song, Bifeng, 2021. "A failure boundary exploration and exploitation framework combining adaptive Kriging model and sample space partitioning strategy for efficient reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    14. Xu, Jun & Song, Jinheng & Yu, Quanfu & Kong, Fan, 2023. "Generalized distribution reconstruction based on the inversion of characteristic function curve for structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    15. Chengning Zhou & Ning-Cong Xiao & Ming J Zuo & Xiaoxu Huang, 2020. "AK-PDF: An active learning method combining kriging and probability density function for efficient reliability analysis," Journal of Risk and Reliability, , vol. 234(3), pages 536-549, June.
    16. Jiang, Chen & Qiu, Haobo & Yang, Zan & Chen, Liming & Gao, Liang & Li, Peigen, 2019. "A general failure-pursuing sampling framework for surrogate-based reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 47-59.
    17. Keshtegar, Behrooz & Chakraborty, Subrata, 2018. "An efficient-robust structural reliability method by adaptive finite-step length based on Armijo line search," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 195-206.
    18. Li, Peiping & Wang, Yu, 2022. "An active learning reliability analysis method using adaptive Bayesian compressive sensing and Monte Carlo simulation (ABCS-MCS)," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    19. Ni, Pinghe & Li, Jun & Hao, Hong & Yan, Weimin & Du, Xiuli & Zhou, Hongyuan, 2020. "Reliability analysis and design optimization of nonlinear structures," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    20. Teixeira, Rui & Nogal, Maria & O’Connor, Alan & Martinez-Pastor, Beatriz, 2020. "Reliability assessment with density scanned adaptive Kriging," Reliability Engineering and System Safety, Elsevier, vol. 199(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:231:y:2023:i:c:s0951832022005865. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.