IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v243y2024ics0951832023007366.html
   My bibliography  Save this article

Physics-guided recurrent neural network trained with approximate Bayesian computation: A case study on structural response prognostics

Author

Listed:
  • Fernández, Juan
  • Chiachío, Juan
  • Barros, José
  • Chiachío, Manuel
  • Kulkarni, Chetan S.

Abstract

A new physics-guided Bayesian recurrent neural network is proposed in this manuscript. This hybrid algorithm benefits from the knowledge in physics-based models, the capability of recurrent neural networks to handle sequential data, and the flexibility of Bayesian methods to quantify the uncertainty. The introduction of physics in the forward pass of the neural network significantly improves the results in multistep-ahead forecasting, and the gradient-free nature of the Bayesian learning engine provides great flexibility to adapt to the observed data. The proposed algorithm has been applied to a data-driven problem about fatigue in composites, and a case study about accelerations in concrete buildings, where a comparison against the state-of-the-art algorithms is also provided. The results revealed: (1) the accuracy of the proposals, comparable to the state-of-the-art recurrent neural networks; (2) its stability during multiple runs of the algorithm, proving that it is a more reliable option; (3) its precise quantification of the uncertainty, which provides useful information for the subsequent decision-making process. As potential future applications to real world scenarios, the proposed Bayesian recurrent neural network could be used in on-board PHM systems in the aerospace industry, or as an on-site prediction tool in buildings for seismic events and/or aftershocks.

Suggested Citation

  • Fernández, Juan & Chiachío, Juan & Barros, José & Chiachío, Manuel & Kulkarni, Chetan S., 2024. "Physics-guided recurrent neural network trained with approximate Bayesian computation: A case study on structural response prognostics," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
  • Handle: RePEc:eee:reensy:v:243:y:2024:i:c:s0951832023007366
    DOI: 10.1016/j.ress.2023.109822
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023007366
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109822?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andrew White & Malachi Tolman & Howard D Thames & Hubert Rodney Withers & Kathy A Mason & Mark K Transtrum, 2016. "The Limitations of Model-Based Experimental Design and Parameter Estimation in Sloppy Systems," PLOS Computational Biology, Public Library of Science, vol. 12(12), pages 1-26, December.
    2. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    3. Wang, Chu & Dou, Manfeng & Li, Zhongliang & Outbib, Rachid & Zhao, Dongdong & Zuo, Jian & Wang, Yuanlin & Liang, Bin & Wang, Peng, 2023. "Data-driven prognostics based on time-frequency analysis and symbolic recurrent neural network for fuel cells under dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    4. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    5. Pan, Yongjun & Sun, Yu & Li, Zhixiong & Gardoni, Paolo, 2023. "Machine learning approaches to estimate suspension parameters for performance degradation assessment using accurate dynamic simulations," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    6. Fan, Xudong & Zhang, Xijin & Yu, Xiong Bill, 2023. "Uncertainty quantification of a deep learning model for failure rate prediction of water distribution networks," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    7. Cao, Lixiao & Zhang, Hongyu & Meng, Zong & Wang, Xueping, 2023. "A parallel GRU with dual-stage attention mechanism model integrating uncertainty quantification for probabilistic RUL prediction of wind turbine bearings," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    8. Li, Zhanhang & Zhou, Jian & Nassif, Hani & Coit, David & Bae, Jinwoo, 2023. "Fusing physics-inferred information from stochastic model with machine learning approaches for degradation prediction," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    9. Ma, Zhonghai & Liao, Haitao & Gao, Jianhang & Nie, Songlin & Geng, Yugang, 2023. "Physics-Informed Machine Learning for Degradation Modeling of an Electro-Hydrostatic Actuator System," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    10. Miele, S. & Karve, P. & Mahadevan, S., 2023. "Multi-fidelity physics-informed machine learning for probabilistic damage diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    11. repec:dau:papers:123456789/5724 is not listed on IDEAS
    12. Hazra, Indranil & Pandey, Mahesh D. & Manzana, Noldainerick, 2020. "Approximate Bayesian computation (ABC) method for estimating parameters of the gamma process using noisy data," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guan, Yu & Li, Wei & Kozak, Drazan & Zhao, Junfeng, 2024. "Response and reliability analysis of a nonlinear VEH systems with FOPID controller by improved stochastic averaging method and LBFNN algorithm," Reliability Engineering and System Safety, Elsevier, vol. 249(C).
    2. Song, Chaolin & Xiao, Rucheng & Zhang, Chi & Zhao, Xinwei & Sun, Bo, 2024. "Simulation-free reliability analysis with importance sampling-based adaptive training physics-informed neural networks: Method and application to chloride penetration," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    3. Pan, Junlin & Sun, Bo & Wu, Zeyu & Yi, Zechen & Feng, Qiang & Ren, Yi & Wang, Zili, 2024. "Probabilistic remaining useful life prediction without lifetime labels: A Bayesian deep learning and stochastic process fusion method," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    4. Chen, Edward & Bao, Han & Dinh, Nam, 2024. "Evaluating the reliability of machine-learning-based predictions used in nuclear power plant instrumentation and control systems," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    5. Qiao, Yajing & Wang, Shaoping & Shi, Jian & Liu, Di & Tao, Mo, 2024. "Reliability model based on fault energy dissipation for mechatronic system," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    6. Li, Long & Xu, Jun & Kuok, Sin-Chi, 2024. "Bayesian sparse grid (BSG) approach for information salvage in reliability assessment of deteriorating structures," Reliability Engineering and System Safety, Elsevier, vol. 251(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang, Shilong & Tang, Baoping & Wang, Weiying & Yang, Qichao & Hu, Cheng, 2024. "Physics-informed multi-state temporal frequency network for RUL prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    2. Oster, Matthew R. & King, Ethan & Bakker, Craig & Bhattacharya, Arnab & Chatterjee, Samrat & Pan, Feng, 2023. "Multi-level optimization with the koopman operator for data-driven, domain-aware, and dynamic system security," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    3. Barui, Sandip & Mitra, Debanjan & Balakrishnan, Narayanaswamy, 2024. "Flexible modelling of a bivariate degradation process with a shared frailty and an application to fatigue crack data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    4. Xu, Xiaodong & Tang, Shengjin & Han, Xuebing & Lu, Languang & Wu, Yu & Yu, Chuanqiang & Sun, Xiaoyan & Xie, Jian & Feng, Xuning & Ouyang, Minggao, 2023. "Fast capacity prediction of lithium-ion batteries using aging mechanism-informed bidirectional long short-term memory network," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    5. Grazzini, Jakob & Richiardi, Matteo G. & Tsionas, Mike, 2017. "Bayesian estimation of agent-based models," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 26-47.
    6. D.T. Frazier & G.M. Martin & C.P. Robert & J. Rousseau, 2016. "Asymptotic Properties of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 18/16, Monash University, Department of Econometrics and Business Statistics.
    7. Xing Ju Lee & Christopher C. Drovandi & Anthony N. Pettitt, 2015. "Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets," Biometrics, The International Biometric Society, vol. 71(1), pages 198-207, March.
    8. McKinley, Trevelyan J. & Ross, Joshua V. & Deardon, Rob & Cook, Alex R., 2014. "Simulation-based Bayesian inference for epidemic models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 434-447.
    9. Li, J. & Nott, D.J. & Fan, Y. & Sisson, S.A., 2017. "Extending approximate Bayesian computation methods to high dimensions via a Gaussian copula model," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 77-89.
    10. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    11. Phan, Hieu Chi & Dhar, Ashutosh Sutra & Bui, Nang Duc, 2023. "Reliability assessment of pipelines crossing strike-slip faults considering modeling uncertainties using ANN models," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    12. Pierre-Olivier Goffard & Patrick Laub, 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Working Papers hal-02891046, HAL.
    13. Bertl Johanna & Ewing Gregory & Kosiol Carolin & Futschik Andreas, 2017. "Approximate maximum likelihood estimation for population genetic inference," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 16(5-6), pages 291-312, December.
    14. Zuo, Jian & Cadet, Catherine & Li, Zhongliang & Bérenguer, Christophe & Outbib, Rachid, 2024. "A deterioration-aware energy management strategy for the lifetime improvement of a multi-stack fuel cell system subject to a random dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    15. Florian Maire & Nial Friel & Pierre ALQUIER, 2017. "Informed Sub-Sampling MCMC: Approximate Bayesian Inference for Large Datasets," Working Papers 2017-40, Center for Research in Economics and Statistics.
    16. Perepolkin, Dmytro & Goodrich, Benjamin & Sahlin, Ullrika, 2023. "The tenets of quantile-based inference in Bayesian models," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    17. Patrick L. McDermott & Christopher K. Wikle & Joshua Millspaugh, 2017. "Hierarchical Nonlinear Spatio-temporal Agent-Based Models for Collective Animal Movement," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 22(3), pages 294-312, September.
    18. Anthony Ebert & Ritabrata Dutta & Kerrie Mengersen & Antonietta Mira & Fabrizio Ruggeri & Paul Wu, 2021. "Likelihood‐free parameter estimation for dynamic queueing networks: Case study of passenger flow in an international airport terminal," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(3), pages 770-792, June.
    19. Stefano Cabras & María Castellanos & Erlis Ruli, 2014. "A Quasi likelihood approximation of posterior distributions for likelihood-intractable complex models," METRON, Springer;Sapienza Università di Roma, vol. 72(2), pages 153-167, August.
    20. Espen Bernton & Pierre E. Jacob & Mathieu Gerber & Christian P. Robert, 2019. "Approximate Bayesian computation with the Wasserstein distance," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 235-269, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:243:y:2024:i:c:s0951832023007366. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.