IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v228y2022ics0951832022003817.html
   My bibliography  Save this article

Bayesian deep-learning for RUL prediction: An active learning perspective

Author

Listed:
  • Zhu, Rong
  • Chen, Yuan
  • Peng, Weiwen
  • Ye, Zhi-Sheng

Abstract

Deep learning (DL) has been intensively exploited for remaining useful life (RUL) prediction in the recent decade. Although with high precision and flexibility, DL methods need sufficient run-to-failure data to guarantee their performance. However, run-to-failure data is fairly expensive to obtain in many industrial applications. How to economically achieve high accuracy with few run-to-failure data becomes a critical and emergent issue. In this study, a Bayesian deep-active-learning framework is proposed for RUL prediction, which goes beyond traditional passive learning and introduces a novel active learning perspective. We use Bayesian neural networks with Monte Carlo dropout inference to predict RUL with uncertainty quantification for samples without run-to-failure labels. The prediction uncertainty is further used to develop an acquisition function for actively selecting target samples to obtain their run-to-failure labels. A recursive model training and active data selection mechanism are then developed to maintain accuracy while reducing the size of the training data. Two practical examples, one from a public bearing dataset and the other from our lab testing on battery degradation, are presented to demonstrate the proposed method. Experimental results demonstrate that 20 and 40% of run-to-failure data can be saved for the bearing and the battery RUL prediction, respectively.

Suggested Citation

  • Zhu, Rong & Chen, Yuan & Peng, Weiwen & Ye, Zhi-Sheng, 2022. "Bayesian deep-learning for RUL prediction: An active learning perspective," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
  • Handle: RePEc:eee:reensy:v:228:y:2022:i:c:s0951832022003817
    DOI: 10.1016/j.ress.2022.108758
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832022003817
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2022.108758?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    2. Zheng, Linfeng & Zhang, Lei & Zhu, Jianguo & Wang, Guoxiu & Jiang, Jiuchun, 2016. "Co-estimation of state-of-charge, capacity and resistance for lithium-ion batteries based on a high-fidelity electrochemical model," Applied Energy, Elsevier, vol. 180(C), pages 424-434.
    3. Li, Tianfu & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    4. Yang, Yixin, 2021. "A machine-learning prediction method of lithium-ion battery life based on charge process for different applications," Applied Energy, Elsevier, vol. 292(C).
    5. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    6. Li, Xiang & Zhang, Wei & Ding, Qian, 2019. "Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 208-218.
    7. Peter M. Attia & Aditya Grover & Norman Jin & Kristen A. Severson & Todor M. Markov & Yang-Hung Liao & Michael H. Chen & Bryan Cheong & Nicholas Perkins & Zi Yang & Patrick K. Herring & Muratahan Ayko, 2020. "Closed-loop optimization of fast-charging protocols for batteries with machine learning," Nature, Nature, vol. 578(7795), pages 397-402, February.
    8. Xiang, Sheng & Qin, Yi & Luo, Jun & Pu, Huayan & Tang, Baoping, 2021. "Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    9. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    10. Lin, Chun-Pang & Cabrera, Javier & Yang, Fangfang & Ling, Man-Ho & Tsui, Kwok-Leung & Bae, Suk-Joo, 2020. "Battery state of health modeling and remaining useful life prediction through time series model," Applied Energy, Elsevier, vol. 275(C).
    11. Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    12. Xiang, Sheng & Qin, Yi & Liu, Fuqiang & Gryllias, Konstantinos, 2022. "Automatic multi-differential deep learning and its application to machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    13. Cao, Yudong & Ding, Yifei & Jia, Minping & Tian, Rushuai, 2021. "A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lin, Yan-Hui & Chang, Liang & Guan, Lu-Xin, 2024. "Enhanced stochastic recurrent hybrid model for RUL Predictions via Semi-supervised learning," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    2. Keshun, You & Guangqi, Qiu & Yingkui, Gu, 2024. "Optimizing prior distribution parameters for probabilistic prediction of remaining useful life using deep learning," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    3. He, Jiabei & Wu, Lifeng, 2023. "Cross-conditions capacity estimation of lithium-ion battery with constrained adversarial domain adaptation," Energy, Elsevier, vol. 277(C).
    4. Dehghan Shoorkand, Hassan & Nourelfath, Mustapha & Hajji, Adnène, 2024. "A hybrid CNN-LSTM model for joint optimization of production and imperfect predictive maintenance planning," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    5. Wang, Jian & Gao, Shibin & Yu, Long & Zhang, Dongkai & Xie, Chenlin & Chen, Ke & Kou, Lei, 2023. "Data-driven lightning-related failure risk prediction of overhead contact lines based on Bayesian network with spatiotemporal fragility model," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    6. Sun, Bin & Li, Yan & Zhang, Yangyang & Guo, Tong, 2024. "Multi-source heterogeneous data fusion prediction technique for the utility tunnel fire detection," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    7. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    8. Meng, Fanbing & Yang, Fangfang & Yang, Jun & Xie, Min, 2023. "A power model considering initial battery state for remaining useful life prediction of lithium-ion batteries," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    9. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    2. Huang, Zhifu & Yang, Yang & Hu, Yawei & Ding, Xiang & Li, Xuanlin & Liu, Yongbin, 2023. "Attention-augmented recalibrated and compensatory network for machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    3. Gao, Zhan & Jiang, Weixiong & Wu, Jun & Dai, Tianjiao & Zhu, Haiping, 2024. "Nonlinear slow-varying dynamics-assisted temporal graph transformer network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    4. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    5. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    6. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    7. Xiao, Dasheng & Lin, Zhifu & Yu, Aiyang & Tang, Ke & Xiao, Hong, 2024. "Data-driven method embedded physical knowledge for entire lifecycle degradation monitoring in aircraft engines," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    8. Chen, Dingliang & Qin, Yi & Qian, Quan & Wang, Yi & Liu, Fuqiang, 2023. "Transfer life prediction of gears by cross-domain health indicator construction and multi-hierarchical long-term memory augmented network," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    9. Zhou, Liang & Wang, Huawei & Xu, Shanshan, 2023. "Aero-engine prognosis strategy based on multi-scale feature fusion and multi-task parallel learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    10. Ardeshiri, Reza Rouhi & Liu, Ming & Ma, Chengbin, 2022. "Multivariate stacked bidirectional long short term memory for lithium-ion battery health management," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    11. de Pater, Ingeborg & Reijns, Arthur & Mitici, Mihaela, 2022. "Alarm-based predictive maintenance scheduling for aircraft engines with imperfect Remaining Useful Life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    12. Wei, Yupeng & Wu, Dazhong & Terpenny, Janis, 2024. "Remaining useful life prediction using graph convolutional attention networks with temporal convolution-aware nested residual connections," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    13. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    14. Yi Lyu & Qichen Zhang & Zhenfei Wen & Aiguo Chen, 2022. "Remaining Useful Life Prediction Based on Multi-Representation Domain Adaptation," Mathematics, MDPI, vol. 10(24), pages 1-18, December.
    15. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    16. Yang, Ningning & Wang, Zhijian & Cai, Wenan & Li, Yanfeng, 2023. "Data Regeneration Based on Multiple Degradation Processes for Remaining Useful Life Estimation," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    17. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    18. Huang, Xucong & Peng, Zhaoqin & Tang, Diyin & Chen, Juan & Zio, Enrico & Zheng, Zaiping, 2024. "A physics-informed autoencoder for system health state assessment based on energy-oriented system performance," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    19. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    20. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:228:y:2022:i:c:s0951832022003817. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.