IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v252y2024ics0951832024005003.html
   My bibliography  Save this article

A core space gradient projection-based continual learning framework for remaining useful life prediction of machinery under variable operating conditions

Author

Listed:
  • Ren, Xiangyu
  • Qin, Yong
  • Li, Bin
  • Wang, Biao
  • Yi, Xiaojian
  • Jia, Limin

Abstract

Recently, continual learning has received particular attention in machinery remaining useful life (RUL) prediction, which enables prognostics networks to gradually improve performance without laborious retraining. Existing studies, however, have the following limitations: 1) The impacts of variable operating conditions are not explicitly considered during continual learning. 2) The continual learnability of prognostics network is limited by the lack of knowledge compression and de-redundancy. To overcome the abovementioned limitations, a novel continual learning framework is proposed for RUL prediction of machinery under variable operating conditions. First, a multi-kernel swarm convolution block is devised to automatically capture degradation features during continual learning without increasing computational consumption, which combines convolutional operations at various scales and focuses attention on appropriate scales based on operating condition information. Then, core space gradient projection is proposed for continual learning of prognostics networks, which mitigates forgetting by guiding gradient descent along the orthogonal direction of the previously input subspace. This approach also ensures the network learnability during continual learning by knowledge compression and de-redundancy to identify core space. The proposed framework is verified using accelerated degradation datasets of rolling element bearings with variable operating conditions. Experimental results show that the proposed framework is superior to some existing continual learning-based prognostics approaches for RUL prediction under variable operating conditions.

Suggested Citation

  • Ren, Xiangyu & Qin, Yong & Li, Bin & Wang, Biao & Yi, Xiaojian & Jia, Limin, 2024. "A core space gradient projection-based continual learning framework for remaining useful life prediction of machinery under variable operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
  • Handle: RePEc:eee:reensy:v:252:y:2024:i:c:s0951832024005003
    DOI: 10.1016/j.ress.2024.110428
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024005003
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110428?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shi, Jiayu & Zhong, Jingshu & Zhang, Yuxuan & Xiao, Bin & Xiao, Lei & Zheng, Yu, 2024. "A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    2. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    3. Li, Naipeng & Wang, Mingyang & Lei, Yaguo & Si, Xiaosheng & Yang, Bin & Li, Xiang, 2024. "A nonparametric degradation modeling method for remaining useful life prediction with fragment data," Reliability Engineering and System Safety, Elsevier, vol. 249(C).
    4. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    5. Fu, Song & Zhang, Yongjian & Lin, Lin & Zhao, Minghang & Zhong, Shi-sheng, 2021. "Deep residual LSTM with domain-invariance for remaining useful life prediction across domains," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    6. Li, Yuan & Li, Jingwei & Wang, Huanjie & Liu, Chengbao & Tan, Jie, 2024. "Knowledge enhanced ensemble method for remaining useful life prediction under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    7. Liu, Jie & Hou, Bingchang & Lu, Ming & Wang, Dong, 2024. "Box-Cox transformation based state-space modeling as a unified prognostic framework for degradation linearization and RUL prediction enhancement," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    8. Kong, Ziqian & Jin, Xiaohang & Xu, Zhengguo & Chen, Zian, 2023. "A contrastive learning framework enhanced by unlabeled samples for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    9. Li, Xiang & Zhang, Wei & Ding, Qian, 2019. "Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction," Reliability Engineering and System Safety, Elsevier, vol. 182(C), pages 208-218.
    10. Xia, Tangbin & Dong, Yifan & Xiao, Lei & Du, Shichang & Pan, Ershun & Xi, Lifeng, 2018. "Recent advances in prognostics and health management for advanced manufacturing paradigms," Reliability Engineering and System Safety, Elsevier, vol. 178(C), pages 255-268.
    11. Zhang, Huixin & Xi, Xiaopeng & Pan, Rong, 2023. "A two-stage data-driven approach to remaining useful life prediction via long short-term memory networks," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    12. Zhang, Yuru & Su, Chun & Wu, Jiajun & Liu, Hao & Xie, Mingjiang, 2024. "Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Wei & Song, Honghao & Si, Shubin & Lu, Wenhao & Cai, Zhiqiang, 2024. "Data augmentation based on diffusion probabilistic model for remaining useful life estimation of aero-engines," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    2. Kim, Gyeongho & Kang, Yun Seok & Yang, Sang Min & Choi, Jae Gyeong & Hwang, Gahyun & Park, Hyung Wook & Lim, Sunghoon, 2025. "Fisher-informed continual learning for remaining useful life prediction of machining tools under varying operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    3. Liang, Tao & Wang, Fuli & Wang, Shu & Li, Kang & Mo, Xuelei & Lu, Di, 2024. "Machinery health prognostic with uncertainty for mineral processing using TSC-TimeGAN," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    4. Fu, En & Hu, Yanyan & Peng, Kaixiang & Chu, Yuxin, 2024. "Supervised contrastive learning based dual-mixer model for Remaining Useful Life prediction," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    5. Yi Lyu & Qichen Zhang & Zhenfei Wen & Aiguo Chen, 2022. "Remaining Useful Life Prediction Based on Multi-Representation Domain Adaptation," Mathematics, MDPI, vol. 10(24), pages 1-18, December.
    6. Wang, Chu & Dou, Manfeng & Li, Zhongliang & Outbib, Rachid & Zhao, Dongdong & Zuo, Jian & Wang, Yuanlin & Liang, Bin & Wang, Peng, 2023. "Data-driven prognostics based on time-frequency analysis and symbolic recurrent neural network for fuel cells under dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    7. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Zheng, Yu & Chen, Liang & Bao, Xiangyu & Zhao, Fei & Zhong, Jingshu & Wang, Chenhan, 2025. "Prediction model optimization of gas turbine remaining useful life based on transfer learning and simultaneous distillation pruning algorithm," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    9. Zhan, Yuling & Kong, Ziqian & Wang, Ziqi & Jin, Xiaohang & Xu, Zhengguo, 2024. "Remaining useful life prediction with uncertainty quantification based on multi-distribution fusion structure," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    10. Zhu, Ting & Chen, Zhen & Zhou, Di & Xia, Tangbin & Pan, Ershun, 2024. "Adaptive staged remaining useful life prediction of roller in a hot strip mill based on multi-scale LSTM with multi-head attention," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    11. Wang, Chen & Zhang, Liming & Chen, Ling & Tan, Tian & Zhang, Cong, 2025. "Remaining useful life prediction of nuclear reactor control rod drive mechanism based on dynamic temporal convolutional network," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    12. Han, Yaoyao & Ding, Xiaoxi & Gu, Fengshou & Chen, Xiaohui & Xu, Minmin, 2025. "Dual-drive RUL prediction of gear transmission systems based on dynamic model and unsupervised domain adaption under zero sample," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    13. Xu, Yuhui & Xia, Tangbin & Jiang, Yimin & Wang, Yu & Wang, Dong & Pan, Ershun & Xi, Lifeng, 2024. "A temporal partial domain adaptation network for transferable prognostics across working conditions with insufficient data," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    14. Ding, Yifei & Jia, Minping & Zhuang, Jichao & Cao, Yudong & Zhao, Xiaoli & Lee, Chi-Guhn, 2023. "Deep imbalanced domain adaptation for transfer learning fault diagnosis of bearings under multiple working conditions," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    15. Guan, Yang & Meng, Zong & Sun, Dengyun & Liu, Jingbo & Fan, Fengjie, 2021. "2MNet: Multi-sensor and multi-scale model toward accurate fault diagnosis of rolling bearing," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    16. Park, Chan Hee & Kim, Hyeongmin & Suh, Chaehyun & Chae, Minseok & Yoon, Heonjun & Youn, Byeng D., 2022. "A health image for deep learning-based fault diagnosis of a permanent magnet synchronous motor under variable operating conditions: Instantaneous current residual map," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    17. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang & Xu, Kun, 2023. "Remaining useful life prediction combined dynamic model with transfer learning under insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    18. Li, Xuanlin & Hu, Yawei & Wang, Hang & Liu, Yongbin & Liu, Xianzeng & Lu, Huitian, 2025. "A closed-form continuous-depth neural-based hybrid difference features re-representation network for RUL prediction," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    19. Yang, Jing & Wang, Xiaomin, 2024. "Meta-learning with deep flow kernel network for few shot cross-domain remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    20. Ma, Zhonghai & Liao, Haitao & Gao, Jianhang & Nie, Songlin & Geng, Yugang, 2023. "Physics-Informed Machine Learning for Degradation Modeling of an Electro-Hydrostatic Actuator System," Reliability Engineering and System Safety, Elsevier, vol. 229(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:252:y:2024:i:c:s0951832024005003. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.