IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v253y2025ics0951832024006124.html
   My bibliography  Save this article

A closed-form continuous-depth neural-based hybrid difference features re-representation network for RUL prediction

Author

Listed:
  • Li, Xuanlin
  • Hu, Yawei
  • Wang, Hang
  • Liu, Yongbin
  • Liu, Xianzeng
  • Lu, Huitian

Abstract

Remaining Useful Life (RUL) prediction contributes to ensuring the reliability of mechanical systems and improving their maintenance plans. Recently, prediction methods based on deep learning have undergone rapid development. However, there are significant differences between multivariate monitoring sequences and utilizing a single model for feature extraction, which leads to reaching suboptimization. Additionally, focusing solely on a specific feature dimension usually imposes notable limitations on the model. This paper proposes a Closed-form Continuous-depth neural (CfC)-based hybrid difference Features Re-representation Network (CfC-F2RN) for RUL prediction. This method comprehensively utilizes hybrid difference features through two stages: initial feature representation and feature re-representation. In the initial feature representation stage, a Long Short-Term Memory (LSTM) is employed to capture the hidden state information of each time step in sequence data. Next, a novel attention mechanism is utilized to extract the hidden states and obtain a deep feature map. In the feature re-representation stage, the encoded features are re-represented using a decoder composed of the CfC model. Finally, the hidden state of the last LSTM unit in the encoder, serving as supplementary information, is combined with the decoded features to form a dual-latent feature representation of the mixed differential features. The prediction subnetwork is then adopted to accomplish RUL prediction. The superiority of CfC-F2RN is substantiated through benchmarking against established methods using the C-MAPSS dataset.

Suggested Citation

  • Li, Xuanlin & Hu, Yawei & Wang, Hang & Liu, Yongbin & Liu, Xianzeng & Lu, Huitian, 2025. "A closed-form continuous-depth neural-based hybrid difference features re-representation network for RUL prediction," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
  • Handle: RePEc:eee:reensy:v:253:y:2025:i:c:s0951832024006124
    DOI: 10.1016/j.ress.2024.110540
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024006124
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110540?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Wei & Li, Xiang & Ma, Hui & Luo, Zhong & Li, Xu, 2021. "Transfer learning using deep representation regularization in remaining useful life prediction across operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    2. Wang, Jiaolong & Zhang, Fode & Zhang, Jianchuan & Liu, Wen & Zhou, Kuang, 2023. "A flexible RUL prediction method based on poly-cell LSTM with applications to lithium battery data," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    3. Shi, Jiayu & Zhong, Jingshu & Zhang, Yuxuan & Xiao, Bin & Xiao, Lei & Zheng, Yu, 2024. "A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    4. Xiang, Sheng & Qin, Yi & Liu, Fuqiang & Gryllias, Konstantinos, 2022. "Automatic multi-differential deep learning and its application to machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    5. Xiang, Sheng & Qin, Yi & Luo, Jun & Pu, Huayan & Tang, Baoping, 2021. "Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    6. Xu, Danyang & Qiu, Haobo & Gao, Liang & Yang, Zan & Wang, Dapeng, 2022. "A novel dual-stream self-attention neural network for remaining useful life estimation of mechanical systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    7. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Jiang, Yuchen & Luo, Hao & Yin, Shen, 2023. "A variational local weighted deep sub-domain adaptation network for remaining useful life prediction facing cross-domain condition," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    8. Xia, Jun & Feng, Yunwen & Teng, Da & Chen, Junyu & Song, Zhicen, 2022. "Distance self-attention network method for remaining useful life estimation of aeroengine with parallel computing," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    9. Huang, Zhifu & Yang, Yang & Hu, Yawei & Ding, Xiang & Li, Xuanlin & Liu, Yongbin, 2023. "Attention-augmented recalibrated and compensatory network for machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    10. Wang, Yuan & Lei, Yaguo & Li, Naipeng & Yan, Tao & Si, Xiaosheng, 2023. "Deep multisource parallel bilinear-fusion network for remaining useful life prediction of machinery," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    11. Dong, Shaojiang & Xiao, Jiafeng & Hu, Xiaolin & Fang, Nengwei & Liu, Lanhui & Yao, Jinbao, 2023. "Deep transfer learning based on Bi-LSTM and attention for remaining useful life prediction of rolling bearing," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    12. Zhou, Liang & Wang, Huawei & Xu, Shanshan, 2023. "Aero-engine prognosis strategy based on multi-scale feature fusion and multi-task parallel learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    13. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    14. Zhao, Zeqi & Bin Liang, & Wang, Xueqian & Lu, Weining, 2017. "Remaining useful life prediction of aircraft engine based on degradation pattern learning," Reliability Engineering and System Safety, Elsevier, vol. 164(C), pages 74-83.
    15. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    16. Cao, Lixiao & Zhang, Hongyu & Meng, Zong & Wang, Xueping, 2023. "A parallel GRU with dual-stage attention mechanism model integrating uncertainty quantification for probabilistic RUL prediction of wind turbine bearings," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    17. Wei, Yupeng & Wu, Dazhong, 2023. "Prediction of state of health and remaining useful life of lithium-ion battery using graph convolutional network with dual attention mechanisms," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. Yang, Jing & Wang, Xiaomin, 2024. "Meta-learning with deep flow kernel network for few shot cross-domain remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    19. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    20. Keshun, You & Guangqi, Qiu & Yingkui, Gu, 2024. "Optimizing prior distribution parameters for probabilistic prediction of remaining useful life using deep learning," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    21. Zhang, Yuru & Su, Chun & Wu, Jiajun & Liu, Hao & Xie, Mingjiang, 2024. "Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    2. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    3. Kim, Gyeongho & Kang, Yun Seok & Yang, Sang Min & Choi, Jae Gyeong & Hwang, Gahyun & Park, Hyung Wook & Lim, Sunghoon, 2025. "Fisher-informed continual learning for remaining useful life prediction of machining tools under varying operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    4. Wang, Wei & Song, Honghao & Si, Shubin & Lu, Wenhao & Cai, Zhiqiang, 2024. "Data augmentation based on diffusion probabilistic model for remaining useful life estimation of aero-engines," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    5. Xiao, Dasheng & Lin, Zhifu & Yu, Aiyang & Tang, Ke & Xiao, Hong, 2024. "Data-driven method embedded physical knowledge for entire lifecycle degradation monitoring in aircraft engines," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    6. Wu, Jinxin & He, Deqiang & Li, Jiayi & Miao, Jian & Li, Xianwang & Li, Hongwei & Shan, Sheng, 2024. "Temporal multi-resolution hypergraph attention network for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    7. González-Muñiz, Ana & Díaz, Ignacio & Cuadrado, Abel A. & García-Pérez, Diego, 2022. "Health indicator for machine condition monitoring built in the latent space of a deep autoencoder," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    8. Zhang, Yuru & Su, Chun & Wu, Jiajun & Liu, Hao & Xie, Mingjiang, 2024. "Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    9. Xu, Zhiqiang & Zhang, Yujie & Miao, Qiang, 2024. "An attention-based multi-scale temporal convolutional network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    10. Fu, En & Hu, Yanyan & Peng, Kaixiang & Chu, Yuxin, 2024. "Supervised contrastive learning based dual-mixer model for Remaining Useful Life prediction," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    11. Yan, Jianhai & Ye, Zhi-Sheng & He, Shuguang & He, Zhen, 2024. "A feature disentanglement and unsupervised domain adaptation of remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    12. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    13. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    14. Zheng, Yu & Chen, Liang & Bao, Xiangyu & Zhao, Fei & Zhong, Jingshu & Wang, Chenhan, 2025. "Prediction model optimization of gas turbine remaining useful life based on transfer learning and simultaneous distillation pruning algorithm," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    15. Zhu, Ting & Chen, Zhen & Zhou, Di & Xia, Tangbin & Pan, Ershun, 2024. "Adaptive staged remaining useful life prediction of roller in a hot strip mill based on multi-scale LSTM with multi-head attention," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    16. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang & Xu, Kun, 2023. "Remaining useful life prediction combined dynamic model with transfer learning under insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    17. Chen, Dingliang & Qin, Yi & Qian, Quan & Wang, Yi & Liu, Fuqiang, 2023. "Transfer life prediction of gears by cross-domain health indicator construction and multi-hierarchical long-term memory augmented network," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. Zhou, Zhihao & Zhang, Wei & Yao, Peng & Long, Zhenhua & Bai, Mingling & Liu, Jinfu & Yu, Daren, 2024. "More realistic degradation trend prediction for gas turbine based on factor analysis and multiple penalty mechanism loss function," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    19. Xiang, Sheng & Li, Penghua & Huang, Yi & Luo, Jun & Qin, Yi, 2024. "Single gated RNN with differential weighted information storage mechanism and its application to machine RUL prediction," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    20. Basora, Luis & Viens, Arthur & Chao, Manuel Arias & Olive, Xavier, 2025. "A benchmark on uncertainty quantification for deep learning prognostics," Reliability Engineering and System Safety, Elsevier, vol. 253(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:253:y:2025:i:c:s0951832024006124. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.