IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v229y2023ics0951832022005038.html
   My bibliography  Save this article

Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning

Author

Listed:
  • Xu, Dan
  • Xiao, Xiaoqi
  • Liu, Jie
  • Sui, Shaobo

Abstract

Accurately predicting the Remaining Useful Life (RUL) is useful to avoid unexpected significant failure of engineering system and reduce maintenance costs effectively. Meanwhile, the diverse operating conditions and high-dimensional feature variables from diverse sensors spatially located in the system are two main obstacles for building an accurate and stable RUL prediction model. Considering that these two obstacles have not been fully considered in the state-of-art work, a novel RUL prediction method based on the improved Transformer model is proposed in this work, which resorts to the attention mechanism and deep learning considering spatio-temporal characteristics and multiple operating conditions. First, the difference of the original sequence data caused by operating conditions is eliminated by clustering and standardization in the data preprocessing process. The future condition information is also considered in RUL prediction calculation. Meanwhile, spatio-temporal feature is extracted by self-attention to realize the information fusion of multi-dimensional sensors and long-term series, in which position encoding is designed to retain the sequence information in the original sequence data. Finally, experimental results on the C-MAPSS and N-CMAPSS datasets show that the proposed method achieves a better performance compared with other existing methods.

Suggested Citation

  • Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
  • Handle: RePEc:eee:reensy:v:229:y:2023:i:c:s0951832022005038
    DOI: 10.1016/j.ress.2022.108886
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832022005038
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2022.108886?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Listou Ellefsen, André & Bjørlykhaug, Emil & Æsøy, Vilmar & Ushakov, Sergey & Zhang, Houxiang, 2019. "Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 240-251.
    2. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    3. Li, Xingyu & Krivtsov, Vasiliy & Arora, Karunesh, 2022. "Attention-based deep survival model for time series data," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    4. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    5. Han, Xiao & Wang, Zili & Xie, Min & He, Yihai & Li, Yao & Wang, Wenzhuo, 2021. "Remaining useful life prediction and predictive maintenance strategies for multi-state manufacturing systems considering functional dependence," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    6. Xiang, Sheng & Qin, Yi & Luo, Jun & Pu, Huayan & Tang, Baoping, 2021. "Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    7. Miao, Mengqi & Yu, Jianbo & Zhao, Zhihong, 2022. "A sparse domain adaption network for remaining useful life prediction of rolling bearings under different working conditions," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    8. Yu, Wennian & Kim, II Yong & Mechefske, Chris, 2020. "An improved similarity-based prognostic algorithm for RUL estimation using an RNN autoencoder scheme," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    9. Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    10. Yu Mo & Qianhui Wu & Xiu Li & Biqing Huang, 2021. "Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1997-2006, October.
    11. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    12. Li, Naipeng & Gebraeel, Nagi & Lei, Yaguo & Bian, Linkan & Si, Xiaosheng, 2019. "Remaining useful life prediction of machinery under time-varying operating conditions based on a two-factor state-space model," Reliability Engineering and System Safety, Elsevier, vol. 186(C), pages 88-100.
    13. Cao, Yudong & Ding, Yifei & Jia, Minping & Tian, Rushuai, 2021. "A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    14. Liu, Junqiang & Lei, Fan & Pan, Chunlu & Hu, Dongbin & Zuo, Hongfu, 2021. "Prediction of remaining useful life of multi-stage aero-engine based on clustering and LSTM fusion," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiang, Sheng & Li, Penghua & Huang, Yi & Luo, Jun & Qin, Yi, 2024. "Single gated RNN with differential weighted information storage mechanism and its application to machine RUL prediction," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    2. Chen, Dingliang & Cai, Wei & Yu, Hangjun & Wu, Fei & Qin, Yi, 2023. "A novel transfer gear life prediction method by the cross-condition health indicator and nested hierarchical binary-valued network," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    3. Liang, Tao & Wang, Fuli & Wang, Shu & Li, Kang & Mo, Xuelei & Lu, Di, 2024. "Machinery health prognostic with uncertainty for mineral processing using TSC-TimeGAN," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    4. Gao, Zhan & Jiang, Weixiong & Wu, Jun & Dai, Tianjiao & Zhu, Haiping, 2024. "Nonlinear slow-varying dynamics-assisted temporal graph transformer network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    5. Cao, Yudong & Zhuang, Jichao & Miao, Qiuhua & Jia, Minping & Feng, Ke & Zhao, Xiaoli & Yan, Xiaoan & Ding, Peng, 2024. "Source-free domain adaptation for transferable remaining useful life prediction of machine considering source data absence," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    6. Zhou, Liang & Wang, Huawei, 2024. "An adaptive multi-scale feature fusion and adaptive mixture-of-experts multi-task model for industrial equipment health status assessment and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    7. Wang, Yilin & Li, Yuanxiang & Zhang, Yuxuan & Lei, Jia & Yu, Yifei & Zhang, Tongtong & Yang, Yongshen & Zhao, Honghua, 2024. "Incorporating prior knowledge into self-supervised representation learning for long PHM signal," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Zhou, Liang & Wang, Huawei & Xu, Shanshan, 2023. "Aero-engine prognosis strategy based on multi-scale feature fusion and multi-task parallel learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    9. Zhou, Kai-Li & Cheng, De-Jun & Zhang, Han-Bing & Hu, Zhong-tai & Zhang, Chun-Yan, 2023. "Deep learning-based intelligent multilevel predictive maintenance framework considering comprehensive cost," Reliability Engineering and System Safety, Elsevier, vol. 237(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    2. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    3. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    4. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    5. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    6. Huang, Zhifu & Yang, Yang & Hu, Yawei & Ding, Xiang & Li, Xuanlin & Liu, Yongbin, 2023. "Attention-augmented recalibrated and compensatory network for machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    7. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    8. Zhu, Rong & Chen, Yuan & Peng, Weiwen & Ye, Zhi-Sheng, 2022. "Bayesian deep-learning for RUL prediction: An active learning perspective," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    9. Zhou, Liang & Wang, Huawei & Xu, Shanshan, 2023. "Aero-engine prognosis strategy based on multi-scale feature fusion and multi-task parallel learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    10. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    11. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    12. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    13. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    14. Gao, Zhan & Jiang, Weixiong & Wu, Jun & Dai, Tianjiao & Zhu, Haiping, 2024. "Nonlinear slow-varying dynamics-assisted temporal graph transformer network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    15. Zhang, Yuru & Su, Chun & Wu, Jiajun & Liu, Hao & Xie, Mingjiang, 2024. "Trend-augmented and temporal-featured Transformer network with multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    16. Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    17. Lin, Yan-Hui & Chang, Liang & Guan, Lu-Xin, 2024. "Enhanced stochastic recurrent hybrid model for RUL Predictions via Semi-supervised learning," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    18. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    19. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    20. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:229:y:2023:i:c:s0951832022005038. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.