IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v221y2022ics0951832022000102.html
   My bibliography  Save this article

Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture

Author

Listed:
  • Liu, Lu
  • Song, Xiao
  • Zhou, Zhetao

Abstract

Remaining useful life (RUL) estimation has been intensively studied, given its important role in prognostics and health management (PHM) of industry. Recently, data-driven structures such as convolutional neural networks (CNNs), have achieved outstanding RUL prediction performance. However, conventional CNNs do not include an adequate mechanism for adaptively weighing input features. In this paper, we propose a double attention-based data-driven framework for aircraft engine RUL prognostics. Specifically, a channel attention-based CNN was utilized to apply greater weights to more significant features. Next, a Transformer was used to focus attention on these features at critical time steps. We validated the effectiveness of the proposed framework on benchmark datasets for aircraft engine RUL estimation. The experimental results indicate that the proposed double attention-based architecture outperformed the existing state-of-the-art (SOTA) algorithms. The double attention-based RUL prediction method can detect the risk of equipment failure and reduce loss.

Suggested Citation

  • Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    • Handle: RePEc:eee:reensy:v:221:y:2022:i:c:s0951832022000102
    DOI: 10.1016/j.ress.2022.108330
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832022000102
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2022.108330?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jiao, Ruihua & Peng, Kaixiang & Dong, Jie & Zhang, Chuanfang, 2020. "Fault monitoring and remaining useful life prediction framework for multiple fault modes in prognostics," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    2. Shi, Yue & Zhu, Weihang & Xiang, Yisha & Feng, Qianmei, 2020. "Condition-based maintenance optimization for multi-component systems subject to a system reliability requirement," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    3. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    4. Li, Naipeng & Gebraeel, Nagi & Lei, Yaguo & Fang, Xiaolei & Cai, Xiao & Yan, Tao, 2021. "Remaining useful life prediction based on a multi-sensor data fusion model," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    5. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    6. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    7. Listou Ellefsen, André & Bjørlykhaug, Emil & Æsøy, Vilmar & Ushakov, Sergey & Zhang, Houxiang, 2019. "Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 240-251.
    8. Xiang, Sheng & Qin, Yi & Luo, Jun & Pu, Huayan & Tang, Baoping, 2021. "Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    9. Yu, Wennian & Kim, II Yong & Mechefske, Chris, 2020. "An improved similarity-based prognostic algorithm for RUL estimation using an RNN autoencoder scheme," Reliability Engineering and System Safety, Elsevier, vol. 199(C).
    10. Qianhui Wu & Keqin Ding & Biqing Huang, 2020. "Approach for fault prognosis using recurrent neural network," Journal of Intelligent Manufacturing, Springer, vol. 31(7), pages 1621-1633, October.
    11. Chiachío, Juan & Jalón, María L. & Chiachío, Manuel & Kolios, Athanasios, 2020. "A Markov chains prognostics framework for complex degradation processes," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    12. Liu, Junqiang & Lei, Fan & Pan, Chunlu & Hu, Dongbin & Zuo, Hongfu, 2021. "Prediction of remaining useful life of multi-stage aero-engine based on clustering and LSTM fusion," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    2. Jiang, Deyin & Chen, Tianyu & Xie, Juanzhang & Cui, Weimin & Song, Bifeng, 2023. "A mechanical system reliability degradation analysis and remaining life estimation method——With the example of an aircraft hatch lock mechanism," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    3. Gao, Zhan & Jiang, Weixiong & Wu, Jun & Dai, Tianjiao & Zhu, Haiping, 2024. "Nonlinear slow-varying dynamics-assisted temporal graph transformer network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    4. Zhang, Huixin & Xi, Xiaopeng & Pan, Rong, 2023. "A two-stage data-driven approach to remaining useful life prediction via long short-term memory networks," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    5. Pan, Tongyang & Chen, Jinglong & Ye, Zhisheng & Li, Aimin, 2022. "A multi-head attention network with adaptive meta-transfer learning for RUL prediction of rocket engines," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    6. Rose, Rodrigo L. & Puranik, Tejas G. & Mavris, Dimitri N. & Rao, Arjun H., 2022. "Application of structural topic modeling to aviation safety data," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    7. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    8. Guo, Junyu & Wan, Jia-Lun & Yang, Yan & Dai, Le & Tang, Aimin & Huang, Bangkui & Zhang, Fangfang & Li, He, 2023. "A deep feature learning method for remaining useful life prediction of drilling pumps," Energy, Elsevier, vol. 282(C).
    9. Xiang, Sheng & Qin, Yi & Liu, Fuqiang & Gryllias, Konstantinos, 2022. "Automatic multi-differential deep learning and its application to machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    10. Zhou, Liang & Wang, Huawei & Xu, Shanshan, 2023. "Aero-engine prognosis strategy based on multi-scale feature fusion and multi-task parallel learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    11. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    12. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    13. Liu, Wenli & Liu, Fenghua & Fang, Weili & Love, Peter E.D., 2024. "Causal discovery and reasoning for geotechnical risk analysis," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    14. Wang, Jiaolong & Zhang, Fode & Zhang, Jianchuan & Liu, Wen & Zhou, Kuang, 2023. "A flexible RUL prediction method based on poly-cell LSTM with applications to lithium battery data," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    15. Liu, Yulang & Chen, Jinglong & Wang, Tiantian & Li, Aimin & Pan, Tongyang, 2023. "A variational transformer for predicting turbopump bearing condition under diverse degradation processes," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    16. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    17. Xia, Jun & Feng, Yunwen & Teng, Da & Chen, Junyu & Song, Zhicen, 2022. "Distance self-attention network method for remaining useful life estimation of aeroengine with parallel computing," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    18. Zhou, Di & Zhuang, Xiao & Zuo, Hongfu & Cai, Jing & Zhao, Xufeng & Xiang, Jiawei, 2022. "A model fusion strategy for identifying aircraft risk using CNN and Att-BiLSTM," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    19. Zhu, Rong & Chen, Yuan & Peng, Weiwen & Ye, Zhi-Sheng, 2022. "Bayesian deep-learning for RUL prediction: An active learning perspective," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    20. Zuo, Tao & Zhang, Kai & Zheng, Qing & Li, Xianxin & Li, Zhixuan & Ding, Guofu & Zhao, Minghang, 2023. "A hybrid attention-based multi-wavelet coefficient fusion method in RUL prognosis of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 237(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    2. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    3. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    4. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    5. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    6. Azar, Kamyar & Hajiakhondi-Meybodi, Zohreh & Naderkhani, Farnoosh, 2022. "Semi-supervised clustering-based method for fault diagnosis and prognosis: A case study," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    7. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    8. Wan, Shaoke & Li, Xiaohu & Zhang, Yanfei & Liu, Shijie & Hong, Jun & Wang, Dongfeng, 2022. "Bearing remaining useful life prediction with convolutional long short-term memory fusion networks," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    9. Nguyen, Khanh T.P. & Medjaher, Kamal & Gogu, Christian, 2022. "Probabilistic deep learning methodology for uncertainty quantification of remaining useful lifetime of multi-component systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    10. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    11. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    12. Bae, Jinwoo & Xi, Zhimin, 2022. "Learning of physical health timestep using the LSTM network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    13. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    14. Arias Chao, Manuel & Kulkarni, Chetan & Goebel, Kai & Fink, Olga, 2022. "Fusing physics-based and deep learning models for prognostics," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    15. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    16. Fan, Linchuan & Chai, Yi & Chen, Xiaolong, 2022. "Trend attention fully convolutional network for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    17. Fallahdizcheh, Amirhossein & Wang, Chao, 2022. "Transfer learning of degradation modeling and prognosis based on multivariate functional analysis with heterogeneous sampling rates," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    18. Wang, Yuan & Lei, Yaguo & Li, Naipeng & Yan, Tao & Si, Xiaosheng, 2023. "Deep multisource parallel bilinear-fusion network for remaining useful life prediction of machinery," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    19. Kumar, Anil & Parkash, Chander & Vashishtha, Govind & Tang, Hesheng & Kundu, Pradeep & Xiang, Jiawei, 2022. "State-space modeling and novel entropy-based health indicator for dynamic degradation monitoring of rolling element bearing," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    20. Moradi, Ramin & Cofre-Martel, Sergio & Lopez Droguett, Enrique & Modarres, Mohammad & Groth, Katrina M., 2022. "Integration of deep learning and Bayesian networks for condition and operation risk monitoring of complex engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:221:y:2022:i:c:s0951832022000102. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.