IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i24p4972-d1301339.html
   My bibliography  Save this article

A Bidirectional Long Short-Term Memory Autoencoder Transformer for Remaining Useful Life Estimation

Author

Listed:
  • Zhengyang Fan

    (Department of Systems Engineering and Operations Research, George Mason University, Fairfax, VA 22030, USA)

  • Wanru Li

    (Department of Systems Engineering and Operations Research, George Mason University, Fairfax, VA 22030, USA)

  • Kuo-Chu Chang

    (Department of Systems Engineering and Operations Research, George Mason University, Fairfax, VA 22030, USA)

Abstract

Estimating the remaining useful life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine’s condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time-series sensor measurements serves as the input, initially processed by the bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.

Suggested Citation

  • Zhengyang Fan & Wanru Li & Kuo-Chu Chang, 2023. "A Bidirectional Long Short-Term Memory Autoencoder Transformer for Remaining Useful Life Estimation," Mathematics, MDPI, vol. 11(24), pages 1-17, December.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:24:p:4972-:d:1301339
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/24/4972/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/24/4972/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yaqiong Lv & Pan Zheng & Jiabei Yuan & Xiaohua Cao, 2023. "A Predictive Maintenance Strategy for Multi-Component Systems Based on Components’ Remaining Useful Life Prediction," Mathematics, MDPI, vol. 11(18), pages 1-23, September.
    2. Feiyue Deng & Yan Bi & Yongqiang Liu & Shaopu Yang, 2021. "Deep-Learning-Based Remaining Useful Life Prediction Based on a Multi-Scale Dilated Convolution Network," Mathematics, MDPI, vol. 9(23), pages 1-17, November.
    3. Yingzhi Zhang & Guiming Guo & Fang Yang & Yubin Zheng & Fenli Zhai, 2023. "Prediction of Tool Remaining Useful Life Based on NHPP-WPHM," Mathematics, MDPI, vol. 11(8), pages 1-17, April.
    4. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    5. Qianhui Wu & Keqin Ding & Biqing Huang, 2020. "Approach for fault prognosis using recurrent neural network," Journal of Intelligent Manufacturing, Springer, vol. 31(7), pages 1621-1633, October.
    6. Si, Xiao-Sheng & Wang, Wenbin & Hu, Chang-Hua & Zhou, Dong-Hua, 2011. "Remaining useful life estimation - A review on the statistical data driven approaches," European Journal of Operational Research, Elsevier, vol. 213(1), pages 1-14, August.
    7. García Nieto, P.J. & García-Gonzalo, E. & Sánchez Lasheras, F. & de Cos Juez, F.J., 2015. "Hybrid PSO–SVM-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 219-231.
    8. Xuliang Tang & Heng Wan & Weiwen Wang & Mengxu Gu & Linfeng Wang & Linfeng Gan, 2023. "Lithium-Ion Battery Remaining Useful Life Prediction Based on Hybrid Model," Sustainability, MDPI, vol. 15(7), pages 1-18, April.
    9. Yu Mo & Qianhui Wu & Xiu Li & Biqing Huang, 2021. "Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit," Journal of Intelligent Manufacturing, Springer, vol. 32(7), pages 1997-2006, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yu Mo & Liang Li & Biqing Huang & Xiu Li, 2023. "Few-shot RUL estimation based on model-agnostic meta-learning," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2359-2372, June.
    2. Khoa Tran & Hai-Canh Vu & Lam Pham & Nassim Boudaoud & Ho-Si-Hung Nguyen, 2024. "Robust-MBDL: A Robust Multi-Branch Deep-Learning-Based Model for Remaining Useful Life Prediction of Rotating Machines," Mathematics, MDPI, vol. 12(10), pages 1-25, May.
    3. Pengcheng Xia & Yixiang Huang & Chengjin Qin & Chengliang Liu, 2024. "Towards prognostic generalization: a domain conditional invariance and specificity disentanglement network for remaining useful life prediction," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3459-3477, October.
    4. Shi, Jiayu & Zhong, Jingshu & Zhang, Yuxuan & Xiao, Bin & Xiao, Lei & Zheng, Yu, 2024. "A dual attention LSTM lightweight model based on exponential smoothing for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    5. Han Cheng & Xianguang Kong & Qibin Wang & Hongbo Ma & Shengkang Yang & Gaige Chen, 2023. "Deep transfer learning based on dynamic domain adaptation for remaining useful life prediction under different working conditions," Journal of Intelligent Manufacturing, Springer, vol. 34(2), pages 587-613, February.
    6. Hervé de Beaulieu, Martin & Jha, Mayank Shekhar & Garnier, Hugues & Cerbah, Farid, 2024. "Remaining Useful Life prediction based on physics-informed data augmentation," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    7. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    8. Kamariotis, Antonios & Tatsis, Konstantinos & Chatzi, Eleni & Goebel, Kai & Straub, Daniel, 2024. "A metric for assessing and optimizing data-driven prognostic algorithms for predictive maintenance," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    9. Patrick Zschech & Kai Heinrich & Raphael Bink & Janis S. Neufeld, 2019. "Prognostic Model Development with Missing Labels," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(3), pages 327-343, June.
    10. Hu, Yang & Baraldi, Piero & Di Maio, Francesco & Zio, Enrico, 2015. "A particle filtering and kernel smoothing-based approach for new design component prognostics," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 19-31.
    11. Basora, Luis & Viens, Arthur & Chao, Manuel Arias & Olive, Xavier, 2025. "A benchmark on uncertainty quantification for deep learning prognostics," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    12. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    13. Lin, Yan-Hui & Chang, Liang & Guan, Lu-Xin, 2024. "Enhanced stochastic recurrent hybrid model for RUL Predictions via Semi-supervised learning," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    14. Zhang, Jian-Xun & Hu, Chang-Hua & He, Xiao & Si, Xiao-Sheng & Liu, Yang & Zhou, Dong-Hua, 2017. "Lifetime prognostics for deteriorating systems with time-varying random jumps," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 338-350.
    15. Miguel A. Rodríguez-López & Luis M. López-González & Luis M. López-Ochoa & Jesús Las-Heras-Casas, 2018. "Methodology for Detecting Malfunctions and Evaluating the Maintenance Effectiveness in Wind Turbine Generator Bearings Using Generic versus Specific Models from SCADA Data," Energies, MDPI, vol. 11(4), pages 1-22, March.
    16. KarabaÄŸ, Oktay & Eruguz, Ayse Sena & Basten, Rob, 2020. "Integrated optimization of maintenance interventions and spare part selection for a partially observable multi-component system," Reliability Engineering and System Safety, Elsevier, vol. 200(C).
    17. Zhengxin Zhang & Xiaosheng Si & Changhua Hu & Xiangyu Kong, 2015. "Degradation modeling–based remaining useful life estimation: A review on approaches for systems with heterogeneity," Journal of Risk and Reliability, , vol. 229(4), pages 343-355, August.
    18. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    19. Gupta, Nitin & Misra, Neeraj & Kumar, Somesh, 2015. "Stochastic comparisons of residual lifetimes and inactivity times of coherent systems with dependent identically distributed components," European Journal of Operational Research, Elsevier, vol. 240(2), pages 425-430.
    20. Kamei, Sayaka & Taghipour, Sharareh, 2023. "A comparison study of centralized and decentralized federated learning approaches utilizing the transformer architecture for estimating remaining useful life," Reliability Engineering and System Safety, Elsevier, vol. 233(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:24:p:4972-:d:1301339. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.