IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i24p4972-d1301339.html
   My bibliography  Save this article

A Bidirectional Long Short-Term Memory Autoencoder Transformer for Remaining Useful Life Estimation

Author

Listed:
  • Zhengyang Fan

    (Department of Systems Engineering and Operations Research, George Mason University, Fairfax, VA 22030, USA)

  • Wanru Li

    (Department of Systems Engineering and Operations Research, George Mason University, Fairfax, VA 22030, USA)

  • Kuo-Chu Chang

    (Department of Systems Engineering and Operations Research, George Mason University, Fairfax, VA 22030, USA)

Abstract

Estimating the remaining useful life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine’s condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time-series sensor measurements serves as the input, initially processed by the bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.

Suggested Citation

  • Zhengyang Fan & Wanru Li & Kuo-Chu Chang, 2023. "A Bidirectional Long Short-Term Memory Autoencoder Transformer for Remaining Useful Life Estimation," Mathematics, MDPI, vol. 11(24), pages 1-17, December.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:24:p:4972-:d:1301339
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/24/4972/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/24/4972/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yaqiong Lv & Pan Zheng & Jiabei Yuan & Xiaohua Cao, 2023. "A Predictive Maintenance Strategy for Multi-Component Systems Based on Components’ Remaining Useful Life Prediction," Mathematics, MDPI, vol. 11(18), pages 1-23, September.
    2. Xuliang Tang & Heng Wan & Weiwen Wang & Mengxu Gu & Linfeng Wang & Linfeng Gan, 2023. "Lithium-Ion Battery Remaining Useful Life Prediction Based on Hybrid Model," Sustainability, MDPI, vol. 15(7), pages 1-18, April.
    3. Feiyue Deng & Yan Bi & Yongqiang Liu & Shaopu Yang, 2021. "Deep-Learning-Based Remaining Useful Life Prediction Based on a Multi-Scale Dilated Convolution Network," Mathematics, MDPI, vol. 9(23), pages 1-17, November.
    4. Yingzhi Zhang & Guiming Guo & Fang Yang & Yubin Zheng & Fenli Zhai, 2023. "Prediction of Tool Remaining Useful Life Based on NHPP-WPHM," Mathematics, MDPI, vol. 11(8), pages 1-17, April.
    5. Si, Xiao-Sheng & Wang, Wenbin & Hu, Chang-Hua & Zhou, Dong-Hua, 2011. "Remaining useful life estimation - A review on the statistical data driven approaches," European Journal of Operational Research, Elsevier, vol. 213(1), pages 1-14, August.
    6. Zhuang, Liangliang & Xu, Ancha & Wang, Xiao-Lin, 2023. "A prognostic driven predictive maintenance framework based on Bayesian deep learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    7. García Nieto, P.J. & García-Gonzalo, E. & Sánchez Lasheras, F. & de Cos Juez, F.J., 2015. "Hybrid PSO–SVM-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 219-231.
    8. Qianhui Wu & Keqin Ding & Biqing Huang, 2020. "Approach for fault prognosis using recurrent neural network," Journal of Intelligent Manufacturing, Springer, vol. 31(7), pages 1621-1633, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yu Mo & Liang Li & Biqing Huang & Xiu Li, 2023. "Few-shot RUL estimation based on model-agnostic meta-learning," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2359-2372, June.
    2. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    3. Patrick Zschech & Kai Heinrich & Raphael Bink & Janis S. Neufeld, 2019. "Prognostic Model Development with Missing Labels," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(3), pages 327-343, June.
    4. Hu, Yang & Baraldi, Piero & Di Maio, Francesco & Zio, Enrico, 2015. "A particle filtering and kernel smoothing-based approach for new design component prognostics," Reliability Engineering and System Safety, Elsevier, vol. 134(C), pages 19-31.
    5. Gao, Shuzhi & Zhang, Sixuan & Zhang, Yimin & Gao, Yue, 2020. "Operational reliability evaluation and prediction of rolling bearing based on isometric mapping and NoCuSa-LSSVM," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    6. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    7. Zhang, Ao & Wang, Zhihua & Bao, Rui & Liu, Chengrui & Wu, Qiong & Cao, Shihao, 2023. "A novel failure time estimation method for degradation analysis based on general nonlinear Wiener processes," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    8. Zhang, Jian-Xun & Hu, Chang-Hua & He, Xiao & Si, Xiao-Sheng & Liu, Yang & Zhou, Dong-Hua, 2017. "Lifetime prognostics for deteriorating systems with time-varying random jumps," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 338-350.
    9. Pan, Yongjun & Sun, Yu & Li, Zhixiong & Gardoni, Paolo, 2023. "Machine learning approaches to estimate suspension parameters for performance degradation assessment using accurate dynamic simulations," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    10. Miguel A. Rodríguez-López & Luis M. López-González & Luis M. López-Ochoa & Jesús Las-Heras-Casas, 2018. "Methodology for Detecting Malfunctions and Evaluating the Maintenance Effectiveness in Wind Turbine Generator Bearings Using Generic versus Specific Models from SCADA Data," Energies, MDPI, vol. 11(4), pages 1-22, March.
    11. KarabaÄŸ, Oktay & Eruguz, Ayse Sena & Basten, Rob, 2020. "Integrated optimization of maintenance interventions and spare part selection for a partially observable multi-component system," Reliability Engineering and System Safety, Elsevier, vol. 200(C).
    12. Zhengxin Zhang & Xiaosheng Si & Changhua Hu & Xiangyu Kong, 2015. "Degradation modeling–based remaining useful life estimation: A review on approaches for systems with heterogeneity," Journal of Risk and Reliability, , vol. 229(4), pages 343-355, August.
    13. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    14. Jahani, Salman & Zhou, Shiyu & Veeramani, Dharmaraj, 2021. "Stochastic prognostics under multiple time-varying environmental factors," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    15. Chang, Miaoxin & Huang, Xianzhen & Coolen, Frank PA & Coolen-Maturi, Tahani, 2023. "New reliability model for complex systems based on stochastic processes and survival signature," European Journal of Operational Research, Elsevier, vol. 309(3), pages 1349-1364.
    16. Gupta, Nitin & Misra, Neeraj & Kumar, Somesh, 2015. "Stochastic comparisons of residual lifetimes and inactivity times of coherent systems with dependent identically distributed components," European Journal of Operational Research, Elsevier, vol. 240(2), pages 425-430.
    17. Zhang, Jian-Xun & Si, Xiao-Sheng & Du, Dang-Bo & Hu, Chang-Hua & Hu, Chen, 2020. "A novel iterative approach of lifetime estimation for standby systems with deteriorating spare parts," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    18. García Nieto, P.J. & García-Gonzalo, E. & Sánchez Lasheras, F. & de Cos Juez, F.J., 2015. "Hybrid PSO–SVM-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 219-231.
    19. Qin, Shuidan & Wang, Bing Xing & Tsai, Tzong-Ru & Wang, Xiaofei, 2023. "The prediction of remaining useful lifetime for the Weibull k-out-of-n load-sharing system," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    20. Ondemir, Onder & Gupta, Surendra M., 2014. "A multi-criteria decision making model for advanced repair-to-order and disassembly-to-order system," European Journal of Operational Research, Elsevier, vol. 233(2), pages 408-419.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:24:p:4972-:d:1301339. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.