IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v215y2021ics0951832021003355.html
   My bibliography  Save this article

A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings

Author

Listed:
  • Cao, Yudong
  • Ding, Yifei
  • Jia, Minping
  • Tian, Rushuai

Abstract

Remaining useful life (RUL) prediction has been a hotspot in the engineering field, which is useful to avoid unexpected breakdowns and reduce maintenance costs of the system. Due to the high nonlinearity and complexity of mechanical systems, traditional methods cannot meet the requirements of medium-term and long-term prediction tasks, and often ignore the influence of temporal information on prediction performance. To solve this problem, this paper proposes a new deep learning framework – Temporal convolutional network with residual self-attention mechanism (TCN-RSA), which can learn both time-frequency and temporal information of signals. First, we input the marginal spectrum of vibration signals to TCN. The causal dilated convolution structure in the TCN has the ability to capture long-term dependencies and extract high-level feature representations from the time-frequency domain at the same time. Then, a residual self-attention mechanism is introduced to obtain the feature contribution degree of different moments in the bearing degradation process. Finally, an end-to-end RUL prediction implementation can be established based on TCN-RSA network. The effectiveness of the proposed method is verified by IEEE PHM 2012 Data challenge datasets and XJTU-SY datasets respectively. The comparative study indicates that the proposed TCN-RSA framework outperforms the other state-of-the-art methods in RUL prediction and system prognosis with respect to better accuracy and computation efficiency.

Suggested Citation

  • Cao, Yudong & Ding, Yifei & Jia, Minping & Tian, Rushuai, 2021. "A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
  • Handle: RePEc:eee:reensy:v:215:y:2021:i:c:s0951832021003355
    DOI: 10.1016/j.ress.2021.107813
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021003355
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107813?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    2. Ding, Yifei & Jia, Minping & Miao, Qiuhua & Huang, Peng, 2021. "Remaining useful life estimation using deep metric transfer learning for kernel regression," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    3. Jouin, Marine & Gouriveau, Rafael & Hissel, Daniel & Péra, Marie-Cécile & Zerhouni, Noureddine, 2016. "Degradations analysis and aging modeling for health assessment and prognostics of PEMFC," Reliability Engineering and System Safety, Elsevier, vol. 148(C), pages 78-95.
    4. Zhao, Zeqi & Bin Liang, & Wang, Xueqian & Lu, Weining, 2017. "Remaining useful life prediction of aircraft engine based on degradation pattern learning," Reliability Engineering and System Safety, Elsevier, vol. 164(C), pages 74-83.
    5. García Nieto, P.J. & García-Gonzalo, E. & Sánchez Lasheras, F. & de Cos Juez, F.J., 2015. "Hybrid PSO–SVM-based method for forecasting of the remaining useful life for aircraft engines and evaluation of its reliability," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 219-231.
    6. Azadeh, A. & Asadzadeh, S.M. & Salehi, N. & Firoozi, M., 2015. "Condition-based maintenance effectiveness for series–parallel power generation system—A combined Markovian simulation model," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 357-368.
    7. Chen, Jinglong & Jing, Hongjie & Chang, Yuanhong & Liu, Qian, 2019. "Gated recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 372-382.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    2. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    3. Li, Xiang & Ding, Qian & Sun, Jian-Qiao, 2018. "Remaining useful life estimation in prognostics using deep convolution neural networks," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 1-11.
    4. Ding, Yifei & Jia, Minping & Miao, Qiuhua & Huang, Peng, 2021. "Remaining useful life estimation using deep metric transfer learning for kernel regression," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    5. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    6. Youdao Wang & Yifan Zhao, 2022. "Multi-Scale Remaining Useful Life Prediction Using Long Short-Term Memory," Sustainability, MDPI, vol. 14(23), pages 1-19, November.
    7. Xiang, Sheng & Qin, Yi & Liu, Fuqiang & Gryllias, Konstantinos, 2022. "Automatic multi-differential deep learning and its application to machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    8. Xiang, Sheng & Qin, Yi & Luo, Jun & Pu, Huayan & Tang, Baoping, 2021. "Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    9. Zhuang, Jichao & Jia, Minping & Ding, Yifei & Ding, Peng, 2021. "Temporal convolution-based transferable cross-domain adaptation approach for remaining useful life estimation under variable failure behaviors," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    10. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    11. Moradi, Ramin & Cofre-Martel, Sergio & Lopez Droguett, Enrique & Modarres, Mohammad & Groth, Katrina M., 2022. "Integration of deep learning and Bayesian networks for condition and operation risk monitoring of complex engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    12. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    13. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    14. Jiao, Ruihua & Peng, Kaixiang & Dong, Jie & Zhang, Chuanfang, 2020. "Fault monitoring and remaining useful life prediction framework for multiple fault modes in prognostics," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    15. Hu, Tao & Guo, Yiming & Gu, Liudong & Zhou, Yifan & Zhang, Zhisheng & Zhou, Zhiting, 2022. "Remaining useful life prediction of bearings under different working conditions using a deep feature disentanglement based transfer learning method," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    16. He, Jiabei & Tian, Yi & Wu, Lifeng, 2022. "A hybrid data-driven method for rapid prediction of lithium-ion battery capacity," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    17. Pan, Tongyang & Chen, Jinglong & Ye, Zhisheng & Li, Aimin, 2022. "A multi-head attention network with adaptive meta-transfer learning for RUL prediction of rocket engines," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    18. Xiao, Lei & Tang, Junxuan & Zhang, Xinghui & Bechhoefer, Eric & Ding, Siyi, 2021. "Remaining useful life prediction based on intentional noise injection and feature reconstruction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    19. Wang, Chu & Dou, Manfeng & Li, Zhongliang & Outbib, Rachid & Zhao, Dongdong & Zuo, Jian & Wang, Yuanlin & Liang, Bin & Wang, Peng, 2023. "Data-driven prognostics based on time-frequency analysis and symbolic recurrent neural network for fuel cells under dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    20. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:215:y:2021:i:c:s0951832021003355. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.