IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v235y2023ics0951832023001126.html
   My bibliography  Save this article

A parallel GRU with dual-stage attention mechanism model integrating uncertainty quantification for probabilistic RUL prediction of wind turbine bearings

Author

Listed:
  • Cao, Lixiao
  • Zhang, Hongyu
  • Meng, Zong
  • Wang, Xueping

Abstract

The accurate probabilistic prediction of remaining useful life (RUL) of bearings plays an important role in ensuring the safe operation of wind turbine maintenance decision making. However, it is still a challenge to improve prediction accuracy and quantify prediction uncertainty, leading to the inability of precision and reliable prediction results. Accordingly, this paper proposed a novel probabilistic RUL prediction method combined the parallel GRUs with dual-stage attention mechanism (PDAGRU) prediction model with the non-parametric uncertainty quantification approach to overcome the limitations. In the PDAGRU model, the dual-stage attention mechanism is developed to improve the capability of degradation information extraction. Meanwhile, the parallel structure can enhance prediction accuracy and help quantify model uncertainty. The proposed uncertainty quantification approach with less prior knowledge can provide probabilistic RUL prediction results based on the kernel density estimation (KDE) and Monte Carlo (MC) dropout. Moreover, a first prediction time (FPT) determination method based on the isotonic regression is developed to more accurately reflect the degradation trajectory of bearings’ RUL. Two cases including simulated data and real-world data are deployed to verify the effectiveness of the proposed method. Compared with other methods, the superiority of the proposed method is verified. The RUL prediction accuracy and interval coverage probability for wind turbine bearings are high to 90.4% and 99.7% respectively.

Suggested Citation

  • Cao, Lixiao & Zhang, Hongyu & Meng, Zong & Wang, Xueping, 2023. "A parallel GRU with dual-stage attention mechanism model integrating uncertainty quantification for probabilistic RUL prediction of wind turbine bearings," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
  • Handle: RePEc:eee:reensy:v:235:y:2023:i:c:s0951832023001126
    DOI: 10.1016/j.ress.2023.109197
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023001126
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109197?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pan, Tongyang & Chen, Jinglong & Ye, Zhisheng & Li, Aimin, 2022. "A multi-head attention network with adaptive meta-transfer learning for RUL prediction of rocket engines," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    2. Zhang, Yong & Xin, Yuqi & Liu, Zhi-wei & Chi, Ming & Ma, Guijun, 2022. "Health status assessment and remaining useful life prediction of aero-engine based on BiGRU and MMoE," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    3. Merainani, Boualem & Laddada, Sofiane & Bechhoefer, Eric & Chikh, Mohamed Abdessamed Ait & Benazzouz, Djamel, 2022. "An integrated methodology for estimating the remaining useful life of high-speed wind turbine shaft bearings with limited samples," Renewable Energy, Elsevier, vol. 182(C), pages 1141-1151.
    4. Wan, Shaoke & Li, Xiaohu & Zhang, Yanfei & Liu, Shijie & Hong, Jun & Wang, Dongfeng, 2022. "Bearing remaining useful life prediction with convolutional long short-term memory fusion networks," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    5. Wang, Han & Liao, Haitao & Ma, Xiaobing & Bao, Rui, 2021. "Remaining Useful Life Prediction and Optimal Maintenance Time Determination for a Single Unit Using Isotonic Regression and Gamma Process Model," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    6. Xiang, Sheng & Qin, Yi & Liu, Fuqiang & Gryllias, Konstantinos, 2022. "Automatic multi-differential deep learning and its application to machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    7. Chen, Jinglong & Jing, Hongjie & Chang, Yuanhong & Liu, Qian, 2019. "Gated recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 372-382.
    8. Cao, Yudong & Ding, Yifei & Jia, Minping & Tian, Rushuai, 2021. "A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    9. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernández, Juan & Chiachío, Juan & Barros, José & Chiachío, Manuel & Kulkarni, Chetan S., 2024. "Physics-guided recurrent neural network trained with approximate Bayesian computation: A case study on structural response prognostics," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    2. Yang, Shilong & Tang, Baoping & Wang, Weiying & Yang, Qichao & Hu, Cheng, 2024. "Physics-informed multi-state temporal frequency network for RUL prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    3. Zhu, Dongping & Huang, Xiaogang & Ding, Zhixia & Zhang, Wei, 2024. "Estimation of wind turbine responses with attention-based neural network incorporating environmental uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    4. Ni, Qing & Ji, J.C. & Feng, Ke & Zhang, Yongchao & Lin, Dongdong & Zheng, Jinde, 2024. "Data-driven bearing health management using a novel multi-scale fused feature and gated recurrent unit," Reliability Engineering and System Safety, Elsevier, vol. 242(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    2. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    3. Yang, Ningning & Wang, Zhijian & Cai, Wenan & Li, Yanfeng, 2023. "Data Regeneration Based on Multiple Degradation Processes for Remaining Useful Life Estimation," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    4. Yang, Shilong & Tang, Baoping & Wang, Weiying & Yang, Qichao & Hu, Cheng, 2024. "Physics-informed multi-state temporal frequency network for RUL prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    5. Chen, Dingliang & Qin, Yi & Qian, Quan & Wang, Yi & Liu, Fuqiang, 2023. "Transfer life prediction of gears by cross-domain health indicator construction and multi-hierarchical long-term memory augmented network," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    6. Wang, Chu & Dou, Manfeng & Li, Zhongliang & Outbib, Rachid & Zhao, Dongdong & Zuo, Jian & Wang, Yuanlin & Liang, Bin & Wang, Peng, 2023. "Data-driven prognostics based on time-frequency analysis and symbolic recurrent neural network for fuel cells under dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    7. Youdao Wang & Yifan Zhao, 2022. "Multi-Scale Remaining Useful Life Prediction Using Long Short-Term Memory," Sustainability, MDPI, vol. 14(23), pages 1-19, November.
    8. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    9. Zhu, Ting & Chen, Zhen & Zhou, Di & Xia, Tangbin & Pan, Ershun, 2024. "Adaptive staged remaining useful life prediction of roller in a hot strip mill based on multi-scale LSTM with multi-head attention," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    10. Ding, Ning & Li, Hulin & Xin, Qi & Wu, Bo & Jiang, Dan, 2023. "Multi-source domain generalization for degradation monitoring of journal bearings under unseen conditions," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    11. Cheng, Yongbo & Qv, Junheng & Feng, Ke & Han, Te, 2024. "A Bayesian adversarial probsparse Transformer model for long-term remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    12. Huang, Zhifu & Yang, Yang & Hu, Yawei & Ding, Xiang & Li, Xuanlin & Liu, Yongbin, 2023. "Attention-augmented recalibrated and compensatory network for machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    13. Wang, Han & Wang, Dongdong & Liu, Haoxiang & Tang, Gang, 2022. "A predictive sliding local outlier correction method with adaptive state change rate determining for bearing remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    14. Yu, Wennian & Shao, Yimin & Xu, Jin & Mechefske, Chris, 2022. "An adaptive and generalized Wiener process model with a recursive filtering algorithm for remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    15. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    16. Zhang, Yong & Xin, Yuqi & Liu, Zhi-wei & Chi, Ming & Ma, Guijun, 2022. "Health status assessment and remaining useful life prediction of aero-engine based on BiGRU and MMoE," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    17. Wu, Jinxin & He, Deqiang & Li, Jiayi & Miao, Jian & Li, Xianwang & Li, Hongwei & Shan, Sheng, 2024. "Temporal multi-resolution hypergraph attention network for remaining useful life prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    18. Hu, Tao & Guo, Yiming & Gu, Liudong & Zhou, Yifan & Zhang, Zhisheng & Zhou, Zhiting, 2022. "Remaining useful life estimation of bearings under different working conditions via Wasserstein distance-based weighted domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    19. Yang, Jing & Wang, Xiaomin, 2024. "Meta-learning with deep flow kernel network for few shot cross-domain remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    20. Xiang, Sheng & Qin, Yi & Luo, Jun & Pu, Huayan & Tang, Baoping, 2021. "Multicellular LSTM-based deep learning model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:235:y:2023:i:c:s0951832023001126. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.