IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v244y2024ics0951832024000036.html
   My bibliography  Save this article

Meta-learning with deep flow kernel network for few shot cross-domain remaining useful life prediction

Author

Listed:
  • Yang, Jing
  • Wang, Xiaomin

Abstract

Reliable prediction of the remaining useful life (RUL) is important for improving maintenance efficiency, equipment availability, and avoiding catastrophic accidents in complex industrial systems. Existing RUL prediction models have made some contribution, relying mainly on a large amount of degraded data with similar patterns or approximate distributions. However, in practical industrial systems, only a small amount of labeling data is usually available, which may also come from different devices and different working conditions, resulting in different distributions in the degraded data. This situation makes the existing RUL methods difficult to achieve satisfactory generalization performance. To address this challenge, this paper proposes a novel Meta-Learning with Deep Flow Kernel Network (MetaDFKN) model for RUL prediction under the few shot and cross-domain conditions. The model first learns kernel features in a data-driven manner and considers them as latent variables to improve the model’s representative ability of shared knowledge between tasks. Then, we introduce the conditional normalized flow technique to infer richer posterior distributions in the kernel features, which helps to obtain feature information with stronger discriminative power. Moreover, shared knowledge and task-specific information are integrated into the contextual inference process, which can mine the dependencies of related tasks and capture richer domain information. Finally, to evaluate the proposed model, we conduct extensive experiments on engine and bearings degradation data, and the results verify the superiority of the model.

Suggested Citation

  • Yang, Jing & Wang, Xiaomin, 2024. "Meta-learning with deep flow kernel network for few shot cross-domain remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
  • Handle: RePEc:eee:reensy:v:244:y:2024:i:c:s0951832024000036
    DOI: 10.1016/j.ress.2024.109928
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024000036
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.109928?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pan, Tongyang & Chen, Jinglong & Ye, Zhisheng & Li, Aimin, 2022. "A multi-head attention network with adaptive meta-transfer learning for RUL prediction of rocket engines," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    2. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    3. Chen, Jiaxian & Li, Dongpeng & Huang, Ruyi & Chen, Zhuyun & Li, Weihua, 2023. "Aero-engine remaining useful life prediction method with self-adaptive multimodal data fusion and cluster-ensemble transfer regression," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    4. Song, Wanqing & Duan, Shouwu & Zio, Enrico & Kudreyko, Aleksey, 2022. "Multifractional and long-range dependent characteristics for remaining useful life prediction of cracking gas compressor," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    5. Fu, Song & Zhang, Yongjian & Lin, Lin & Zhao, Minghang & Zhong, Shi-sheng, 2021. "Deep residual LSTM with domain-invariance for remaining useful life prediction across domains," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    6. Mitici, Mihaela & de Pater, Ingeborg & Barros, Anne & Zeng, Zhiguo, 2023. "Dynamic predictive maintenance for multiple components using data-driven probabilistic RUL prognostics: The case of turbofan engines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    7. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang, 2022. "The two-stage RUL prediction across operation conditions using deep transfer learning and insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    8. Zhang, Xin & Sun, Jiankai & Wang, Jiaxu & Jin, Yulin & Wang, Lei & Liu, Zhiwen, 2023. "PAOLTransformer: Pruning-adaptive optimal lightweight Transformer model for aero-engine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 240(C).
    9. Miao, Mengqi & Yu, Jianbo & Zhao, Zhihong, 2022. "A sparse domain adaption network for remaining useful life prediction of rolling bearings under different working conditions," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    10. Zhang, Huixin & Xi, Xiaopeng & Pan, Rong, 2023. "A two-stage data-driven approach to remaining useful life prediction via long short-term memory networks," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    11. Hu, Tao & Guo, Yiming & Gu, Liudong & Zhou, Yifan & Zhang, Zhisheng & Zhou, Zhiting, 2022. "Remaining useful life estimation of bearings under different working conditions via Wasserstein distance-based weighted domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    12. da Costa, Paulo Roberto de Oliveira & Akçay, Alp & Zhang, Yingqian & Kaymak, Uzay, 2020. "Remaining useful lifetime prediction via deep domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    13. Li, Wanxiang & Shang, Zhiwu & Gao, Maosheng & Qian, Shiqi & Feng, Zehua, 2022. "Remaining useful life prediction based on transfer multi-stage shrinkage attention temporal convolutional network under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    14. Zuo, Tao & Zhang, Kai & Zheng, Qing & Li, Xianxin & Li, Zhixuan & Ding, Guofu & Zhao, Minghang, 2023. "A hybrid attention-based multi-wavelet coefficient fusion method in RUL prognosis of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    15. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    16. Liu, Junqiang & Lei, Fan & Pan, Chunlu & Hu, Dongbin & Zuo, Hongfu, 2021. "Prediction of remaining useful life of multi-stage aero-engine based on clustering and LSTM fusion," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    17. Yu Mo & Liang Li & Biqing Huang & Xiu Li, 2023. "Few-shot RUL estimation based on model-agnostic meta-learning," Journal of Intelligent Manufacturing, Springer, vol. 34(5), pages 2359-2372, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yan, Jianhai & Ye, Zhi-Sheng & He, Shuguang & He, Zhen, 2024. "A feature disentanglement and unsupervised domain adaptation of remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    2. Chen, Dingliang & Cai, Wei & Yu, Hangjun & Wu, Fei & Qin, Yi, 2023. "A novel transfer gear life prediction method by the cross-condition health indicator and nested hierarchical binary-valued network," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    3. Li, Yuanfu & Chen, Yifan & Shao, Haonan & Zhang, Huisheng, 2023. "A novel dual attention mechanism combined with knowledge for remaining useful life prediction based on gated recurrent units," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    4. Yan, Jianhai & He, Zhen & He, Shuguang, 2023. "Multitask learning of health state assessment and remaining useful life prediction for sensor-equipped machines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    5. Cheng, Yongbo & Qv, Junheng & Feng, Ke & Han, Te, 2024. "A Bayesian adversarial probsparse Transformer model for long-term remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    6. Nejjar, Ismail & Geissmann, Fabian & Zhao, Mengjie & Taal, Cees & Fink, Olga, 2024. "Domain adaptation via alignment of operation profile for Remaining Useful Lifetime prediction," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    7. Chen, Dingliang & Qin, Yi & Qian, Quan & Wang, Yi & Liu, Fuqiang, 2023. "Transfer life prediction of gears by cross-domain health indicator construction and multi-hierarchical long-term memory augmented network," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    8. Zhang, Zhiyao & Chen, Xiaohui & Zio, Enrico & Li, Longxiao, 2023. "Multi-task learning boosted predictions of the remaining useful life of aero-engines under scenarios of working-condition shift," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    9. Li, Yuan & Li, Jingwei & Wang, Huanjie & Liu, Chengbao & Tan, Jie, 2024. "Knowledge enhanced ensemble method for remaining useful life prediction under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    10. Xiang, Sheng & Li, Penghua & Huang, Yi & Luo, Jun & Qin, Yi, 2024. "Single gated RNN with differential weighted information storage mechanism and its application to machine RUL prediction," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    11. Xu, Danyang & Qiu, Haobo & Gao, Liang & Yang, Zan & Wang, Dapeng, 2022. "A novel dual-stream self-attention neural network for remaining useful life estimation of mechanical systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    12. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Jiang, Yuchen & Luo, Hao & Yin, Shen, 2023. "A variational local weighted deep sub-domain adaptation network for remaining useful life prediction facing cross-domain condition," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    13. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    14. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    15. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    16. Zhu, Yongmeng & Wu, Jiechang & Wu, Jun & Liu, Shuyong, 2022. "Dimensionality reduce-based for remaining useful life prediction of machining tools with multisensor fusion," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    17. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    18. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    19. Yang, Shilong & Tang, Baoping & Wang, Weiying & Yang, Qichao & Hu, Cheng, 2024. "Physics-informed multi-state temporal frequency network for RUL prediction of rolling bearings," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    20. Zhang, Jiusi & Tian, Jilun & Yan, Pengfei & Wu, Shimeng & Luo, Hao & Yin, Shen, 2024. "Multi-hop graph pooling adversarial network for cross-domain remaining useful life prediction: A distributed federated learning perspective," Reliability Engineering and System Safety, Elsevier, vol. 244(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:244:y:2024:i:c:s0951832024000036. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.