IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v252y2024ics0951832024005052.html
   My bibliography  Save this article

Reserving embedding space for new fault types: A new continual learning method for bearing fault diagnosis

Author

Listed:
  • Zhu, Hongyan
  • Shen, Changqing
  • Li, Lin
  • Wang, Dong
  • Huang, Weiguo
  • Zhu, Zhongkui

Abstract

In complex operating environments, rotating equipment may continually generate new fault categories, affecting the safety of equipment operation, and the number of collected fault samples is limited, which make it difficult to establish a reliable diagnostic model. Few-shot continual learning (FSCL) can continuously learn and summarize fault knowledge from limited samples. These traditional FSCL models, when learning from limited samples of new types of bearing faults, exhibit model overfitting and catastrophic forgetting issues after self-updating (new model). This phenomenon significantly limits the reliability of traditional models. This paper presents a new approach coined as reserving embedding space for new fault types (RESNFT) for continual learning of newly occurred bearing faults for machinery fault diagnosis, which includes several key and new ideas. Preliminary, a class prototype (prototype vector) is derived to replace a classifier weight. Then, embedding space reserved by forcibly assigning real fault samples to both real and virtual categories can mitigate catastrophic forgetting. Finally, virtual faults formed by sample mixing guide new fault samples to the reserved embedding space, and realize continuous classification of new faults. Results show that the RESNFT can effectively alleviate the catastrophic forgetting and overfitting problems, and it is superior to other existing methods.

Suggested Citation

  • Zhu, Hongyan & Shen, Changqing & Li, Lin & Wang, Dong & Huang, Weiguo & Zhu, Zhongkui, 2024. "Reserving embedding space for new fault types: A new continual learning method for bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
  • Handle: RePEc:eee:reensy:v:252:y:2024:i:c:s0951832024005052
    DOI: 10.1016/j.ress.2024.110433
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024005052
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110433?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cai, Xiao & Li, Naipeng & Xie, Min, 2024. "RUL prediction for two-phase degrading systems considering physical damage observations," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    2. Yu, Aobo & Cai, Bolin & Wu, Qiujie & García, Miguel Martínez & Li, Jing & Chen, Xiangcheng, 2024. "Source-free domain adaptation method for fault diagnosis of rotation machinery under partial information," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    3. Miao, Mengqi & Yu, Jianbo, 2024. "Deep feature interactive network for machinery fault diagnosis using multi-source heterogeneous data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    4. Li, Sai & Peng, Yanfeng & Shen, Yiping & Zhao, Sibo & Shao, Haidong & Bin, Guangfu & Guo, Yong & Yang, Xingkai & Fan, Chao, 2024. "Rolling Bearing Fault Diagnosis Under Data Imbalance and Variable Speed Based on Adaptive Clustering Weighted Oversampling," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    5. Wu, Zhangjun & Xu, Renli & Luo, Yuansheng & Shao, Haidong, 2024. "A holistic semi-supervised method for imbalanced fault diagnosis of rotational machinery with out-of-distribution samples," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    6. Chen, Pengfei & Zhao, Rongzhen & He, Tianjing & Wei, Kongyuan & Yuan, Jianhui, 2023. "A novel bearing fault diagnosis method based joint attention adversarial domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    7. Shi, Peiming & Wu, Shuping & Xu, Xuefang & Zhang, Bofei & Liang, Pengfei & Qiao, Zijian, 2023. "TSN: A novel intelligent fault diagnosis method for bearing with small samples under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 240(C).
    8. Zuo, Lin & Xu, Fengjie & Zhang, Changhua & Xiahou, Tangfan & Liu, Yu, 2022. "A multi-layer spiking neural network-based approach to bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yu, Tian & Li, Chaoshun & Huang, Jie & Xiao, Xiangqu & Zhang, Xiaoyuan & Li, Yuhong & Fu, Bitao, 2024. "ReF-DDPM: A novel DDPM-based data augmentation method for imbalanced rolling bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    2. Liu, Jiale & Wang, Huan, 2024. "A brain-inspired energy-efficient Wide Spiking Residual Attention Framework for intelligent fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    3. Yue, Ke & Li, Jipu & Deng, Shuhan & Kwoh, Chee Keong & Chen, Zhuyun & Li, Weihua, 2024. "A relationship-aware calibrated prototypical network for fault incremental diagnosis of electric motors without reserved samples," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    4. Chen, Xirui & Liu, Hui, 2025. "Domain correction for hydraulic internal pump leakage detection considering multiclass aberrant flow data," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    5. Liu, Jie & He, Zihan & Miao, Yonghao, 2024. "Causality-based adversarial attacks for robust GNN modelling with application in fault detection," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    6. Zhang, Guowei & Kong, Xianguang & Wang, Qibin & Du, Jingli & Wang, Jinrui & Ma, Hongbo, 2024. "Single domain generalization method based on anti-causal learning for rotating machinery fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    7. Pang, Zhendong & Luan, Yingxin & Chen, Jiahong & Li, Teng, 2024. "ParInfoGPT: An LLM-based two-stage framework for reliability assessment of rotating machine under partial information," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    8. Tito G. Amaral & Vitor Fernão Pires & Armando Cordeiro & Daniel Foito & João F. Martins & Julia Yamnenko & Tetyana Tereschenko & Liudmyla Laikova & Ihor Fedin, 2023. "Incipient Fault Diagnosis of a Grid-Connected T-Type Multilevel Inverter Using Multilayer Perceptron and Walsh Transform," Energies, MDPI, vol. 16(6), pages 1-18, March.
    9. Zhang, Jian-Xun & Zhang, Jia-Ling & Zhang, Zheng-Xin & Li, Tian-Mei & Si, Xiao-Sheng, 2024. "Remaining useful life prediction for stochastic degrading devices incorporating quantization," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    10. Kim, Yong Chae & Lee, Jinwook & Kim, Taehun & Baek, Jonghwa & Ko, Jin Uk & Jung, Joon Ha & Youn, Byeng D., 2024. "Gradient Alignment based Partial Domain Adaptation (GAPDA) using a domain knowledge filter for fault diagnosis of bearing," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    11. Fan, Hanwen & Jia, Haiying & He, Xuzhuo & Lyu, Jing, 2024. "Navigating uncertainty: A dynamic Bayesian network-based risk assessment framework for maritime trade routes," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    12. Wang, Chen & Zhang, Liming & Chen, Ling & Tan, Tian & Zhang, Cong, 2025. "Remaining useful life prediction of nuclear reactor control rod drive mechanism based on dynamic temporal convolutional network," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    13. Li, Xinyu & Cheng, Changming & Peng, Zhike, 2025. "Label-guided contrastive learning with weighted pseudo-labeling: A novel mechanical fault diagnosis method with insufficient annotated data," Reliability Engineering and System Safety, Elsevier, vol. 254(PA).
    14. Jiang, Hongyan & Cheng, Feng & Wu, Cong & Fang, Dianjun & Zeng, Yuhai, 2024. "A multi-period-sequential-index combination method for short-term prediction of small sample data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    15. Zheng, Shuwen & Pan, Kai & Liu, Jie & Chen, Yunxia, 2024. "Empirical study on fine-tuning pre-trained large language models for fault diagnosis of complex systems," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    16. Wang, Changdong & Tian, Bowen & Yang, Jingli & Jie, Huamin & Chang, Yongqi & Zhao, Zhenyu, 2024. "Neural-transformer: A brain-inspired lightweight mechanical fault diagnosis method under noise," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    17. Liu, Jianing & Cao, Hongrui & Luo, Yang, 2023. "An information-induced fault diagnosis framework generalizing from stationary to unknown nonstationary working conditions," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    18. Wang, Huan & Li, Yan-Fu, 2023. "Bioinspired membrane learnable spiking neural network for autonomous vehicle sensors fault diagnosis under open environments," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    19. Liu, Shaowei & Jiang, Hongkai & Wu, Zhenghong & Yi, Zichun & Wang, Ruixin, 2023. "Intelligent fault diagnosis of rotating machinery using a multi-source domain adaptation network with adversarial discrepancy matching," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    20. Yu, Xiaolei & Zhao, Zhibin & Zhang, Xingwu & Chen, Xuefeng & Cai, Jianbing, 2023. "Statistical identification guided open-set domain adaptation in fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 232(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:252:y:2024:i:c:s0951832024005052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.