IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v252y2024ics0951832024005052.html
   My bibliography  Save this article

Reserving embedding space for new fault types: A new continual learning method for bearing fault diagnosis

Author

Listed:
  • Zhu, Hongyan
  • Shen, Changqing
  • Li, Lin
  • Wang, Dong
  • Huang, Weiguo
  • Zhu, Zhongkui

Abstract

In complex operating environments, rotating equipment may continually generate new fault categories, affecting the safety of equipment operation, and the number of collected fault samples is limited, which make it difficult to establish a reliable diagnostic model. Few-shot continual learning (FSCL) can continuously learn and summarize fault knowledge from limited samples. These traditional FSCL models, when learning from limited samples of new types of bearing faults, exhibit model overfitting and catastrophic forgetting issues after self-updating (new model). This phenomenon significantly limits the reliability of traditional models. This paper presents a new approach coined as reserving embedding space for new fault types (RESNFT) for continual learning of newly occurred bearing faults for machinery fault diagnosis, which includes several key and new ideas. Preliminary, a class prototype (prototype vector) is derived to replace a classifier weight. Then, embedding space reserved by forcibly assigning real fault samples to both real and virtual categories can mitigate catastrophic forgetting. Finally, virtual faults formed by sample mixing guide new fault samples to the reserved embedding space, and realize continuous classification of new faults. Results show that the RESNFT can effectively alleviate the catastrophic forgetting and overfitting problems, and it is superior to other existing methods.

Suggested Citation

  • Zhu, Hongyan & Shen, Changqing & Li, Lin & Wang, Dong & Huang, Weiguo & Zhu, Zhongkui, 2024. "Reserving embedding space for new fault types: A new continual learning method for bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
  • Handle: RePEc:eee:reensy:v:252:y:2024:i:c:s0951832024005052
    DOI: 10.1016/j.ress.2024.110433
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832024005052
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2024.110433?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cai, Xiao & Li, Naipeng & Xie, Min, 2024. "RUL prediction for two-phase degrading systems considering physical damage observations," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    2. Miao, Mengqi & Yu, Jianbo, 2024. "Deep feature interactive network for machinery fault diagnosis using multi-source heterogeneous data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    3. Li, Sai & Peng, Yanfeng & Shen, Yiping & Zhao, Sibo & Shao, Haidong & Bin, Guangfu & Guo, Yong & Yang, Xingkai & Fan, Chao, 2024. "Rolling Bearing Fault Diagnosis Under Data Imbalance and Variable Speed Based on Adaptive Clustering Weighted Oversampling," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    4. Shi, Peiming & Wu, Shuping & Xu, Xuefang & Zhang, Bofei & Liang, Pengfei & Qiao, Zijian, 2023. "TSN: A novel intelligent fault diagnosis method for bearing with small samples under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 240(C).
    5. Zuo, Lin & Xu, Fengjie & Zhang, Changhua & Xiahou, Tangfan & Liu, Yu, 2022. "A multi-layer spiking neural network-based approach to bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    6. Yu, Aobo & Cai, Bolin & Wu, Qiujie & García, Miguel Martínez & Li, Jing & Chen, Xiangcheng, 2024. "Source-free domain adaptation method for fault diagnosis of rotation machinery under partial information," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    7. Wu, Zhangjun & Xu, Renli & Luo, Yuansheng & Shao, Haidong, 2024. "A holistic semi-supervised method for imbalanced fault diagnosis of rotational machinery with out-of-distribution samples," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    8. Chen, Pengfei & Zhao, Rongzhen & He, Tianjing & Wei, Kongyuan & Yuan, Jianhui, 2023. "A novel bearing fault diagnosis method based joint attention adversarial domain adaptation," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yu, Tian & Li, Chaoshun & Huang, Jie & Xiao, Xiangqu & Zhang, Xiaoyuan & Li, Yuhong & Fu, Bitao, 2024. "ReF-DDPM: A novel DDPM-based data augmentation method for imbalanced rolling bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    2. Liu, Jiale & Wang, Huan, 2024. "A brain-inspired energy-efficient Wide Spiking Residual Attention Framework for intelligent fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    3. Yue, Ke & Li, Jipu & Deng, Shuhan & Kwoh, Chee Keong & Chen, Zhuyun & Li, Weihua, 2024. "A relationship-aware calibrated prototypical network for fault incremental diagnosis of electric motors without reserved samples," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    4. Liu, Jie & He, Zihan & Miao, Yonghao, 2024. "Causality-based adversarial attacks for robust GNN modelling with application in fault detection," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    5. Zhang, Guowei & Kong, Xianguang & Wang, Qibin & Du, Jingli & Wang, Jinrui & Ma, Hongbo, 2024. "Single domain generalization method based on anti-causal learning for rotating machinery fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    6. Pang, Zhendong & Luan, Yingxin & Chen, Jiahong & Li, Teng, 2024. "ParInfoGPT: An LLM-based two-stage framework for reliability assessment of rotating machine under partial information," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    7. Chen, Xirui & Liu, Hui, 2025. "Domain correction for hydraulic internal pump leakage detection considering multiclass aberrant flow data," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    8. Tan, Hongchuang & Xie, Suchao & Ma, Wen & Yang, Chengxing & Zheng, Shiwei, 2023. "Correlation feature distribution matching for fault diagnosis of machines," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    9. Li, Qikang & Tang, Baoping & Deng, Lei & Yang, Qichao & Zhu, Peng, 2024. "Adaptive centroid prototype-based domain adaptation for fault diagnosis of rotating machinery without source data," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    10. Tito G. Amaral & Vitor Fernão Pires & Armando Cordeiro & Daniel Foito & João F. Martins & Julia Yamnenko & Tetyana Tereschenko & Liudmyla Laikova & Ihor Fedin, 2023. "Incipient Fault Diagnosis of a Grid-Connected T-Type Multilevel Inverter Using Multilayer Perceptron and Walsh Transform," Energies, MDPI, vol. 16(6), pages 1-18, March.
    11. Zhang, Wei & Wang, Ziwei & Li, Xiang, 2023. "Blockchain-based decentralized federated transfer learning methodology for collaborative machinery fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    12. Zhang, Jian-Xun & Zhang, Jia-Ling & Zhang, Zheng-Xin & Li, Tian-Mei & Si, Xiao-Sheng, 2024. "Remaining useful life prediction for stochastic degrading devices incorporating quantization," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    13. Li, Ying & Zhang, Lijie & Liang, Pengfei & Wang, Xiangfeng & Wang, Bin & Xu, Leitao, 2024. "Semi-supervised meta-path space extended graph convolution network for intelligent fault diagnosis of rotating machinery under time-varying speeds," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    14. Kim, Yong Chae & Lee, Jinwook & Kim, Taehun & Baek, Jonghwa & Ko, Jin Uk & Jung, Joon Ha & Youn, Byeng D., 2024. "Gradient Alignment based Partial Domain Adaptation (GAPDA) using a domain knowledge filter for fault diagnosis of bearing," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    15. Fan, Hanwen & Jia, Haiying & He, Xuzhuo & Lyu, Jing, 2024. "Navigating uncertainty: A dynamic Bayesian network-based risk assessment framework for maritime trade routes," Reliability Engineering and System Safety, Elsevier, vol. 250(C).
    16. Wang, Chen & Zhang, Liming & Chen, Ling & Tan, Tian & Zhang, Cong, 2025. "Remaining useful life prediction of nuclear reactor control rod drive mechanism based on dynamic temporal convolutional network," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    17. Liu, Zhao-Hua & Chen, Liang & Wei, Hua-Liang & Wu, Fa-Ming & Chen, Lei & Chen, Ya-Nan, 2023. "A Tensor-based domain alignment method for intelligent fault diagnosis of rolling bearing in rotating machinery," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. Kim, Gyeongho & Kang, Yun Seok & Yang, Sang Min & Choi, Jae Gyeong & Hwang, Gahyun & Park, Hyung Wook & Lim, Sunghoon, 2025. "Fisher-informed continual learning for remaining useful life prediction of machining tools under varying operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    19. Li, Xinyu & Cheng, Changming & Peng, Zhike, 2025. "Label-guided contrastive learning with weighted pseudo-labeling: A novel mechanical fault diagnosis method with insufficient annotated data," Reliability Engineering and System Safety, Elsevier, vol. 254(PA).
    20. Jiang, Hongyan & Cheng, Feng & Wu, Cong & Fang, Dianjun & Zeng, Yuhai, 2024. "A multi-period-sequential-index combination method for short-term prediction of small sample data," Reliability Engineering and System Safety, Elsevier, vol. 242(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:252:y:2024:i:c:s0951832024005052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.