IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v218y2022ipas0951832021006207.html
   My bibliography  Save this article

Self-supervised pretraining via contrast learning for intelligent incipient fault detection of bearings

Author

Listed:
  • Ding, Yifei
  • Zhuang, Jichao
  • Ding, Peng
  • Jia, Minping

Abstract

Data-driven approaches for prognostic and health management (PHM) increasingly rely on massive historical data, yet annotations are expensive and time-consuming. Learning approaches that utilize semi-labeled or unlabeled data are becoming increasingly popular. In this paper, a self-supervised pre-training via contrast learning (SSPCL) is introduced to learn discriminative representations from unlabeled bearing datasets. Specifically, the SSPCL employs momentum contrast learning (MCL) to investigate the local representation in terms of instance-level discrimination contrast. Further, we propose a specific architecture for SSPCL deployment on bearing vibration signals by presenting several data augmentations for 1D sequences. On this basis, we put forward an incipient fault detection method based on SSPCL for run-to-failure cycle of rolling bearings. This approach transfers the SSPCL pre-trained model to a specific semi-supervised downstream task, effectively utilizing all unlabeled data and relying on only a little priori knowledge. A case study on FEMTO-ST datasets shows that the fine-tuned model is competent for incipient fault detection, outperforming other state-of-the-art methods. Furthermore, a supplemental case on a self-built fault datasets further demonstrate the great potential and superiority of our proposed SSPCL method in PHM.

Suggested Citation

  • Ding, Yifei & Zhuang, Jichao & Ding, Peng & Jia, Minping, 2022. "Self-supervised pretraining via contrast learning for intelligent incipient fault detection of bearings," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
  • Handle: RePEc:eee:reensy:v:218:y:2022:i:pa:s0951832021006207
    DOI: 10.1016/j.ress.2021.108126
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021006207
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.108126?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tian Wang & Meina Qiao & Mengyi Zhang & Yi Yang & Hichem Snoussi, 2020. "Data-driven prognostic method based on self-supervised learning approaches for fault detection," Journal of Intelligent Manufacturing, Springer, vol. 31(7), pages 1611-1619, October.
    2. Wang, Xu & Shen, Changqing & Xia, Min & Wang, Dong & Zhu, Jun & Zhu, Zhongkui, 2020. "Multi-scale deep intra-class transfer learning for bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    3. Zhang, Liangwei & Lin, Jing & Shao, Haidong & Zhang, Zhicong & Yan, Xiaohui & Long, Jianyu, 2021. "End-to-end unsupervised fault detection using a flow-based model," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    4. Xu, Fan & Yang, Fangfang & Fei, Zicheng & Huang, Zhelin & Tsui, Kwok-Leung, 2021. "Life prediction of lithium-ion batteries based on stacked denoising autoencoders," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Sai & Peng, Yanfeng & Shen, Yiping & Zhao, Sibo & Shao, Haidong & Bin, Guangfu & Guo, Yong & Yang, Xingkai & Fan, Chao, 2024. "Rolling Bearing Fault Diagnosis Under Data Imbalance and Variable Speed Based on Adaptive Clustering Weighted Oversampling," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    2. Liu, Shaowei & Jiang, Hongkai & Wu, Zhenghong & Yi, Zichun & Wang, Ruixin, 2023. "Intelligent fault diagnosis of rotating machinery using a multi-source domain adaptation network with adversarial discrepancy matching," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    3. Zitong Yan & Hongmei Liu, 2022. "SMoCo: A Powerful and Efficient Method Based on Self-Supervised Learning for Fault Diagnosis of Aero-Engine Bearing under Limited Data," Mathematics, MDPI, vol. 10(15), pages 1-24, August.
    4. Panjapornpon, Chanin & Bardeeniz, Santi & Hussain, Mohamed Azlan, 2023. "Deep learning approach for energy efficiency prediction with signal monitoring reliability for a vinyl chloride monomer process," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    5. Wang, Yilin & Li, Yuanxiang & Zhang, Yuxuan & Lei, Jia & Yu, Yifei & Zhang, Tongtong & Yang, Yongshen & Zhao, Honghua, 2024. "Incorporating prior knowledge into self-supervised representation learning for long PHM signal," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    6. Zuo, Lin & Xu, Fengjie & Zhang, Changhua & Xiahou, Tangfan & Liu, Yu, 2022. "A multi-layer spiking neural network-based approach to bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    7. Dong, Shaojiang & Xiao, Jiafeng & Hu, Xiaolin & Fang, Nengwei & Liu, Lanhui & Yao, Jinbao, 2023. "Deep transfer learning based on Bi-LSTM and attention for remaining useful life prediction of rolling bearing," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    8. Mohammed Majid Abdulrazzaq & Nehad T. A. Ramaha & Alaa Ali Hameed & Mohammad Salman & Dong Keon Yon & Norma Latif Fitriyani & Muhammad Syafrudin & Seung Won Lee, 2024. "Consequential Advancements of Self-Supervised Learning (SSL) in Deep Learning Contexts," Mathematics, MDPI, vol. 12(5), pages 1-42, March.
    9. Li, Yan-Fu & Wang, Huan & Sun, Muxia, 2024. "ChatGPT-like large-scale foundation models for prognostics and health management: A survey and roadmaps," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    10. Zheng, Niannian & Luan, Xiaoli & Shardt, Yuri A.W. & Liu, Fei, 2024. "Dynamic-controlled principal component analysis for fault detection and automatic recovery," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    11. Li, Jimeng & Mao, Weilin & Yang, Bixin & Meng, Zong & Tong, Kai & Yu, Shancheng, 2024. "RUL prediction of rolling bearings across working conditions based on multi-scale convolutional parallel memory domain adaptation network," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    12. Shi, Yaowei & Deng, Aidong & Deng, Minqiang & Xu, Meng & Liu, Yang & Ding, Xue & Li, Jing, 2022. "Transferable adaptive channel attention module for unsupervised cross-domain fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    13. Dong, Yutong & Jiang, Hongkai & Yao, Renhe & Mu, Mingzhe & Yang, Qiao, 2024. "Rolling bearing intelligent fault diagnosis towards variable speed and imbalanced samples using multiscale dynamic supervised contrast learning," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    14. Xiaobo Liu & Hantao Guo & Yibing Liu, 2022. "One-Shot Fault Diagnosis of Wind Turbines Based on Meta-Analogical Momentum Contrast Learning," Energies, MDPI, vol. 15(9), pages 1-14, April.
    15. Shi, Yaowei & Deng, Aidong & Deng, Minqiang & Xu, Meng & Liu, Yang & Ding, Xue & Bian, Wenbin, 2023. "Domain augmentation generalization network for real-time fault diagnosis under unseen working conditions," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    16. Li, Xin & Li, Yong & Yan, Ke & Shao, Haidong & (Jing) Lin, Janet, 2023. "Intelligent fault diagnosis of bevel gearboxes using semi-supervised probability support matrix machine and infrared imaging," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    17. Ding, Yifei & Jia, Minping & Zhuang, Jichao & Cao, Yudong & Zhao, Xiaoli & Lee, Chi-Guhn, 2023. "Deep imbalanced domain adaptation for transfer learning fault diagnosis of bearings under multiple working conditions," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. Shao, Kaixuan & He, Yigang & Xing, Zhikai & Du, Bolun, 2023. "Detecting wind turbine anomalies using nonlinear dynamic parameters-assisted machine learning with normal samples," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    19. Zheng, Jianqin & Wang, Chang & Liang, Yongtu & Liao, Qi & Li, Zhuochao & Wang, Bohong, 2022. "Deeppipe: A deep-learning method for anomaly detection of multi-product pipelines," Energy, Elsevier, vol. 259(C).
    20. Yu, Aobo & Cai, Bolin & Wu, Qiujie & García, Miguel Martínez & Li, Jing & Chen, Xiangcheng, 2024. "Source-free domain adaptation method for fault diagnosis of rotation machinery under partial information," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    21. Fang, Xiaoyu & Qu, Jianfeng & Chai, Yi, 2023. "Self-supervised intermittent fault detection for analog circuits guided by prior knowledge," Reliability Engineering and System Safety, Elsevier, vol. 233(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moradi, Ramin & Cofre-Martel, Sergio & Lopez Droguett, Enrique & Modarres, Mohammad & Groth, Katrina M., 2022. "Integration of deep learning and Bayesian networks for condition and operation risk monitoring of complex engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    2. Hou, Hui & Liu, Chao & Wei, Ruizeng & He, Huan & Wang, Lei & Li, Weibo, 2023. "Outage duration prediction under typhoon disaster with stacking ensemble learning," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    3. Liu, Jiale & Wang, Huan, 2024. "A brain-inspired energy-efficient Wide Spiking Residual Attention Framework for intelligent fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    4. Tan, Hongchuang & Xie, Suchao & Ma, Wen & Yang, Chengxing & Zheng, Shiwei, 2023. "Correlation feature distribution matching for fault diagnosis of machines," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    5. Cao, Mengda & Zhang, Tao & Liu, Yajie & Zhang, Yajun & Wang, Yu & Li, Kaiwen, 2022. "An ensemble learning prognostic method for capacity estimation of lithium-ion batteries based on the V-IOWGA operator," Energy, Elsevier, vol. 257(C).
    6. Mohammed Majid Abdulrazzaq & Nehad T. A. Ramaha & Alaa Ali Hameed & Mohammad Salman & Dong Keon Yon & Norma Latif Fitriyani & Muhammad Syafrudin & Seung Won Lee, 2024. "Consequential Advancements of Self-Supervised Learning (SSL) in Deep Learning Contexts," Mathematics, MDPI, vol. 12(5), pages 1-42, March.
    7. Shi, Yaowei & Deng, Aidong & Deng, Minqiang & Xu, Meng & Liu, Yang & Ding, Xue & Li, Jing, 2022. "Transferable adaptive channel attention module for unsupervised cross-domain fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    8. Dong, Yutong & Jiang, Hongkai & Wu, Zhenghong & Yang, Qiao & Liu, Yunpeng, 2023. "Digital twin-assisted multiscale residual-self-attention feature fusion network for hypersonic flight vehicle fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    9. Wei, Yupeng & Wu, Dazhong, 2023. "Prediction of state of health and remaining useful life of lithium-ion battery using graph convolutional network with dual attention mechanisms," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    10. Zhang, Qing & Tang, Lv & Xuan, Jianping & Shi, Tielin & Li, Rui, 2023. "An uncertainty relevance metric-based domain adaptation fault diagnosis method to overcome class relevance caused confusion," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    11. Wu, Jingyao & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Learning from Class-imbalanced Data with a Model-Agnostic Framework for Machine Intelligent Diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    12. Abdellatif Elmouatamid & Brian Fricke & Jian Sun & Philip W. T. Pong, 2023. "Air Conditioning Systems Fault Detection and Diagnosis-Based Sensing and Data-Driven Approaches," Energies, MDPI, vol. 16(12), pages 1-20, June.
    13. Tang, Ting & Yuan, Huimei, 2022. "A hybrid approach based on decomposition algorithm and neural network for remaining useful life prediction of lithium-ion battery," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    14. Coraça, Eduardo M. & Ferreira, Janito V. & Nóbrega, Eurípedes G.O., 2023. "An unsupervised structural health monitoring framework based on Variational Autoencoders and Hidden Markov Models," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    15. Ma, Yulin & Li, Lei & Yang, Jun, 2022. "Convolutional kernel aggregated domain adaptation for intelligent fault diagnosis with label noise," Reliability Engineering and System Safety, Elsevier, vol. 227(C).
    16. Kong, Jin-zhen & Yang, Fangfang & Zhang, Xi & Pan, Ershun & Peng, Zhike & Wang, Dong, 2021. "Voltage-temperature health feature extraction to improve prognostics and health management of lithium-ion batteries," Energy, Elsevier, vol. 223(C).
    17. Zhao, Chao & Shen, Weiming, 2022. "Adaptive open set domain generalization network: Learning to diagnose unknown faults under unknown working conditions," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    18. Li, Xin & Yang, Yu & Wu, Zhantao & Yan, Ke & Shao, Haidong & Cheng, Junsheng, 2022. "High-accuracy gearbox health state recognition based on graph sparse random vector functional link network," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    19. Braga, Joaquim A.P. & Andrade, António R., 2021. "Multivariate statistical aggregation and dimensionality reduction techniques to improve monitoring and maintenance in railways: The wheelset component," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    20. Guo, Jianchun & Si, Zetian & Liu, Yi & Li, Jiahao & Li, Yanting & Xiang, Jiawei, 2022. "Dynamic time warping using graph similarity guided symplectic geometry mode decomposition to detect bearing faults," Reliability Engineering and System Safety, Elsevier, vol. 224(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:218:y:2022:i:pa:s0951832021006207. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.