IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v226y2022ics0951832022002836.html
   My bibliography  Save this article

Out-of-distribution detection-assisted trustworthy machinery fault diagnosis approach with uncertainty-aware deep ensembles

Author

Listed:
  • Han, Te
  • Li, Yan-Fu

Abstract

Recent intelligent fault diagnosis technologies can effectively identify the machinery health condition, while they are learnt based on a closed-world assumption, i.e., the training and testing data follow independently identically distribution (IID). However, in real-world diagnosis, the monitored samples are often from unknown distributions, such as unseen machine faults, leading to an out-of-distribution (OOD) problem. This is a challenging issue that may induce the model to produce unreliable and unsafe decision for unforeseen machine data. To tackle this problem, a novel OOD detection-assisted trustworthy machinery fault diagnosis approach is developed to enhance the reliability and safety of intelligent models. First, multiple deep neural networks are integrated to establish an ensemble diagnosis system, called deep ensembles. Then, the trustworthy analysis with uncertainty-aware deep ensembles is conducted to detect the OOD samples and issue the warnings for the potential untrustworthy diagnosis. A selection criterion of uncertainty threshold is given. Finally, the trustworthy decisions are achieved by comprehensively considering the deep ensembles’ prediction and uncertainty. The proposed trustworthy fault diagnosis approach is validated in two case studies, exhibiting significant advantages for diagnosing OOD samples.

Suggested Citation

  • Han, Te & Li, Yan-Fu, 2022. "Out-of-distribution detection-assisted trustworthy machinery fault diagnosis approach with uncertainty-aware deep ensembles," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
  • Handle: RePEc:eee:reensy:v:226:y:2022:i:c:s0951832022002836
    DOI: 10.1016/j.ress.2022.108648
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832022002836
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2022.108648?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    2. Wang, Xu & Shen, Changqing & Xia, Min & Wang, Dong & Zhu, Jun & Zhu, Zhongkui, 2020. "Multi-scale deep intra-class transfer learning for bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    3. Xiang, Sheng & Qin, Yi & Liu, Fuqiang & Gryllias, Konstantinos, 2022. "Automatic multi-differential deep learning and its application to machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    4. Hu, Yang & Miao, Xuewen & Si, Yong & Pan, Ershun & Zio, Enrico, 2022. "Prognostics and health management: A review from the perspectives of design, development and decision," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    5. Li, Xin & Zhong, Xiang & Shao, Haidong & Han, Te & Shen, Changqing, 2021. "Multi-sensor gearbox fault diagnosis by using feature-fusion covariance matrix and multi-Riemannian kernel ridge regression," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    6. Li, Yanfu & Zio, Enrico, 2012. "Uncertainty analysis of the adequacy assessment model of a distributed generation system," Renewable Energy, Elsevier, vol. 41(C), pages 235-244.
    7. Lee, Jinwook & Kim, Myungyon & Ko, Jin Uk & Jung, Joon Ha & Sun, Kyung Ho & Youn, Byeng D., 2022. "Asymmetric inter-intra domain alignments (AIIDA) method for intelligent fault diagnosis of rotating machinery," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dong, Manman & Cheng, Yongbo & Wan, Liangqi, 2024. "A new adaptive multi-kernel relevance vector regression for structural reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    2. Tian, Jilun & Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Luo, Hao & Yin, Shen, 2024. "A novel generalized source-free domain adaptation approach for cross-domain industrial fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    3. Cao, Yudong & Jia, Minping & Zhao, Xiaoli & Yan, Xiaoan & Feng, Ke, 2024. "Complex augmented representation network for transferable health prognosis of rolling bearing considering dynamic covariate shift," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    4. Floreale, Giovanni & Baraldi, Piero & Lu, Xuefei & Rossetti, Paolo & Zio, Enrico, 2024. "Sensitivity analysis by differential importance measure for unsupervised fault diagnostics," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    5. Feng, Tingting & Li, Shichao & Guo, Liang & Gao, Hongli & Chen, Tao & Yu, Yaoxiang, 2023. "A degradation-shock dependent competing failure processes based method for remaining useful life prediction of drill bit considering time-shifting sudden failure threshold," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    6. Yu, Xiaolei & Zhao, Zhibin & Zhang, Xingwu & Chen, Xuefeng & Cai, Jianbing, 2023. "Statistical identification guided open-set domain adaptation in fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    7. Xia, Pengcheng & Huang, Yixiang & Tao, Zhiyu & Liu, Chengliang & Liu, Jie, 2023. "A digital twin-enhanced semi-supervised framework for motor fault diagnosis based on phase-contrastive current dot pattern," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    8. Zhou, Chengyu & Fang, Xiaolei, 2023. "A convex two-dimensional variable selection method for the root-cause diagnostics of product defects," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    9. Reza Bazghandi & Mohammad Hoseintabar Marzebali & Vahid Abolghasemi & Shahin Hedayati Kia, 2023. "A Novel Mode Un-Mixing Approach in Variational Mode Decomposition for Fault Detection in Wound Rotor Induction Machines," Energies, MDPI, vol. 16(14), pages 1-17, July.
    10. Li, Yan-Fu & Wang, Huan & Sun, Muxia, 2024. "ChatGPT-like large-scale foundation models for prognostics and health management: A survey and roadmaps," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    11. Zhang, Wei & Wang, Ziwei & Li, Xiang, 2023. "Blockchain-based decentralized federated transfer learning methodology for collaborative machinery fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    12. Ma, Yulin & Yang, Jun & Li, Lei, 2023. "Gradient aligned domain generalization with a mutual teaching teacher-student network for intelligent fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    13. Liu, Yuanhong & Shi, Baoxin & Lu, Shixiang & Gao, Zhi-Wei & Zhang, Fangfang, 2024. "A novel local linear embedding algorithm via local mutual representation for bearing fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    14. Wang, Huan & Li, Yan-Fu, 2023. "Bioinspired membrane learnable spiking neural network for autonomous vehicle sensors fault diagnosis under open environments," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    15. Zhu, Zuanyu & Cheng, Junsheng & Wang, Ping & Wang, Jian & Kang, Xin & Yang, Yu, 2023. "A novel fault diagnosis framework for rotating machinery with hierarchical multiscale symbolic diversity entropy and robust twin hyperdisk-based tensor machine," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    16. Li, Xin & Li, Yong & Yan, Ke & Shao, Haidong & (Jing) Lin, Janet, 2023. "Intelligent fault diagnosis of bevel gearboxes using semi-supervised probability support matrix machine and infrared imaging," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    17. Wang, Jinrui & Zhang, Zongzhen & Liu, Zhiliang & Han, Baokun & Bao, Huaiqian & Ji, Shanshan, 2023. "Digital twin aided adversarial transfer learning method for domain adaptation fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    18. Huang, Keke & Tao, Shijun & Wu, Dehao & Yang, Chunhua & Gui, Weihua, 2024. "Robust condition identification against label noise in industrial processes based on trusted connection dictionary learning," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    19. Shao, Kaixuan & He, Yigang & Xing, Zhikai & Du, Bolun, 2023. "Detecting wind turbine anomalies using nonlinear dynamic parameters-assisted machine learning with normal samples," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    20. Hanting Zhou & Wenhe Chen & Jing Liu & Longsheng Cheng & Min Xia, 2024. "Trustworthy and intelligent fault diagnosis with effective denoising and evidential stacked GRU neural network," Journal of Intelligent Manufacturing, Springer, vol. 35(7), pages 3523-3542, October.
    21. Wenhao Lu & Wei Wang & Xuefei Qin & Zhiqiang Cai, 2024. "Enhancing Fault Diagnosis in Mechanical Systems with Graph Neural Networks Addressing Class Imbalance," Mathematics, MDPI, vol. 12(13), pages 1-22, July.
    22. Zhao, Zeyun & Wang, Jia & Tao, Qian & Li, Andong & Chen, Yiyang, 2024. "An unknown wafer surface defect detection approach based on Incremental Learning for reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    23. Zhang, Qing & Tang, Lv & Xuan, Jianping & Shi, Tielin & Li, Rui, 2023. "An uncertainty relevance metric-based domain adaptation fault diagnosis method to overcome class relevance caused confusion," Reliability Engineering and System Safety, Elsevier, vol. 231(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Taotao & Han, Te & Droguett, Enrique Lopez, 2022. "Towards trustworthy machine fault diagnosis: A probabilistic Bayesian deep learning framework," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    2. Liu, Shaowei & Jiang, Hongkai & Wu, Zhenghong & Yi, Zichun & Wang, Ruixin, 2023. "Intelligent fault diagnosis of rotating machinery using a multi-source domain adaptation network with adversarial discrepancy matching," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    3. Yu, Xiaolei & Zhao, Zhibin & Zhang, Xingwu & Chen, Xuefeng & Cai, Jianbing, 2023. "Statistical identification guided open-set domain adaptation in fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    4. Tan, Hongchuang & Xie, Suchao & Ma, Wen & Yang, Chengxing & Zheng, Shiwei, 2023. "Correlation feature distribution matching for fault diagnosis of machines," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    5. Li, Yan-Fu & Wang, Huan & Sun, Muxia, 2024. "ChatGPT-like large-scale foundation models for prognostics and health management: A survey and roadmaps," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    6. Wang, Jianyu & Zeng, Zhiguo & Zhang, Heng & Barros, Anne & Miao, Qiang, 2022. "An hybrid domain adaptation diagnostic network guided by curriculum pseudo labels for electro-mechanical actuator," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    7. Zuo, Jian & Cadet, Catherine & Li, Zhongliang & Bérenguer, Christophe & Outbib, Rachid, 2024. "A deterioration-aware energy management strategy for the lifetime improvement of a multi-stack fuel cell system subject to a random dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Zhao, Chao & Shen, Weiming, 2022. "Adaptive open set domain generalization network: Learning to diagnose unknown faults under unknown working conditions," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    9. Guo, Jianchun & Si, Zetian & Liu, Yi & Li, Jiahao & Li, Yanting & Xiang, Jiawei, 2022. "Dynamic time warping using graph similarity guided symplectic geometry mode decomposition to detect bearing faults," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    10. Zhang, Xinwei & Feng, Yong & Chen, Jinglong & Liu, Zijun & Wang, Jun & Huang, Hong, 2024. "Knowledge distillation-optimized two-stage anomaly detection for liquid rocket engine with missing multimodal data," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    11. Li, Qi & Chen, Liang & Kong, Lin & Wang, Dong & Xia, Min & Shen, Changqing, 2023. "Cross-domain augmentation diagnosis: An adversarial domain-augmented generalization method for fault diagnosis under unseen working conditions," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    12. Zou, Xinyu & Tao, Laifa & Sun, Lulu & Wang, Chao & Ma, Jian & Lu, Chen, 2023. "A case-learning-based paradigm for quantitative recommendation of fault diagnosis algorithms: A case study of gearbox," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    13. Shi, Yaowei & Deng, Aidong & Deng, Minqiang & Xu, Meng & Liu, Yang & Ding, Xue & Bian, Wenbin, 2023. "Domain augmentation generalization network for real-time fault diagnosis under unseen working conditions," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    14. Gao, Dawei & Huang, Kai & Zhu, Yongsheng & Zhu, Linbo & Yan, Ke & Ren, Zhijun & Guedes Soares, C., 2024. "Semi-supervised small sample fault diagnosis under a wide range of speed variation conditions based on uncertainty analysis," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    15. Park, Chan Hee & Kim, Hyeongmin & Suh, Chaehyun & Chae, Minseok & Yoon, Heonjun & Youn, Byeng D., 2022. "A health image for deep learning-based fault diagnosis of a permanent magnet synchronous motor under variable operating conditions: Instantaneous current residual map," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    16. He, Yuxuan & Su, Huai & Zio, Enrico & Peng, Shiliang & Fan, Lin & Yang, Zhaoming & Yang, Zhe & Zhang, Jinjun, 2023. "A systematic method of remaining useful life estimation based on physics-informed graph neural networks with multisensor data," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    17. Ma, Chenyang & Li, Yongbo & Wang, Xianzhi & Cai, Zhiqiang, 2023. "Early fault diagnosis of rotating machinery based on composite zoom permutation entropy," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    18. Mandelli, Diego & Wang, Congjian & Agarwal, Vivek & Lin, Linyu & Manjunatha, Koushik A., 2024. "Reliability modeling in a predictive maintenance context: A margin-based approach," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    19. Park, Hyung Jun & Kim, Nam H. & Choi, Joo-Ho, 2024. "A robust health prediction using Bayesian approach guided by physical constraints," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    20. Shi, Yaowei & Deng, Aidong & Deng, Minqiang & Xu, Meng & Liu, Yang & Ding, Xue & Li, Jing, 2022. "Transferable adaptive channel attention module for unsupervised cross-domain fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 226(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:226:y:2022:i:c:s0951832022002836. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.