IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v215y2021ics0951832021003288.html
   My bibliography  Save this article

End-to-end unsupervised fault detection using a flow-based model

Author

Listed:
  • Zhang, Liangwei
  • Lin, Jing
  • Shao, Haidong
  • Zhang, Zhicong
  • Yan, Xiaohui
  • Long, Jianyu

Abstract

Fault detection has been extensively studied in both academia and industry. The rareness of faulty samples in the real world restricts the use of many supervised models, and the reliance on domain expertise for feature engineering raises other barriers. For this reason, this paper proposes an unsupervised, end-to-end approach to fault detection based on a flow-based model, the Nonlinear Independent Components Estimation (NICE) model. A NICE model models a target distribution via a sequence of invertible transformations to a prior distribution in the latent space. We prove that, under certain conditions, the L2-norm of normal samples’ latent codes in a trained NICE model is Chi-distributed. This facilitates the use of hypothesis testing for fault detection purpose. Concretely, we first apply Zero-phase Component Analysis to decorrelate the data of normal states. The whitened data are fed to a NICE model for training, in a maximum likelihood sense. At the testing stage, samples whose L2-norm of latent codes fail in the hypothesis testing are suspected of being generated by different mechanisms and hence regarded as potential faults. The proposed approach was validated on two datasets of vibration signals; it proved superior to several alternatives. We also show the use of NICE, a type of generative model, can produce real-like vibration signals because of the model's bijective nature.

Suggested Citation

  • Zhang, Liangwei & Lin, Jing & Shao, Haidong & Zhang, Zhicong & Yan, Xiaohui & Long, Jianyu, 2021. "End-to-end unsupervised fault detection using a flow-based model," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
  • Handle: RePEc:eee:reensy:v:215:y:2021:i:c:s0951832021003288
    DOI: 10.1016/j.ress.2021.107805
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832021003288
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2021.107805?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Li, Rui & Verhagen, Wim J.C. & Curran, Richard, 2020. "A systematic methodology for Prognostic and Health Management system architecture definition," Reliability Engineering and System Safety, Elsevier, vol. 193(C).
    2. Shi, Zunya & Chehade, Abdallah, 2021. "A dual-LSTM framework combining change point detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    3. Zhang, Liangwei & Lin, Jing & Karim, Ramin, 2015. "An angle-based subspace anomaly detection approach to high-dimensional data: With an application to industrial fault detection," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 482-497.
    4. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    5. Liu, Zepeng & Zhang, Long & Carrasco, Joaquin, 2020. "Vibration analysis for large-scale wind turbine blade bearing fault detection with an empirical wavelet thresholding method," Renewable Energy, Elsevier, vol. 146(C), pages 99-110.
    6. Compare, Michele & Bellani, Luca & Zio, Enrico, 2017. "Reliability model of a component equipped with PHM capabilities," Reliability Engineering and System Safety, Elsevier, vol. 168(C), pages 4-11.
    7. Jeong, Haedong & Park, Bumsoo & Park, Seungtae & Min, Hyungcheol & Lee, Seungchul, 2019. "Fault detection and identification method using observer-based residuals," Reliability Engineering and System Safety, Elsevier, vol. 184(C), pages 27-40.
    8. Fan, Yuantao & Nowaczyk, Sławomir & Rögnvaldsson, Thorsteinn, 2020. "Transfer learning for remaining useful life prediction based on consensus self-organizing models," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    9. Gabriel Michau & Yang Hu & Thomas Palmé & Olga Fink, 2020. "Feature learning for fault detection in high-dimensional condition monitoring signals," Journal of Risk and Reliability, , vol. 234(1), pages 104-115, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ding, Yifei & Zhuang, Jichao & Ding, Peng & Jia, Minping, 2022. "Self-supervised pretraining via contrast learning for intelligent incipient fault detection of bearings," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    2. Chen, Zhen & Zhou, Di & Zio, Enrico & Xia, Tangbin & Pan, Ershun, 2023. "Adaptive transfer learning for multimode process monitoring and unsupervised anomaly detection in steam turbines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    3. He, Jiahui & Cheng, Zhijun & Guo, Bo, 2024. "Anomaly detection in telemetry data using a jointly optimal one-class support vector machine with dictionary learning," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    4. Zhao, Shuaiyu & Duan, Yiling & Roy, Nitin & Zhang, Bin, 2024. "A deep learning methodology based on adaptive multiscale CNN and enhanced highway LSTM for industrial process fault diagnosis," Reliability Engineering and System Safety, Elsevier, vol. 249(C).
    5. Xu, Yadong & Yan, Xiaoan & Sun, Beibei & Liu, Zheng, 2022. "Global contextual residual convolutional neural networks for motor fault diagnosis under variable-speed conditions," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    6. Rivas, Andy & Delipei, Gregory Kyriakos & Davis, Ian & Bhongale, Satyan & Yang, Jinan & Hou, Jason, 2024. "A component diagnostic and prognostic framework for pump bearings based on deep learning with data augmentation," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    7. Xu, Yadong & Yan, Xiaoan & Sun, Beibei & Liu, Zheng, 2022. "Dually attentive multiscale networks for health state recognition of rotating machinery," Reliability Engineering and System Safety, Elsevier, vol. 225(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fallahdizcheh, Amirhossein & Wang, Chao, 2022. "Transfer learning of degradation modeling and prognosis based on multivariate functional analysis with heterogeneous sampling rates," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    2. Hu, Yang & Miao, Xuewen & Si, Yong & Pan, Ershun & Zio, Enrico, 2022. "Prognostics and health management: A review from the perspectives of design, development and decision," Reliability Engineering and System Safety, Elsevier, vol. 217(C).
    3. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    4. Costa, Nahuel & Sánchez, Luciano, 2022. "Variational encoding approach for interpretable assessment of remaining useful life estimation," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    5. Zou, Xinyu & Tao, Laifa & Sun, Lulu & Wang, Chao & Ma, Jian & Lu, Chen, 2023. "A case-learning-based paradigm for quantitative recommendation of fault diagnosis algorithms: A case study of gearbox," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    6. Moradi, Ramin & Cofre-Martel, Sergio & Lopez Droguett, Enrique & Modarres, Mohammad & Groth, Katrina M., 2022. "Integration of deep learning and Bayesian networks for condition and operation risk monitoring of complex engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    7. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    8. Park, Chan Hee & Kim, Hyeongmin & Suh, Chaehyun & Chae, Minseok & Yoon, Heonjun & Youn, Byeng D., 2022. "A health image for deep learning-based fault diagnosis of a permanent magnet synchronous motor under variable operating conditions: Instantaneous current residual map," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    9. Liu, Jianing & Cao, Hongrui & Luo, Yang, 2023. "An information-induced fault diagnosis framework generalizing from stationary to unknown nonstationary working conditions," Reliability Engineering and System Safety, Elsevier, vol. 237(C).
    10. He, Jiahui & Cheng, Zhijun & Guo, Bo, 2024. "Anomaly detection in telemetry data using a jointly optimal one-class support vector machine with dictionary learning," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    11. Liu, Shaowei & Jiang, Hongkai & Wu, Zhenghong & Yi, Zichun & Wang, Ruixin, 2023. "Intelligent fault diagnosis of rotating machinery using a multi-source domain adaptation network with adversarial discrepancy matching," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    12. Lee, Jinwook & Kim, Myungyon & Ko, Jin Uk & Jung, Joon Ha & Sun, Kyung Ho & Youn, Byeng D., 2022. "Asymmetric inter-intra domain alignments (AIIDA) method for intelligent fault diagnosis of rotating machinery," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    13. Fu, Song & Zhang, Yongjian & Lin, Lin & Zhao, Minghang & Zhong, Shi-sheng, 2021. "Deep residual LSTM with domain-invariance for remaining useful life prediction across domains," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    14. Liu, Lu & Song, Xiao & Zhou, Zhetao, 2022. "Aircraft engine remaining useful life estimation via a double attention-based data-driven architecture," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    15. Wang, Chu & Dou, Manfeng & Li, Zhongliang & Outbib, Rachid & Zhao, Dongdong & Zuo, Jian & Wang, Yuanlin & Liang, Bin & Wang, Peng, 2023. "Data-driven prognostics based on time-frequency analysis and symbolic recurrent neural network for fuel cells under dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    16. Rivas, Andy & Delipei, Gregory Kyriakos & Davis, Ian & Bhongale, Satyan & Yang, Jinan & Hou, Jason, 2024. "A component diagnostic and prognostic framework for pump bearings based on deep learning with data augmentation," Reliability Engineering and System Safety, Elsevier, vol. 247(C).
    17. Amirhossein Hosseinzadeh Dadash & Niclas Björsell, 2024. "Infinite-Horizon Degradation Control Based on Optimization of Degradation-Aware Cost Function," Mathematics, MDPI, vol. 12(5), pages 1-24, February.
    18. Ma, Zhonghai & Liao, Haitao & Gao, Jianhang & Nie, Songlin & Geng, Yugang, 2023. "Physics-Informed Machine Learning for Degradation Modeling of an Electro-Hydrostatic Actuator System," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    19. Shahil Kumar & Krish Kumar Raj & Maurizio Cirrincione & Giansalvo Cirrincione & Vincenzo Franzitta & Rahul Ranjeev Kumar, 2024. "A Comprehensive Review of Remaining Useful Life Estimation Approaches for Rotating Machinery," Energies, MDPI, vol. 17(22), pages 1-46, November.
    20. Azar, Kamyar & Hajiakhondi-Meybodi, Zohreh & Naderkhani, Farnoosh, 2022. "Semi-supervised clustering-based method for fault diagnosis and prognosis: A case study," Reliability Engineering and System Safety, Elsevier, vol. 222(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:215:y:2021:i:c:s0951832021003288. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.