IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v235y2023ics0951832023001473.html
   My bibliography  Save this article

Causal Graph Attention Network with Disentangled Representations for Complex Systems Fault Detection

Author

Listed:
  • Liu, Jie
  • Zheng, Shuwen
  • Wang, Chong

Abstract

Considering the importance of complex systems fault detection, much efforts have been dedicated to fault feature extraction with monitoring data. The graph-based approach has become a trending topic, which exploits the non-Euclidean structure and generates representation based on spatial information. However, most graph-based models are built based on correlation assumption, and disregards the causality which are intrinsic in system and its failure process. In this paper, a causal graph attention network with disentangled representations (Causal-GAT) is proposed for fault detection. High-dimensional variables are first characterized into directed acyclic graphs using data-driven causal discovery combining expertise. The causal graph, which represents variables’ cause-effect relations, is fed into the Causal-GAT. Disentangled Causal Attention (DC-Attention) is proposed to adaptively aggregate cause variables for embedding the effect variables. To improve feature extraction efficiency in the multi-head attention, the DC-Attention enforces disentangled node representation by regularizing it with a specified causal condition. To verify the effectiveness of the proposed method, a real case study concerning the high-speed train braking systems is considered. Experimental results with the benchmark methods demonstrate the advantages of the proposed method. Validities of causal graph construction, representation disentanglement, as well as interpretability of the model are also discussed in this work.

Suggested Citation

  • Liu, Jie & Zheng, Shuwen & Wang, Chong, 2023. "Causal Graph Attention Network with Disentangled Representations for Complex Systems Fault Detection," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
  • Handle: RePEc:eee:reensy:v:235:y:2023:i:c:s0951832023001473
    DOI: 10.1016/j.ress.2023.109232
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832023001473
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2023.109232?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xia, Liqiao & Liang, Yongshi & Leng, Jiewu & Zheng, Pai, 2023. "Maintenance planning recommendation of complex industrial equipment based on knowledge graph and graph neural network," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    2. Andrews, John & Tolo, Silvia, 2023. "Dynamic and dependent tree theory (D2T2): A framework for the analysis of fault trees with dependent basic events," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    3. Yang, Zhe & Baraldi, Piero & Zio, Enrico, 2022. "A method for fault detection in multi-component systems based on sparse autoencoder-based deep neural networks," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    4. Guo, Junchao & He, Qingbo & Zhen, Dong & Gu, Fengshou & Ball, Andrew D., 2023. "Multi-sensor data fusion for rotating machinery fault detection using improved cyclic spectral covariance matrix and motor current signal analysis," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    5. Saeed, Umer & Jan, Sana Ullah & Lee, Young-Doo & Koo, Insoo, 2021. "Fault diagnosis based on extremely randomized trees in wireless sensor networks," Reliability Engineering and System Safety, Elsevier, vol. 205(C).
    6. Adedipe, Tosin & Shafiee, Mahmood & Zio, Enrico, 2020. "Bayesian Network Modelling for the Wind Energy Industry: An Overview," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    7. Li, Fudong & Chen, Jinglong & Liu, Zijun & Lv, Haixin & Wang, Jun & Yuan, Junshe & Xiao, Wenrong, 2022. "A soft-target difference scaling network via relational knowledge distillation for fault detection of liquid rocket engine under multi-source trouble-free samples," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    8. Li, Tianfu & Zhao, Zhibin & Sun, Chuang & Yan, Ruqiang & Chen, Xuefeng, 2021. "Hierarchical attention graph convolutional network to fuse multi-sensor signals for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    9. Zwirglmaier, Kilian & Straub, Daniel & Groth, Katrina M., 2017. "Capturing cognitive causal paths in human reliability analysis with Bayesian network models," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 117-129.
    10. Soleimani, Morteza & Campean, Felician & Neagu, Daniel, 2021. "Integration of Hidden Markov Modelling and Bayesian Network for fault detection and prediction of complex engineered systems," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    11. Liu, Jie & Xu, Yubo & Wang, Lisong, 2022. "Fault information mining with causal network for railway transportation system," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    12. Dibaj, Ali & Gao, Zhen & Nejad, Amir R., 2023. "Fault detection of offshore wind turbine drivetrains in different environmental conditions through optimal selection of vibration measurements," Renewable Energy, Elsevier, vol. 203(C), pages 161-176.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zheng, Shuwen & Wang, Chong & Zio, Enrico & Liu, Jie, 2024. "Fault detection in complex mechatronic systems by a hierarchical graph convolution attention network based on causal paths," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    2. Shen, Yang & Yang, Zhen & Guo, Li & Zhao, Xiaozhe & Duan, Yao, 2024. "Scenario mapping for critical infrastructure failure under typhoon rainfall: A dependency and causality approach," Reliability Engineering and System Safety, Elsevier, vol. 249(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zheng, Shuwen & Wang, Chong & Zio, Enrico & Liu, Jie, 2024. "Fault detection in complex mechatronic systems by a hierarchical graph convolution attention network based on causal paths," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    2. Tang, Shengnan & Zhu, Yong & Yuan, Shouqi, 2022. "Intelligent fault identification of hydraulic pump using deep adaptive normalized CNN and synchrosqueezed wavelet transform," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    3. Coraça, Eduardo M. & Ferreira, Janito V. & Nóbrega, Eurípedes G.O., 2023. "An unsupervised structural health monitoring framework based on Variational Autoencoders and Hidden Markov Models," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    4. Liu, Jie & Xu, Yubo & Wang, Lisong, 2022. "Fault information mining with causal network for railway transportation system," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    5. Yan, Shen & Shao, Haidong & Min, Zhishan & Peng, Jiangji & Cai, Baoping & Liu, Bin, 2023. "FGDAE: A new machinery anomaly detection method towards complex operating conditions," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    6. Sahu, Atma Ram & Palei, Sanjay Kumar, 2022. "Fault analysis of dragline subsystem using Bayesian network model," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    7. Ekanem, Nsimah & Mosleh, Ali & Shen, Song-Hua & Ramos, Marilia, 2024. "Phoenix–A model-based human reliability analysis methodology: Data sources and quantitative analysis procedure," Reliability Engineering and System Safety, Elsevier, vol. 248(C).
    8. Abubakar Ahmad Musa & Adamu Hussaini & Weixian Liao & Fan Liang & Wei Yu, 2023. "Deep Neural Networks for Spatial-Temporal Cyber-Physical Systems: A Survey," Future Internet, MDPI, vol. 15(6), pages 1-24, May.
    9. Yuga Raju Gunda & Suprakash Gupta & Lalit Kumar Singh, 2023. "Assessing human performance and human reliability: a review," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 14(3), pages 817-828, June.
    10. Kohtz, Sara & Zhao, Junhan & Renteria, Anabel & Lalwani, Anand & Xu, Yanwen & Zhang, Xiaolong & Haran, Kiruba Sivasubramaniam & Senesky, Debbie & Wang, Pingfeng, 2024. "Optimal sensor placement for permanent magnet synchronous motor condition monitoring using a digital twin-assisted fault diagnosis approach," Reliability Engineering and System Safety, Elsevier, vol. 242(C).
    11. Chang, Yuanhong & Li, Fudong & Chen, Jinglong & Liu, Yulang & Li, Zipeng, 2022. "Efficient temporal flow Transformer accompanied with multi-head probsparse self-attention mechanism for remaining useful life prognostics," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    12. Izaz Raouf & Asif Khan & Salman Khalid & Muhammad Sohail & Muhammad Muzammil Azad & Heung Soo Kim, 2022. "Sensor-Based Prognostic Health Management of Advanced Driver Assistance System for Autonomous Vehicles: A Recent Survey," Mathematics, MDPI, vol. 10(18), pages 1-26, September.
    13. Cheng, Biyi & Yao, Yingxue & Qu, Xiaobin & Zhou, Zhiming & Wei, Jionghui & Liang, Ertang & Zhang, Chengcheng & Kang, Hanwen & Wang, Hongjun, 2024. "Multi-objective parameter optimization of large-scale offshore wind Turbine's tower based on data-driven model with deep learning and machine learning methods," Energy, Elsevier, vol. 305(C).
    14. Zaitseva, Elena & Levashenko, Vitaly & Rabcan, Jan, 2023. "A new method for analysis of Multi-State systems based on Multi-valued decision diagram under epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    15. Faraz Qasim & Doug Hyung Lee & Jongkuk Won & Jin-Kuk Ha & Sang Jin Park, 2021. "Development of Advanced Advisory System for Anomalies (AAA) to Predict and Detect the Abnormal Operation in Fired Heaters for Real Time Process Safety and Optimization," Energies, MDPI, vol. 14(21), pages 1-24, November.
    16. Lyu, Dongzhen & Niu, Guangxing & Liu, Enhui & Zhang, Bin & Chen, Gang & Yang, Tao & Zio, Enrico, 2022. "Time space modelling for fault diagnosis and prognosis with uncertainty management: A general theoretical formulation," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    17. Groth, Katrina M. & Smith, Reuel & Moradi, Ramin, 2019. "A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    18. Bai, Ruxue & Meng, Zong & Xu, Quansheng & Fan, Fengjie, 2023. "Fractional Fourier and time domain recurrence plot fusion combining convolutional neural network for bearing fault diagnosis under variable working conditions," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    19. Zhang, Xinwei & Feng, Yong & Chen, Jinglong & Liu, Zijun & Wang, Jun & Huang, Hong, 2024. "Knowledge distillation-optimized two-stage anomaly detection for liquid rocket engine with missing multimodal data," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    20. Paglioni, Vincent P. & Groth, Katrina M., 2022. "Dependency definitions for quantitative human reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 220(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:235:y:2023:i:c:s0951832023001473. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.