IDEAS home Printed from https://ideas.repec.org/a/sae/risrel/v237y2023i5p910-921.html
   My bibliography  Save this article

Toward a framework for risk monitoring of complex engineering systems with online operational data: A deep learning-based solution

Author

Listed:
  • Ramin Moradi
  • Andrés Ruiz-Tagle Palazuelos
  • Enrique Lopez Droguett
  • Katrina M Groth

Abstract

A mathematical architecture is developed for system-level condition monitoring. This architecture is built toward performing end-to-end operation risk and condition monitoring. The streaming monitoring data is given to the architecture as the input and system-level and component-level operation health states are computed as the output. This architecture integrates fault trees as the system-level modeling method and Deep Learning (DL) as the components condition monitoring method. A number of different deep learning models are trained using both operation and maintenance data for the components. Then, the fault tree fuses the continuous components’ assessments to provide system-level health insight. The applicability of this architecture is tested by implementing it on a real-world mining stone crusher system. This approach is extendable to dynamic risk assessment of complex engineering systems. However, DL models should be used with caution for safety-critical applications. We show that having DL models with high accuracy is not enough for trusting their predictions. We discuss the calibration of DL-based condition monitoring models and demonstrate how they can improve the trustworthiness and interpretability of DL models in risk and reliability applications.

Suggested Citation

  • Ramin Moradi & Andrés Ruiz-Tagle Palazuelos & Enrique Lopez Droguett & Katrina M Groth, 2023. "Toward a framework for risk monitoring of complex engineering systems with online operational data: A deep learning-based solution," Journal of Risk and Reliability, , vol. 237(5), pages 910-921, October.
  • Handle: RePEc:sae:risrel:v:237:y:2023:i:5:p:910-921
    DOI: 10.1177/1748006X221079964
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1748006X221079964
    Download Restriction: no

    File URL: https://libkey.io/10.1177/1748006X221079964?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Moradi, Ramin & Groth, Katrina M., 2020. "Modernizing risk assessment: A systematic integration of PRA and PHM techniques," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    2. Xing, Jinduo & Zeng, Zhiguo & Zio, Enrico, 2019. "A framework for dynamic risk assessment with condition monitoring data and inspection data," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moradi, Ramin & Cofre-Martel, Sergio & Lopez Droguett, Enrique & Modarres, Mohammad & Groth, Katrina M., 2022. "Integration of deep learning and Bayesian networks for condition and operation risk monitoring of complex engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    2. He, Rui & Zhu, Jingyu & Chen, Guoming & Tian, Zhigang, 2022. "A real-time probabilistic risk assessment method for the petrochemical industry based on data monitoring," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    3. Qiao, Wanguan, 2021. "Analysis and measurement of multifactor risk in underground coal mine accidents based on coupling theory," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    4. Ferretto, D. & Mazzini, G. & Ambrosini, W. & Aldorf, R. & Hrehor, M., 2021. "Risk monitor implementation for the LVR-15 research reactor," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    5. Lewis, Austin D. & Groth, Katrina M., 2022. "Metrics for evaluating the performance of complex engineering system health monitoring models," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    6. Zaitseva, Elena & Levashenko, Vitaly & Rabcan, Jan, 2023. "A new method for analysis of Multi-State systems based on Multi-valued decision diagram under epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    7. Feng, Jian Rui & Yu, Guanghui & Zhao, Mengke & Zhang, Jiaqing & Lu, Shouxiang, 2022. "Dynamic risk assessment framework for industrial systems based on accidents chain theory: The case study of fire and explosion risk of UHV converter transformer," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    8. BahooToroody, Ahmad & De Carlo, Filippo & Paltrinieri, Nicola & Tucci, Mario & Van Gelder, P.H.A.J.M., 2020. "Bayesian regression based condition monitoring approach for effective reliability prediction of random processes in autonomous energy supply operation," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    9. Costica Bejinariu & Doru-Costin Darabont & Diana-Petronela Burduhos-Nergis & Alin-Marian Cazac & Cristiana Chiriac-Moruzzi, 2023. "Considerations Regarding the Application of the Occupational Injury and Illness Risk Assessment Method at Workplaces/Workstations, in Relation to the ISO 45001 Standard," Sustainability, MDPI, vol. 15(3), pages 1-16, January.
    10. Zhang, Jintao & Bagtzoglou, Yiannis & Zhu, Jin & Li, Baikun & Zhang, Wei, 2023. "Fragility-based system performance assessment of critical power infrastructure," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    11. Vrignat, Pascal & Kratz, Frédéric & Avila, Manuel, 2022. "Sustainable manufacturing, maintenance policies, prognostics and health management: A literature review," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    12. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    13. Guo, Yongjin & Wang, Hongdong & Guo, Yu & Zhong, Mingjun & Li, Qing & Gao, Chao, 2022. "System operational reliability evaluation based on dynamic Bayesian network and XGBoost," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    14. Lewis, Austin D. & Groth, Katrina M., 2023. "A comparison of DBN model performance in SIPPRA health monitoring based on different data stream discretization methods," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    15. Abdenour Soualhi & Mourad Lamraoui & Bilal Elyousfi & Hubert Razik, 2022. "PHM SURVEY: Implementation of Prognostic Methods for Monitoring Industrial Systems," Energies, MDPI, vol. 15(19), pages 1-24, September.
    16. Mandelli, Diego & Wang, Congjian & Agarwal, Vivek & Lin, Linyu & Manjunatha, Koushik A., 2024. "Reliability modeling in a predictive maintenance context: A margin-based approach," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    17. Dimaio, F. & Scapinello, O. & Zio, E. & Ciarapica, C. & Cincotta, S. & Crivellari, A. & Decarli, L. & Larosa, L., 2021. "Accounting for Safety Barriers Degradation in the Risk Assessment of Oil and Gas Systems by Multistate Bayesian Networks," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    18. Michael Felix Pacevicius & Marilia Ramos & Davide Roverso & Christian Thun Eriksen & Nicola Paltrinieri, 2022. "Managing Heterogeneous Datasets for Dynamic Risk Analysis of Large-Scale Infrastructures," Energies, MDPI, vol. 15(9), pages 1-40, April.
    19. Victor Bolbot & Gerasimos Theotokatos & Rainer Hamann & George Psarros & Evangelos Boulougouris, 2021. "Dynamic Blackout Probability Monitoring System for Cruise Ship Power Plants," Energies, MDPI, vol. 14(20), pages 1-19, October.
    20. Ariannik, Mohamadreza & Razi-Kazemi, Ali A. & Lehtonen, Matti, 2020. "An approach on lifetime estimation of distribution transformers based on degree of polymerization," Reliability Engineering and System Safety, Elsevier, vol. 198(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:risrel:v:237:y:2023:i:5:p:910-921. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.