IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v240y2019icp561-582.html
   My bibliography  Save this article

An anomaly detection framework for dynamic systems using a Bayesian hierarchical framework

Author

Listed:
  • Moghaddass, Ramin
  • Sheng, Shuangwen

Abstract

Complex systems are susceptible to many types of anomalies, faults, and abnormal behavior caused by a variety of off-nominal conditions that may ultimately result in major failures or catastrophic events. Early and accurate detection of these anomalies using system inputs and outputs collected from sensors and smart devices has become a challenging problem and an active area of research in many application domains. In this article, we present a new Bayesian hierarchical framework that is able to model the relationship between system inputs (sensor measurements) and outputs (response variables) without imposing strong distributional/parametric assumptions while using only a subset of training samples and sensor attributes. Then, an optimal cost-sensitive anomaly detection framework is proposed to determine whether a sample is an anomalous one taking into consideration the trade-off between misclassification errors and detection rates. The model can be used for both supervised and unsupervised settings depending on the availability of data regarding the behavior of the system under anomaly conditions. The unsupervised model is particularly useful when it is prohibitive to identify in advance the anomalies that a system may present and where no data are available regarding the behavior of the system under anomaly conditions. A Bayesian hierarchical setting is used to structure the proposed framework and help with accommodating uncertainty, imposing interpretability, and controlling the sparsity and complexity of the proposed anomaly detection framework. A Markov chain Monte Carlo algorithm is also developed for model training using past data. The numerical experiments conducted using a simulated data set and a wind turbine data set demonstrate the successful application of the proposed work for system response modeling and anomaly detection.

Suggested Citation

  • Moghaddass, Ramin & Sheng, Shuangwen, 2019. "An anomaly detection framework for dynamic systems using a Bayesian hierarchical framework," Applied Energy, Elsevier, vol. 240(C), pages 561-582.
    • Handle: RePEc:eee:appene:v:240:y:2019:i:c:p:561-582
    DOI: 10.1016/j.apenergy.2019.02.025
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261919303150
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2019.02.025?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Eunshin Byon, 2013. "Wind turbine operations and maintenance: a tractable approximation of dynamic decision making," IISE Transactions, Taylor & Francis Journals, vol. 45(11), pages 1188-1201.
    2. Artigao, Estefania & Martín-Martínez, Sergio & Honrubia-Escribano, Andrés & Gómez-Lázaro, Emilio, 2018. "Wind turbine reliability: A comprehensive review towards effective condition monitoring development," Applied Energy, Elsevier, vol. 228(C), pages 1569-1583.
    3. Angel Gil & Miguel A. Sanz-Bobi & Miguel A. Rodríguez-López, 2018. "Behavior Anomaly Indicators Based on Reference Patterns—Application to the Gearbox and Electrical Generator of a Wind Turbine," Energies, MDPI, vol. 11(1), pages 1-15, January.
    4. Balducelli, C. & Bologna, S. & Lavalle, L. & Vicoli, G., 2007. "Safeguarding information intensive critical infrastructures against novel types of emerging failures," Reliability Engineering and System Safety, Elsevier, vol. 92(9), pages 1218-1229.
    5. Hu, R.L. & Granderson, J. & Auslander, D.M. & Agogino, A., 2019. "Design of machine learning models with domain experts for automated sensor selection for energy fault detection," Applied Energy, Elsevier, vol. 235(C), pages 117-128.
    6. Peyman Mazidi & Lina Bertling Tjernberg & Miguel A Sanz Bobi, 2017. "Wind turbine prognostics and maintenance management based on a hybrid approach of neural networks and a proportional hazards model," Journal of Risk and Reliability, , vol. 231(2), pages 121-129, April.
    7. Sun, Peng & Li, Jian & Wang, Caisheng & Lei, Xiao, 2016. "A generalized model for wind turbine anomaly identification based on SCADA data," Applied Energy, Elsevier, vol. 168(C), pages 550-567.
    8. Andrade, A.R. & Teixeira, P.F., 2015. "Statistical modelling of railway track geometry degradation using Hierarchical Bayesian models," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 169-183.
    9. Fan, Cheng & Xiao, Fu & Zhao, Yang & Wang, Jiayuan, 2018. "Analytical investigation of autoencoder-based methods for unsupervised anomaly detection in building energy data," Applied Energy, Elsevier, vol. 211(C), pages 1123-1135.
    10. Zhang, Liangwei & Lin, Jing & Karim, Ramin, 2015. "An angle-based subspace anomaly detection approach to high-dimensional data: With an application to industrial fault detection," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 482-497.
    11. Fei Li & Hongzhi Wang & Guowen Zhou & Daren Yu & Jiangzhong Li & Hong Gao, 2017. "Anomaly Detection in Gas Turbine Fuel Systems Using a Sequential Symbolic Method," Energies, MDPI, vol. 10(5), pages 1-22, May.
    12. Yonglong Yan & Jian Li & David Wenzhong Gao, 2014. "Condition Parameter Modeling for Anomaly Detection in Wind Turbines," Energies, MDPI, vol. 7(5), pages 1-17, May.
    13. Mishra, Madhav & Martinsson, Jesper & Rantatalo, Matti & Goebel, Kai, 2018. "Bayesian hierarchical model-based prognostics for lithium-ion batteries," Reliability Engineering and System Safety, Elsevier, vol. 172(C), pages 25-35.
    14. Yang, Wenguang & Liu, Chao & Jiang, Dongxiang, 2018. "An unsupervised spatiotemporal graphical modeling approach for wind turbine condition monitoring," Renewable Energy, Elsevier, vol. 127(C), pages 230-241.
    15. Giwhyun Lee & Yu Ding & Marc G. Genton & Le Xie, 2015. "Power Curve Estimation With Multivariate Environmental Factors for Inland and Offshore Wind Farms," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 56-67, March.
    16. Peyman Mazidi & Mian Du & Lina Bertling Tjernberg & Miguel A Sanz Bobi, 2017. "A health condition model for wind turbine monitoring through neural networks and proportional hazard models," Journal of Risk and Reliability, , vol. 231(5), pages 481-494, October.
    17. Rocco S., Claudio M. & Zio, Enrico, 2007. "A support vector machine integrated system for the classification of operation anomalies in nuclear components and systems," Reliability Engineering and System Safety, Elsevier, vol. 92(5), pages 593-600.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Prashant Kumar & Salman Khalid & Heung Soo Kim, 2023. "Prognostics and Health Management of Rotating Machinery of Industrial Robot with Deep Learning Applications—A Review," Mathematics, MDPI, vol. 11(13), pages 1-37, July.
    2. Adedipe, Tosin & Shafiee, Mahmood & Zio, Enrico, 2020. "Bayesian Network Modelling for the Wind Energy Industry: An Overview," Reliability Engineering and System Safety, Elsevier, vol. 202(C).
    3. Huang, Yufeng & Tao, Jun & Zhao, Junyi & Sun, Gang & Yin, Kai & Zhai, Junyi, 2023. "Graph structure embedded with physical constraints-based information fusion network for interpretable fault diagnosis of aero-engine," Energy, Elsevier, vol. 283(C).
    4. Bai, Mingliang & Yang, Xusheng & Liu, Jinfu & Liu, Jiao & Yu, Daren, 2021. "Convolutional neural network-based deep transfer learning for fault detection of gas turbine combustion chambers," Applied Energy, Elsevier, vol. 302(C).
    5. Qu, Fuming & Liu, Jinhai & Zhu, Hongfei & Zhou, Bowen, 2020. "Wind turbine fault detection based on expanded linguistic terms and rules using non-singleton fuzzy logic," Applied Energy, Elsevier, vol. 262(C).
    6. Jorge Maldonado-Correa & Sergio Martín-Martínez & Estefanía Artigao & Emilio Gómez-Lázaro, 2020. "Using SCADA Data for Wind Turbine Condition Monitoring: A Systematic Literature Review," Energies, MDPI, vol. 13(12), pages 1-21, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qu, Fuming & Liu, Jinhai & Zhu, Hongfei & Zhou, Bowen, 2020. "Wind turbine fault detection based on expanded linguistic terms and rules using non-singleton fuzzy logic," Applied Energy, Elsevier, vol. 262(C).
    2. Izquierdo, J. & Márquez, A. Crespo & Uribetxebarria, J. & Erguido, A., 2020. "On the importance of assessing the operational context impact on maintenance management for life cycle cost of wind energy projects," Renewable Energy, Elsevier, vol. 153(C), pages 1100-1110.
    3. Jorge Maldonado-Correa & Sergio Martín-Martínez & Estefanía Artigao & Emilio Gómez-Lázaro, 2020. "Using SCADA Data for Wind Turbine Condition Monitoring: A Systematic Literature Review," Energies, MDPI, vol. 13(12), pages 1-21, June.
    4. Conor McKinnon & Alan Turnbull & Sofia Koukoura & James Carroll & Alasdair McDonald, 2020. "Effect of Time History on Normal Behaviour Modelling Using SCADA Data to Predict Wind Turbine Failures," Energies, MDPI, vol. 13(18), pages 1-19, September.
    5. Junshuai Yan & Yongqian Liu & Xiaoying Ren, 2023. "An Early Fault Detection Method for Wind Turbine Main Bearings Based on Self-Attention GRU Network and Binary Segmentation Changepoint Detection Algorithm," Energies, MDPI, vol. 16(10), pages 1-23, May.
    6. Junshuai Yan & Yongqian Liu & Xiaoying Ren & Li Li, 2023. "Wind Turbine Gearbox Condition Monitoring Using Hybrid Attentions and Spatio-Temporal BiConvLSTM Network," Energies, MDPI, vol. 16(19), pages 1-22, September.
    7. Chen, Zhen & Zhou, Di & Zio, Enrico & Xia, Tangbin & Pan, Ershun, 2023. "Adaptive transfer learning for multimode process monitoring and unsupervised anomaly detection in steam turbines," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    8. Xiang, Ling & Yang, Xin & Hu, Aijun & Su, Hao & Wang, Penghe, 2022. "Condition monitoring and anomaly detection of wind turbine based on cascaded and bidirectional deep learning networks," Applied Energy, Elsevier, vol. 305(C).
    9. Conor McKinnon & James Carroll & Alasdair McDonald & Sofia Koukoura & Charlie Plumley, 2021. "Investigation of Isolation Forest for Wind Turbine Pitch System Condition Monitoring Using SCADA Data," Energies, MDPI, vol. 14(20), pages 1-20, October.
    10. Ota, Shuhei & Kimura, Mitsuhiro, 2017. "A statistical dependent failure detection method for n-component parallel systems," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 376-382.
    11. Liang, Jinping & Zhang, Ke & Al-Durra, Ahmed & Zhou, Daming, 2020. "A novel fault diagnostic method in power converters for wind power generation system," Applied Energy, Elsevier, vol. 266(C).
    12. Dao, Phong B., 2022. "On Wilcoxon rank sum test for condition monitoring and fault detection of wind turbines," Applied Energy, Elsevier, vol. 318(C).
    13. Conor McKinnon & James Carroll & Alasdair McDonald & Sofia Koukoura & David Infield & Conaill Soraghan, 2020. "Comparison of New Anomaly Detection Technique for Wind Turbine Condition Monitoring Using Gearbox SCADA Data," Energies, MDPI, vol. 13(19), pages 1-19, October.
    14. Wang, Zeyu & Liu, Jian & Zhang, Yuanxin & Yuan, Hongping & Zhang, Ruixue & Srinivasan, Ravi S., 2021. "Practical issues in implementing machine-learning models for building energy efficiency: Moving beyond obstacles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    15. Izquierdo, J. & Crespo Márquez, A. & Uribetxebarria, J., 2019. "Dynamic artificial neural network-based reliability considering operational context of assets," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 483-493.
    16. Xia, Tangbin & Dong, Yifan & Xiao, Lei & Du, Shichang & Pan, Ershun & Xi, Lifeng, 2018. "Recent advances in prognostics and health management for advanced manufacturing paradigms," Reliability Engineering and System Safety, Elsevier, vol. 178(C), pages 255-268.
    17. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    18. Belqasem Aljafari & Jasmin Pamela Stephenraj & Indragandhi Vairavasundaram & Raja Singh Rassiah, 2022. "Steady State Modeling and Performance Analysis of a Wind Turbine-Based Doubly Fed Induction Generator System with Rotor Control," Energies, MDPI, vol. 15(9), pages 1-19, May.
    19. Quintanilha, Igor M. & Elias, Vitor R.M. & da Silva, Felipe B. & Fonini, Pedro A.M. & da Silva, Eduardo A.B. & Netto, Sergio L. & Apolinário, José A. & de Campos, Marcello L.R. & Martins, Wallace A., 2021. "A fault detector/classifier for closed-ring power generators using machine learning," Reliability Engineering and System Safety, Elsevier, vol. 212(C).
    20. Xavier Serrano-Guerrero & Guillermo Escrivá-Escrivá & Santiago Luna-Romero & Jean-Michel Clairand, 2020. "A Time-Series Treatment Method to Obtain Electrical Consumption Patterns for Anomalies Detection Improvement in Electrical Consumption Profiles," Energies, MDPI, vol. 13(5), pages 1-23, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:240:y:2019:i:c:p:561-582. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.