IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v184y2022icp473-486.html
   My bibliography  Save this article

Anomaly detection in wind turbine SCADA data for power curve cleaning

Author

Listed:
  • Morrison, Rory
  • Liu, Xiaolei
  • Lin, Zi

Abstract

Wind turbine power curve cleaning, by way of removing curtailment, stoppage, and other anomalies, is an essential step in making raw data useable for further analysis, such as determining turbine performance, site characteristics, or improving forecasting models. Typically, data comes as SCADA (Supervisory Control and Data Acquisition) data, so contains not only environmental and turbine performance data but also the control action imposed on the turbine by the operator. Many different anomaly detection (AD) methods have been proposed to clean power curves; however, few papers have explored filtering explicit and obvious anomalies from the SCADA prior to running AD. This paper actively explores this filtering impact by comparing the performances of 4 different AD methods with/without filtering. These are: iForest, Local Outlier Factor, Gaussian Mixture Models, and k-Nearest Neighbours. Each approach is evaluated in terms of prediction error, data removal rates, and ability to maintain the underlying wind statistical characteristics. The results show the effectiveness of filtering with every technique showing improvement compared to its unfiltered counterpart. Furthermore, Gaussian Mixture Models are shown to provide favourable accuracy whilst maintaining wind variability, however, with the wide range of performances of methods, a user's choice may be different depending on their needs.

Suggested Citation

  • Morrison, Rory & Liu, Xiaolei & Lin, Zi, 2022. "Anomaly detection in wind turbine SCADA data for power curve cleaning," Renewable Energy, Elsevier, vol. 184(C), pages 473-486.
  • Handle: RePEc:eee:renene:v:184:y:2022:i:c:p:473-486
    DOI: 10.1016/j.renene.2021.11.118
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148121017134
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2021.11.118?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lin, Zi & Liu, Xiaolei, 2020. "Wind power forecasting of an offshore wind turbine based on high-frequency SCADA data and deep learning neural network," Energy, Elsevier, vol. 201(C).
    2. Lijun Zhang & Kai Liu & Yufeng Wang & Zachary Bosire Omariba, 2018. "Ice Detection Model of Wind Turbine Blades Based on Random Forest Classifier," Energies, MDPI, vol. 11(10), pages 1-15, September.
    3. Bi, Ran & Zhou, Chengke & Hepburn, Donald M., 2017. "Detection and classification of faults in pitch-regulated wind turbine generators using normal behaviour models based on performance curves," Renewable Energy, Elsevier, vol. 105(C), pages 674-688.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen Zhang & Tao Yang, 2023. "Anomaly Detection for Wind Turbines Using Long Short-Term Memory-Based Variational Autoencoder Wasserstein Generation Adversarial Network under Semi-Supervised Training," Energies, MDPI, vol. 16(19), pages 1-18, October.
    2. Chengming Zuo & Juchuan Dai & Guo Li & Mimi Li & Fan Zhang, 2023. "Investigation of Data Pre-Processing Algorithms for Power Curve Modeling of Wind Turbines Based on ECC," Energies, MDPI, vol. 16(6), pages 1-24, March.
    3. Xiong, Xiong & Zou, Ruilin & Sheng, Tao & Zeng, Weilin & Ye, Xiaoling, 2023. "An ultra-short-term wind speed correction method based on the fluctuation characteristics of wind speed," Energy, Elsevier, vol. 283(C).
    4. Huifan Zeng & Juchuan Dai & Chengming Zuo & Huanguo Chen & Mimi Li & Fan Zhang, 2022. "Correlation Investigation of Wind Turbine Multiple Operating Parameters Based on SCADA Data," Energies, MDPI, vol. 15(14), pages 1-24, July.
    5. Wang, Peng & Li, Yanting & Zhang, Guangyao, 2023. "Probabilistic power curve estimation based on meteorological factors and density LSTM," Energy, Elsevier, vol. 269(C).
    6. Ifaei, Pouya & Nazari-Heris, Morteza & Tayerani Charmchi, Amir Saman & Asadi, Somayeh & Yoo, ChangKyoo, 2023. "Sustainable energies and machine learning: An organized review of recent applications and challenges," Energy, Elsevier, vol. 266(C).
    7. Hou, Guolian & Wang, Junjie & Fan, Yuzhen & Zhang, Jianhua & Huang, Congzhi, 2024. "A novel wind power deterministic and interval prediction framework based on the critic weight method, improved northern goshawk optimization, and kernel density estimation," Renewable Energy, Elsevier, vol. 226(C).
    8. Francisco Bilendo & Angela Meyer & Hamed Badihi & Ningyun Lu & Philippe Cambron & Bin Jiang, 2022. "Applications and Modeling Techniques of Wind Turbine Power Curve for Wind Farms—A Review," Energies, MDPI, vol. 16(1), pages 1-38, December.
    9. Wang, Yun & Duan, Xiaocong & Zou, Runmin & Zhang, Fan & Li, Yifen & Hu, Qinghua, 2023. "A novel data-driven deep learning approach for wind turbine power curve modeling," Energy, Elsevier, vol. 270(C).
    10. Wang, Han & Zhang, Ning & Du, Ershun & Yan, Jie & Han, Shuang & Li, Nan & Li, Hongxia & Liu, Yongqian, 2023. "An adaptive identification method of abnormal data in wind and solar power stations," Renewable Energy, Elsevier, vol. 208(C), pages 76-93.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jorge Maldonado-Correa & Sergio Martín-Martínez & Estefanía Artigao & Emilio Gómez-Lázaro, 2020. "Using SCADA Data for Wind Turbine Condition Monitoring: A Systematic Literature Review," Energies, MDPI, vol. 13(12), pages 1-21, June.
    2. Sales-Setién, Ester & Peñarrocha-Alós, Ignacio, 2020. "Robust estimation and diagnosis of wind turbine pitch misalignments at a wind farm level," Renewable Energy, Elsevier, vol. 146(C), pages 1746-1765.
    3. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    4. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    5. Liang, Yushi & Wu, Chunbing & Ji, Xiaodong & Zhang, Mulan & Li, Yiran & He, Jianjun & Qin, Zhiheng, 2022. "Estimation of the influences of spatiotemporal variations in air density on wind energy assessment in China based on deep neural network," Energy, Elsevier, vol. 239(PC).
    6. Chen, Wanqiu & Qiu, Yingning & Feng, Yanhui & Li, Ye & Kusiak, Andrew, 2021. "Diagnosis of wind turbine faults with transfer learning algorithms," Renewable Energy, Elsevier, vol. 163(C), pages 2053-2067.
    7. Lin, Zi & Liu, Xiaolei & Lao, Liyun & Liu, Hengxu, 2020. "Prediction of two-phase flow patterns in upward inclined pipes via deep learning," Energy, Elsevier, vol. 210(C).
    8. Kisvari, Adam & Lin, Zi & Liu, Xiaolei, 2021. "Wind power forecasting – A data-driven method along with gated recurrent neural network," Renewable Energy, Elsevier, vol. 163(C), pages 1895-1909.
    9. Sabarathinam Srinivasan & Suresh Kumarasamy & Zacharias E. Andreadakis & Pedro G. Lind, 2023. "Artificial Intelligence and Mathematical Models of Power Grids Driven by Renewable Energy Sources: A Survey," Energies, MDPI, vol. 16(14), pages 1-56, July.
    10. Huifan Zeng & Juchuan Dai & Chengming Zuo & Huanguo Chen & Mimi Li & Fan Zhang, 2022. "Correlation Investigation of Wind Turbine Multiple Operating Parameters Based on SCADA Data," Energies, MDPI, vol. 15(14), pages 1-24, July.
    11. Yin, Linfei & Qiu, Yao, 2022. "Long-term price guidance mechanism of flexible energy service providers based on stochastic differential methods," Energy, Elsevier, vol. 238(PB).
    12. Natei Ermias Benti & Mesfin Diro Chaka & Addisu Gezahegn Semie, 2023. "Forecasting Renewable Energy Generation with Machine Learning and Deep Learning: Current Advances and Future Prospects," Sustainability, MDPI, vol. 15(9), pages 1-33, April.
    13. Farah, Shahid & David A, Wood & Humaira, Nisar & Aneela, Zameer & Steffen, Eger, 2022. "Short-term multi-hour ahead country-wide wind power prediction for Germany using gated recurrent unit deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    14. Wang, Zixuan & Qin, Bo & Sun, Haiyue & Zhang, Jian & Butala, Mark D. & Demartino, Cristoforo & Peng, Peng & Wang, Hongwei, 2023. "An imbalanced semi-supervised wind turbine blade icing detection method based on contrastive learning," Renewable Energy, Elsevier, vol. 212(C), pages 251-262.
    15. Hu, Yue & Liu, Hanjing & Wu, Senzhen & Zhao, Yuan & Wang, Zhijin & Liu, Xiufeng, 2024. "Temporal collaborative attention for wind power forecasting," Applied Energy, Elsevier, vol. 357(C).
    16. Ivan Kabardin & Sergey Dvoynishnikov & Maxim Gordienko & Sergey Kakaulin & Vadim Ledovsky & Grigoriy Gusev & Vladislav Zuev & Valery Okulov, 2021. "Optical Methods for Measuring Icing of Wind Turbine Blades," Energies, MDPI, vol. 14(20), pages 1-14, October.
    17. Mingyu Li & Dongxiao Niu & Zhengsen Ji & Xiwen Cui & Lijie Sun, 2021. "Forecast Research on Multidimensional Influencing Factors of Global Offshore Wind Power Investment Based on Random Forest and Elastic Net," Sustainability, MDPI, vol. 13(21), pages 1-19, November.
    18. Yakoub, Ghali & Mathew, Sathyajith & Leal, Joao, 2023. "Intelligent estimation of wind farm performance with direct and indirect ‘point’ forecasting approaches integrating several NWP models," Energy, Elsevier, vol. 263(PD).
    19. Ma, Yixiang & Yu, Lean & Zhang, Guoxing, 2022. "Short-term wind power forecasting with an intermittency-trait-driven methodology," Renewable Energy, Elsevier, vol. 198(C), pages 872-883.
    20. Chang Cai & Jicai Guo & Xiaowen Song & Yanfeng Zhang & Jianxin Wu & Shufeng Tang & Yan Jia & Zhitai Xing & Qing’an Li, 2023. "Review of Data-Driven Approaches for Wind Turbine Blade Icing Detection," Sustainability, MDPI, vol. 15(2), pages 1-20, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:184:y:2022:i:c:p:473-486. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.