IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v15y2022i17p6373-d903451.html
   My bibliography  Save this article

Abnormal Data Cleaning Method for Wind Turbines Based on Constrained Curve Fitting

Author

Listed:
  • Xiangqing Yin

    (School of Mechanical Electronic and Information Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China)

  • Yi Liu

    (School of Mechanical Electronic and Information Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China)

  • Li Yang

    (School of Mechanical Electronic and Information Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China)

  • Wenchao Gao

    (School of Mechanical Electronic and Information Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China)

Abstract

With the increase of the scale of wind turbines, the problem of data quality of wind turbines has become increasingly prominent, which seriously affects the follow-up research. A large number of abnormal data exist in the historical data recorded by the wind turbine Supervisory Control And Data Acquisition (SCADA) system. In order to improve data quality, it is necessary to clean a large number of abnormal data in the original data. Aiming at the problem that the cleaning effect is not good in the presence of a large number of abnormal data, a method for cleaning abnormal data of wind turbines based on constrained curve fitting is proposed. According to the wind speed-power characteristics of wind turbines, the constrained wind speed-power curve is fit with the least square method, and the constrained optimization problem is transformed into an unconstrained optimization problem by using the external penalty function method. Data cleaning was performed on the fitted curve using an improved 3-σ standard deviation. Experiments show that, compared with the existing methods, this method can still perform data cleaning well when the historical wind turbine data contains many abnormal data, and the method is insensitive to parameters, simple in the calculation, and easy to automate.

Suggested Citation

  • Xiangqing Yin & Yi Liu & Li Yang & Wenchao Gao, 2022. "Abnormal Data Cleaning Method for Wind Turbines Based on Constrained Curve Fitting," Energies, MDPI, vol. 15(17), pages 1-22, August.
    • Handle: RePEc:gam:jeners:v:15:y:2022:i:17:p:6373-:d:903451
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/15/17/6373/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/15/17/6373/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Li, Tenghui & Liu, Xiaolei & Lin, Zi & Morrison, Rory, 2022. "Ensemble offshore Wind Turbine Power Curve modelling – An integration of Isolation Forest, fast Radial Basis Function Neural Network, and metaheuristic algorithm," Energy, Elsevier, vol. 239(PD).
    2. Liang Tao & Qian Siqi & Yingjuan Zhang & Huan Shi, 2019. "Abnormal Detection of Wind Turbine Based on SCADA Data Mining," Mathematical Problems in Engineering, Hindawi, vol. 2019, pages 1-10, August.
    3. Seo, Seokho & Oh, Si-Doek & Kwak, Ho-Young, 2019. "Wind turbine power curve modeling using maximum likelihood estimation method," Renewable Energy, Elsevier, vol. 136(C), pages 1164-1169.
    4. Lin, Zi & Liu, Xiaolei, 2020. "Wind power forecasting of an offshore wind turbine based on high-frequency SCADA data and deep learning neural network," Energy, Elsevier, vol. 201(C).
    5. Xu, Keyi & Yan, Jie & Zhang, Hao & Zhang, Haoran & Han, Shuang & Liu, Yongqian, 2021. "Quantile based probabilistic wind turbine power curve model," Applied Energy, Elsevier, vol. 296(C).
    6. Long, Huan & Xu, Shaohui & Gu, Wei, 2022. "An abnormal wind turbine data cleaning algorithm based on color space conversion and image feature detection," Applied Energy, Elsevier, vol. 311(C).
    7. Han, Shuang & Qiao, Yanhui & Yan, Ping & Yan, Jie & Liu, Yongqian & Li, Li, 2020. "Wind turbine power curve modeling based on interval extreme probability density for the integration of renewable energies and electric vehicles," Renewable Energy, Elsevier, vol. 157(C), pages 190-203.
    8. Neshat, Mehdi & Nezhad, Meysam Majidi & Abbasnejad, Ehsan & Mirjalili, Seyedali & Groppi, Daniele & Heydari, Azim & Tjernberg, Lina Bertling & Astiaso Garcia, Davide & Alexander, Bradley & Shi, Qinfen, 2021. "Wind turbine power output prediction using a new hybrid neuro-evolutionary method," Energy, Elsevier, vol. 229(C).
    9. Conor McKinnon & Alan Turnbull & Sofia Koukoura & James Carroll & Alasdair McDonald, 2020. "Effect of Time History on Normal Behaviour Modelling Using SCADA Data to Predict Wind Turbine Failures," Energies, MDPI, vol. 13(18), pages 1-19, September.
    10. Kevin Leahy & Colm Gallagher & Peter O’Donovan & Dominic T. J. O’Sullivan, 2019. "Issues with Data Quality for Wind Turbine Condition Monitoring and Reliability Analyses," Energies, MDPI, vol. 12(2), pages 1-22, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Peng & Li, Yanting & Zhang, Guangyao, 2023. "Probabilistic power curve estimation based on meteorological factors and density LSTM," Energy, Elsevier, vol. 269(C).
    2. Wang, Yun & Duan, Xiaocong & Zou, Runmin & Zhang, Fan & Li, Yifen & Hu, Qinghua, 2023. "A novel data-driven deep learning approach for wind turbine power curve modeling," Energy, Elsevier, vol. 270(C).
    3. Zou, Runmin & Yang, Jiaxin & Wang, Yun & Liu, Fang & Essaaidi, Mohamed & Srinivasan, Dipti, 2021. "Wind turbine power curve modeling using an asymmetric error characteristic-based loss function and a hybrid intelligent optimizer," Applied Energy, Elsevier, vol. 304(C).
    4. Qiao, Yanhui & Han, Shuang & Zhang, Yajie & Liu, Yongqian & Yan, Jie, 2024. "A multivariable wind turbine power curve modeling method considering segment control differences and short-time self-dependence," Renewable Energy, Elsevier, vol. 222(C).
    5. Urmeneta, Jon & Izquierdo, Juan & Leturiondo, Urko, 2023. "A methodology for performance assessment at system level—Identification of operating regimes and anomaly detection in wind turbines," Renewable Energy, Elsevier, vol. 205(C), pages 281-292.
    6. Francisco Bilendo & Angela Meyer & Hamed Badihi & Ningyun Lu & Philippe Cambron & Bin Jiang, 2022. "Applications and Modeling Techniques of Wind Turbine Power Curve for Wind Farms—A Review," Energies, MDPI, vol. 16(1), pages 1-38, December.
    7. Chatterjee, Joyjit & Dethlefs, Nina, 2021. "Scientometric review of artificial intelligence for operations & maintenance of wind turbines: The past, present and future," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    8. Zhang, Juntao & Cheng, Chuntian & Yu, Shen, 2024. "Recognizing the mapping relationship between wind power output and meteorological information at a province level by coupling GIS and CNN technologies," Applied Energy, Elsevier, vol. 360(C).
    9. Yan, Jie & Nuertayi, Akejiang & Yan, Yamin & Liu, Shan & Liu, Yongqian, 2023. "Hybrid physical and data driven modeling for dynamic operation characteristic simulation of wind turbine," Renewable Energy, Elsevier, vol. 215(C).
    10. Xu, Keyi & Yan, Jie & Zhang, Hao & Zhang, Haoran & Han, Shuang & Liu, Yongqian, 2021. "Quantile based probabilistic wind turbine power curve model," Applied Energy, Elsevier, vol. 296(C).
    11. Qinguo Zhang & Xiaojian Liu, 2022. "Optimization of the Quality of the Automatic Transmission Shift and the Power Transmission Characteristics," Energies, MDPI, vol. 15(13), pages 1-15, June.
    12. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    13. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    14. Izquierdo, J. & Márquez, A. Crespo & Uribetxebarria, J. & Erguido, A., 2020. "On the importance of assessing the operational context impact on maintenance management for life cycle cost of wind energy projects," Renewable Energy, Elsevier, vol. 153(C), pages 1100-1110.
    15. Camila Correa-Jullian & Sergio Cofre-Martel & Gabriel San Martin & Enrique Lopez Droguett & Gustavo de Novaes Pires Leite & Alexandre Costa, 2022. "Exploring Quantum Machine Learning and Feature Reduction Techniques for Wind Turbine Pitch Fault Detection," Energies, MDPI, vol. 15(8), pages 1-29, April.
    16. Mahsa Dehghan Manshadi & Milad Mousavi & M. Soltani & Amir Mosavi & Levente Kovacs, 2022. "Deep Learning for Modeling an Offshore Hybrid Wind–Wave Energy System," Energies, MDPI, vol. 15(24), pages 1-16, December.
    17. Liang, Yushi & Wu, Chunbing & Ji, Xiaodong & Zhang, Mulan & Li, Yiran & He, Jianjun & Qin, Zhiheng, 2022. "Estimation of the influences of spatiotemporal variations in air density on wind energy assessment in China based on deep neural network," Energy, Elsevier, vol. 239(PC).
    18. Lorin Jenkel & Stefan Jonas & Angela Meyer, 2023. "Privacy-Preserving Fleet-Wide Learning of Wind Turbine Conditions with Federated Learning," Energies, MDPI, vol. 16(17), pages 1-29, September.
    19. Olgun Aydin & Bartłomiej Igliński & Krzysztof Krukowski & Marek Siemiński, 2022. "Analyzing Wind Energy Potential Using Efficient Global Optimization: A Case Study for the City Gdańsk in Poland," Energies, MDPI, vol. 15(9), pages 1-22, April.
    20. Qian, XiaoYi & Sun, TianHe & Zhang, YuXian & Wang, BaoShi & Awad Gendeel, Mohammed Altayeb, 2023. "Wind turbine fault detection based on spatial-temporal feature and neighbor operation state," Renewable Energy, Elsevier, vol. 219(P1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:17:p:6373-:d:903451. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.