IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v234y2024ics0960148124013338.html
   My bibliography  Save this article

Data-driven control of wind turbine under online power strategy via deep learning and reinforcement learning

Author

Listed:
  • Li, Tenghui
  • Yang, Jin
  • Ioannou, Anastasia

Abstract

This study proposes a data-driven wind turbine (WT) model predictive control (MPC) enhanced by a deep-learning (DL) radial basis function network (RBFN) and a reinforcement-learning (RL) deep Q-learning network (DQN). The RBFN provides comprehensive aerodynamic predictions, including thrust, torque, and power. Besides, the MPC linearization relies on the RBFN prediction to estimate force sensitivities. The DQN achieves an online power strategy (OPS) that solves the 2-degree-of-freedom (2-DOF) optimization of rotor speed and pitch angle, which can actively adjust power capture to meet different power requirements. The DQN adopts a novel bisection algorithm with a first-in-first-out (FIFO) queue for high-precision 2-DOF results. The MPC coordinates the permanent magnet synchronous generator (PMSG) and pitch servo, considering shaft rotation and tower movement. Compared with the maximum power point tracking (MPPT) and power reference point tracking (PRPT) based controls, the proposed RBFN-DQN-MPC reduces power fluctuation and ensures constant output. This study also compares the DQN with the categorical DQN (C51), which indicates that the DQN is more effective in the 2-DOF optimization. Hence, WTs enhanced by the DL-RL-MPC are intelligent and reliable for flexible wind generation.

Suggested Citation

  • Li, Tenghui & Yang, Jin & Ioannou, Anastasia, 2024. "Data-driven control of wind turbine under online power strategy via deep learning and reinforcement learning," Renewable Energy, Elsevier, vol. 234(C).
  • Handle: RePEc:eee:renene:v:234:y:2024:i:c:s0960148124013338
    DOI: 10.1016/j.renene.2024.121265
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148124013338
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2024.121265?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fu, Shifeng & Li, Zheng & Zhu, Weijun & Han, Xingxing & Liang, Xiaoling & Yang, Hua & Shen, Wenzhong, 2023. "Study on aerodynamic performance and wake characteristics of a floating offshore wind turbine under pitch motion," Renewable Energy, Elsevier, vol. 205(C), pages 317-325.
    2. Hu, Ruiqi & Le, Conghuan & Gao, Zhen & Ding, Hongyan & Zhang, Puyang, 2021. "Implementation and evaluation of control strategies based on an open controller for a 10 MW floating wind turbine," Renewable Energy, Elsevier, vol. 179(C), pages 1751-1766.
    3. Lin, Zhongwei & Chen, Zhenyu & Liu, Jizhen & Wu, Qiuwei, 2019. "Coordinated mechanical loads and power optimization of wind energy conversion systems with variable-weight model predictive control strategy," Applied Energy, Elsevier, vol. 236(C), pages 307-317.
    4. Mazare, Mahmood, 2024. "Adaptive optimal secure wind power generation control for variable speed wind turbine systems via reinforcement learning," Applied Energy, Elsevier, vol. 353(PA).
    5. Chen, Jian & Yao, Wei & Zhang, Chuan-Ke & Ren, Yaxing & Jiang, Lin, 2019. "Design of robust MPPT controller for grid-connected PMSG-Based wind turbine via perturbation observation based nonlinear adaptive control," Renewable Energy, Elsevier, vol. 134(C), pages 478-495.
    6. Hawari, Qusay & Kim, Taeseong & Ward, Christopher & Fleming, James, 2022. "A robust gain scheduling method for a PI collective pitch controller of multi-MW onshore wind turbines," Renewable Energy, Elsevier, vol. 192(C), pages 443-455.
    7. Pan, Lin & Wang, Xudong, 2020. "Variable pitch control on direct-driven PMSG for offshore wind turbine using Repetitive-TS fuzzy PID control," Renewable Energy, Elsevier, vol. 159(C), pages 221-237.
    8. Liao, Hao & Hu, Weihao & Wu, Xiawei & Wang, Ni & Liu, Zhou & Huang, Qi & Chen, Cong & Chen, Zhe, 2020. "Active power dispatch optimization for offshore wind farms considering fatigue distribution," Renewable Energy, Elsevier, vol. 151(C), pages 1173-1185.
    9. López-Queija, Javier & Robles, Eider & Jugo, Josu & Alonso-Quesada, Santiago, 2022. "Review of control technologies for floating offshore wind turbines," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    10. Xie, Jingjie & Dong, Hongyang & Zhao, Xiaowei, 2023. "Data-driven torque and pitch control of wind turbines via reinforcement learning," Renewable Energy, Elsevier, vol. 215(C).
    11. Li, Tenghui & Liu, Xiaolei & Lin, Zi & Morrison, Rory, 2022. "Ensemble offshore Wind Turbine Power Curve modelling – An integration of Isolation Forest, fast Radial Basis Function Neural Network, and metaheuristic algorithm," Energy, Elsevier, vol. 239(PD).
    12. Lin, Zi & Liu, Xiaolei, 2020. "Wind power forecasting of an offshore wind turbine based on high-frequency SCADA data and deep learning neural network," Energy, Elsevier, vol. 201(C).
    13. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    14. Hong, Ying-Yi & Rioflorido, Christian Lian Paulo P., 2019. "A hybrid deep learning-based neural network for 24-h ahead wind power forecasting," Applied Energy, Elsevier, vol. 250(C), pages 530-539.
    15. Wakui, Tetsuya & Nagamura, Atsushi & Yokoyama, Ryohei, 2021. "Stabilization of power output and platform motion of a floating offshore wind turbine-generator system using model predictive control based on previewed disturbances," Renewable Energy, Elsevier, vol. 173(C), pages 105-127.
    16. González-Hernández, José Genaro & Salas-Cabrera, Rubén & Vázquez-Bautista, Roberto & Ong-de-la-Cruz, Luis Manuel & Rodríguez-Guillén, Joel, 2021. "A novel MPPT PI discrete reverse-acting controller for a wind energy conversion system," Renewable Energy, Elsevier, vol. 178(C), pages 904-915.
    17. Sun, Haiying & Qiu, Changyu & Lu, Lin & Gao, Xiaoxia & Chen, Jian & Yang, Hongxing, 2020. "Wind turbine power modelling and optimization using artificial neural network with wind field experimental data," Applied Energy, Elsevier, vol. 280(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shu, Tong & Song, Dongran & Hoon Joo, Young, 2022. "Decentralised optimisation for large offshore wind farms using a sparsified wake directed graph," Applied Energy, Elsevier, vol. 306(PA).
    2. Liu, Junbo & Cai, Chang & Song, Dongran & Zhong, Xiaohui & Shi, Kezhong & Chen, Yinpeng & Cheng, Shijie & Huang, Yupian & Jiang, Xue & Li, Qing'an, 2024. "Nonlinear model predictive control for maximum wind energy extraction of semi-submersible floating offshore wind turbine based on simplified dynamics model," Energy, Elsevier, vol. 311(C).
    3. Kim, Daeyoung & Ryu, Geonhwa & Moon, Chaejoo & Kim, Bumsuk, 2024. "Accuracy of a short-term wind power forecasting model based on deep learning using LiDAR-SCADA integration: A case study of the 400-MW Anholt offshore wind farm," Applied Energy, Elsevier, vol. 373(C).
    4. Amira Elkodama & Amr Ismaiel & A. Abdellatif & S. Shaaban & Shigeo Yoshida & Mostafa A. Rushdi, 2023. "Control Methods for Horizontal Axis Wind Turbines (HAWT): State-of-the-Art Review," Energies, MDPI, vol. 16(17), pages 1-32, September.
    5. Yang, Lin & Liao, Kangping & Ma, Qingwei & Ma, Gang & Sun, Hanbing, 2023. "Investigation of wake characteristics of floating offshore wind turbine with control strategy using actuator curve embedding method," Renewable Energy, Elsevier, vol. 218(C).
    6. Palanimuthu, Kumarasamy & Joo, Young Hoon, 2023. "Reliability improvement of the large-scale wind turbines with actuator faults using a robust fault-tolerant synergetic pitch control," Renewable Energy, Elsevier, vol. 217(C).
    7. Zhu, Dongping & Huang, Xiaogang & Ding, Zhixia & Zhang, Wei, 2024. "Estimation of wind turbine responses with attention-based neural network incorporating environmental uncertainties," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    8. Zhang, Juntao & Cheng, Chuntian & Yu, Shen, 2024. "Recognizing the mapping relationship between wind power output and meteorological information at a province level by coupling GIS and CNN technologies," Applied Energy, Elsevier, vol. 360(C).
    9. Jafarzadeh Ghoushchi, Saeid & Manjili, Sobhan & Mardani, Abbas & Saraji, Mahyar Kamali, 2021. "An extended new approach for forecasting short-term wind power using modified fuzzy wavelet neural network: A case study in wind power plant," Energy, Elsevier, vol. 223(C).
    10. Hongfu Zhang & Jiahao Wen & Farshad Golnary & Lei Zhou, 2022. "Output Power Control and Load Mitigation of a Horizontal Axis Wind Turbine with a Fully Coupled Aeroelastic Model: Novel Sliding Mode Perspective," Mathematics, MDPI, vol. 10(15), pages 1-40, August.
    11. Xinghua Tao & Nan Mo & Jianbo Qin & Xiaozhe Yang & Linfei Yin & Likun Hu, 2023. "Parallel Multi-Layer Monte Carlo Optimization Algorithm for Doubly Fed Induction Generator Controller Parameters Optimization," Energies, MDPI, vol. 16(19), pages 1-20, October.
    12. José Genaro González-Hernández & Rubén Salas-Cabrera, 2022. "Duty Cycle-Rotor Angular Speed Reverse Acting Relationship Steady State Analysis Based on a PMSG d–q Transform Modeling," Mathematics, MDPI, vol. 10(5), pages 1-17, February.
    13. Chengcheng Gu & Hua Li, 2022. "Review on Deep Learning Research and Applications in Wind and Wave Energy," Energies, MDPI, vol. 15(4), pages 1-19, February.
    14. Paweł Piotrowski & Inajara Rutyna & Dariusz Baczyński & Marcin Kopyt, 2022. "Evaluation Metrics for Wind Power Forecasts: A Comprehensive Review and Statistical Analysis of Errors," Energies, MDPI, vol. 15(24), pages 1-38, December.
    15. Yang, Yang & Lang, Jin & Wu, Jian & Zhang, Yanyan & Su, Lijie & Song, Xiangman, 2022. "Wind speed forecasting with correlation network pruning and augmentation: A two-phase deep learning method," Renewable Energy, Elsevier, vol. 198(C), pages 267-282.
    16. Liang, Tianyang & Hu, Changhong, 2024. "Numerical simulation of wind turbine wake characteristics by flux reconstruction method," Renewable Energy, Elsevier, vol. 234(C).
    17. Li, Tenghui & Liu, Xiaolei & Lin, Zi & Morrison, Rory, 2022. "Ensemble offshore Wind Turbine Power Curve modelling – An integration of Isolation Forest, fast Radial Basis Function Neural Network, and metaheuristic algorithm," Energy, Elsevier, vol. 239(PD).
    18. James Roetzer & Xingjie Li & John Hall, 2024. "Review of Data-Driven Models in Wind Energy: Demonstration of Blade Twist Optimization Based on Aerodynamic Loads," Energies, MDPI, vol. 17(16), pages 1-20, August.
    19. Xiangqing Yin & Yi Liu & Li Yang & Wenchao Gao, 2022. "Abnormal Data Cleaning Method for Wind Turbines Based on Constrained Curve Fitting," Energies, MDPI, vol. 15(17), pages 1-22, August.
    20. Wang, Xinbao & Xiao, Yang & Cai, Chang & Wu, Xianyou & Zhang, Yongming & Kong, Detong & Liu, Junbo & Sun, Xiangyu & Zhong, Xiaohui & Li, Qing'an, 2024. "Cyclic pitch control for aerodynamic load reductions of floating offshore wind turbines under pitch motions," Energy, Elsevier, vol. 309(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:234:y:2024:i:c:s0960148124013338. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.