IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v348y2023ics0306261923008838.html
   My bibliography  Save this article

Reward adaptive wind power tracking control based on deep deterministic policy gradient

Author

Listed:
  • Chen, Peng
  • Han, Dezhi

Abstract

Wind power efficiency is an essential factor affecting wind power development, and efficient wind power control methods are the key to improving wind power efficiency. Previous wind power control methods require high internal system expertise in internal systems and struggled to balance the accuracy of the maximum power control and the output stability under high wind speed. Therefore, this paper proposes a reward-adaptive control method for wind power tracking based on Deep Deterministic Policy Gradient (DDPG). The method can use one controller to simultaneously control the generator torque and pitch angle in various operating conditions following the system state and the designed flag of operating conditions, thus enabling efficient tracking of the maximum power generation, and stabilizing the output power under high wind speed. Moreover, this paper proposes an internal and external reward algorithm that integrates the Intrinsic Curiosity Module (ICM) and the Actor–Critic (AC) architecture, which can adaptively calculate the reward of DDPG, thereby effectively resolving the sparse reward problem, accelerating the convergence of neural network, and improving the learning effect. From the simulation, the control method proposed in this paper can effectively improve the power generation efficiency under turbulent wind speed, reduce the pitch angle variation by about 30%, and improve the power tracking accuracy by more than 70%.

Suggested Citation

  • Chen, Peng & Han, Dezhi, 2023. "Reward adaptive wind power tracking control based on deep deterministic policy gradient," Applied Energy, Elsevier, vol. 348(C).
    • Handle: RePEc:eee:appene:v:348:y:2023:i:c:s0306261923008838
    DOI: 10.1016/j.apenergy.2023.121519
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923008838
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.121519?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kumar, Dipesh & Chatterjee, Kalyan, 2016. "A review of conventional and advanced MPPT algorithms for wind energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 55(C), pages 957-970.
    2. Sahin, Mustafa & Yavrucuk, Ilkay, 2022. "Adaptive envelope protection control of wind turbines under varying operational conditions," Energy, Elsevier, vol. 247(C).
    3. Youssef, Abdel-Raheem & Mousa, Hossam H.H. & Mohamed, Essam E.M., 2020. "Development of self-adaptive P&O MPPT algorithm for wind generation systems with concentrated search area," Renewable Energy, Elsevier, vol. 154(C), pages 875-893.
    4. Yao, Qi & Hu, Yang & Zhao, Tianyang & Guan, Yuanpeng & Luo, Zhiling & Liu, Jizhen, 2022. "Fatigue load suppression during active power control process in wind farm using dynamic-local-reference DMPC," Renewable Energy, Elsevier, vol. 183(C), pages 423-434.
    5. Gualtieri, Giovanni, 2019. "A comprehensive review on wind resource extrapolation models applied in wind energy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 102(C), pages 215-233.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. He, J.Y. & Chan, P.W. & Li, Q.S. & Huang, Tao & Yim, Steve Hung Lam, 2024. "Assessment of urban wind energy resource in Hong Kong based on multi-instrument observations," Renewable and Sustainable Energy Reviews, Elsevier, vol. 191(C).
    2. Crippa, Paola & Alifa, Mariana & Bolster, Diogo & Genton, Marc G. & Castruccio, Stefano, 2021. "A temporal model for vertical extrapolation of wind speed and wind energy assessment," Applied Energy, Elsevier, vol. 301(C).
    3. Giani, Paolo & Tagle, Felipe & Genton, Marc G. & Castruccio, Stefano & Crippa, Paola, 2020. "Closing the gap between wind energy targets and implementation for emerging countries," Applied Energy, Elsevier, vol. 269(C).
    4. Tavakol Aghaei, Vahid & Ağababaoğlu, Arda & Bawo, Biram & Naseradinmousavi, Peiman & Yıldırım, Sinan & Yeşilyurt, Serhat & Onat, Ahmet, 2023. "Energy optimization of wind turbines via a neural control policy based on reinforcement learning Markov chain Monte Carlo algorithm," Applied Energy, Elsevier, vol. 341(C).
    5. Arshdeep Singh & Shimi Sudha Letha, 2019. "Emerging energy sources for electric vehicle charging station," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 21(5), pages 2043-2082, October.
    6. Tai Li & Yanbo Wang & Sunan Sun & Huimin Qian & Leqiu Wang & Lei Wang & Yanxia Shen & Zhicheng Ji, 2023. "Fuzzy Active Disturbance Rejection-Based Virtual Inertia Control Strategy for Wind Farms," Energies, MDPI, vol. 16(10), pages 1-16, May.
    7. Zhicheng Lin & Song Zheng & Zhicheng Chen & Rong Zheng & Wang Zhang, 2019. "Application Research of the Parallel System Theory and the Data Engine Approach in Wind Energy Conversion System," Energies, MDPI, vol. 12(5), pages 1-20, March.
    8. Amir Raouf & Kotb B. Tawfiq & Elsayed Tag Eldin & Hossam Youssef & Elwy E. El-Kholy, 2023. "Wind Energy Conversion Systems Based on a Synchronous Generator: Comparative Review of Control Methods and Performance," Energies, MDPI, vol. 16(5), pages 1-22, February.
    9. Christoffer Hallgren & Johan Arnqvist & Stefan Ivanell & Heiner Körnich & Ville Vakkari & Erik Sahlée, 2020. "Looking for an Offshore Low-Level Jet Champion among Recent Reanalyses: A Tight Race over the Baltic Sea," Energies, MDPI, vol. 13(14), pages 1-26, July.
    10. Li, Lei & Yin, Xiao-Li & Jia, Xin-Chun & Sobhani, Behrooz, 2020. "Day ahead powerful probabilistic wind power forecast using combined intelligent structure and fuzzy clustering algorithm," Energy, Elsevier, vol. 192(C).
    11. Pérez Albornoz, C. & Escalante Soberanis, M.A. & Ramírez Rivera, V. & Rivero, M., 2022. "Review of atmospheric stability estimations for wind power applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 163(C).
    12. Amira Elkodama & Amr Ismaiel & A. Abdellatif & S. Shaaban & Shigeo Yoshida & Mostafa A. Rushdi, 2023. "Control Methods for Horizontal Axis Wind Turbines (HAWT): State-of-the-Art Review," Energies, MDPI, vol. 16(17), pages 1-32, September.
    13. Dongran Song & Jian Yang & Mei Su & Anfeng Liu & Yao Liu & Young Hoon Joo, 2017. "A Comparison Study between Two MPPT Control Methods for a Large Variable-Speed Wind Turbine under Different Wind Speed Characteristics," Energies, MDPI, vol. 10(5), pages 1-18, May.
    14. Ganesh Mayilsamy & Balasubramani Natesan & Young Hoon Joo & Seong Ryong Lee, 2022. "Fast Terminal Synergetic Control of PMVG-Based Wind Energy Conversion System for Enhancing the Power Extraction Efficiency," Energies, MDPI, vol. 15(8), pages 1-22, April.
    15. He, J.Y. & Li, Q.S. & Chan, P.W. & Zhao, X.D., 2023. "Assessment of future wind resources under climate change using a multi-model and multi-method ensemble approach," Applied Energy, Elsevier, vol. 329(C).
    16. Matheus Schramm Dall’Asta & Telles Brunelli Lazzarin, 2024. "A Review of Fast Power-Reserve Control Techniques in Grid-Connected Wind Energy Conversion Systems," Energies, MDPI, vol. 17(2), pages 1-29, January.
    17. Vasudevan, Krishnakumar R. & Ramachandaramurthy, Vigna K. & Venugopal, Gomathi & Ekanayake, J.B. & Tiong, S.K., 2021. "Variable speed pumped hydro storage: A review of converters, controls and energy management strategies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    18. Bodha, Venugopal Reddy & Srujana, A. & Chandrashekar, O., 2018. "A modified H-bridge voltage source converter with Fault Ride Capability," Energy, Elsevier, vol. 165(PB), pages 1380-1391.
    19. Christopher Jung & Dirk Schindler, 2023. "Reasons for the Recent Onshore Wind Capacity Factor Increase," Energies, MDPI, vol. 16(14), pages 1-17, July.
    20. Wollz, Danilo Henrique & da Silva, Sergio Augusto Oliveira & Sampaio, Leonardo Poltronieri, 2020. "Real-time monitoring of an electronic wind turbine emulator based on the dynamic PMSG model using a graphical interface," Renewable Energy, Elsevier, vol. 155(C), pages 296-308.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:348:y:2023:i:c:s0306261923008838. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.