IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v217y2023ics0960148123010431.html
   My bibliography  Save this article

MARLYC: Multi-Agent Reinforcement Learning Yaw Control

Author

Listed:
  • Kadoche, Elie
  • Gourvénec, Sébastien
  • Pallud, Maxime
  • Levent, Tanguy

Abstract

Inside wind farms, turbines are subject to physical interactions such as the wake effects. Such phenomena damage the performance of wind turbines, especially offshore. Yaw control consists in rotating a turbine’s nacelle on a horizontal plane and can be used to reduce the detrimental consequences of wake effects by steering them. In this work, a new method called multi-agent reinforcement learning yaw control (MARLYC) is proposed to control the yaw of each turbine in order to improve the total energy production of the farm. MARLYC consists in the centralized training and decentralized execution of multiple reinforcement learning agents, each agent controlling the setting of one turbine’s yaw. Agents are trained together so that collective control strategies can emerge. During execution, agents are completely independent, making their usage simpler. Numerical simulations are conducted on 15 different wind farms whose size ranges from 4 to 151 turbines with real time-varying wind data. For each wind farm, MARLYC increases the total energy production by controlling the yaws of the turbines judiciously with negligible increase of the computation time.

Suggested Citation

  • Kadoche, Elie & Gourvénec, Sébastien & Pallud, Maxime & Levent, Tanguy, 2023. "MARLYC: Multi-Agent Reinforcement Learning Yaw Control," Renewable Energy, Elsevier, vol. 217(C).
    • Handle: RePEc:eee:renene:v:217:y:2023:i:c:s0960148123010431
    DOI: 10.1016/j.renene.2023.119129
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148123010431
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2023.119129?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Steven Chu & Arun Majumdar, 2012. "Opportunities and challenges for a sustainable energy future," Nature, Nature, vol. 488(7411), pages 294-303, August.
    2. Bastankhah, Majid & Porté-Agel, Fernando, 2014. "A new analytical model for wind-turbine wakes," Renewable Energy, Elsevier, vol. 70(C), pages 116-123.
    3. Dong, Hongyang & Zhang, Jincheng & Zhao, Xiaowei, 2021. "Intelligent wind farm control via deep reinforcement learning and high-fidelity simulations," Applied Energy, Elsevier, vol. 292(C).
    4. Njiri, Jackson G. & Söffker, Dirk, 2016. "State-of-the-art in wind turbine control: Trends and challenges," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 377-393.
    5. Sun, Xiaojing & Huang, Diangui & Wu, Guoqing, 2012. "The current state of offshore wind energy technology development," Energy, Elsevier, vol. 41(1), pages 298-312.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pawar, Suraj & Sharma, Ashesh & Vijayakumar, Ganesh & Bay, Chrstopher J. & Yellapantula, Shashank & San, Omer, 2022. "Towards multi-fidelity deep learning of wind turbine wakes," Renewable Energy, Elsevier, vol. 200(C), pages 867-879.
    2. Baisthakur, Shubham & Fitzgerald, Breiffni, 2024. "Physics-Informed Neural Network surrogate model for bypassing Blade Element Momentum theory in wind turbine aerodynamic load estimation," Renewable Energy, Elsevier, vol. 224(C).
    3. Cao, Lichao & Ge, Mingwei & Gao, Xiaoxia & Du, Bowen & Li, Baoliang & Huang, Zhi & Liu, Yongqian, 2022. "Wind farm layout optimization to minimize the wake induced turbulence effect on wind turbines," Applied Energy, Elsevier, vol. 323(C).
    4. Wang, Yubao & Huang, Xiaozhou & Huang, Zhendong, 2024. "Energy-related uncertainty and Chinese stock market returns," Finance Research Letters, Elsevier, vol. 62(PB).
    5. Chen, Xuejun & Yang, Yongming & Cui, Zhixin & Shen, Jun, 2019. "Vibration fault diagnosis of wind turbines based on variational mode decomposition and energy entropy," Energy, Elsevier, vol. 174(C), pages 1100-1109.
    6. Muhammad Habib Ur Rehman & Luigi Coppola & Ernestino Lufrano & Isabella Nicotera & Cataldo Simari, 2023. "Enhancing Water Retention, Transport, and Conductivity Performance in Fuel Cell Applications: Nafion-Based Nanocomposite Membranes with Organomodified Graphene Oxide Nanoplatelets," Energies, MDPI, vol. 16(23), pages 1-11, November.
    7. Pin Li & Jinsuo Zhang, 2019. "Is China’s Energy Supply Sustainable? New Research Model Based on the Exponential Smoothing and GM(1,1) Methods," Energies, MDPI, vol. 12(2), pages 1-30, January.
    8. Mao, Guozhu & Zou, Hongyang & Chen, Guanyi & Du, Huibin & Zuo, Jian, 2015. "Past, current and future of biomass energy research: A bibliometric analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 1823-1833.
    9. Sarlak, H. & Meneveau, C. & Sørensen, J.N., 2015. "Role of subgrid-scale modeling in large eddy simulation of wind turbine wake interactions," Renewable Energy, Elsevier, vol. 77(C), pages 386-399.
    10. Luo, Rongrong & Wang, Liuwei & Yu, Wei & Shao, Feilong & Shen, Haikuo & Xie, Huaqing, 2023. "High energy storage density titanium nitride-pentaerythritol solid–solid composite phase change materials for light-thermal-electric conversion," Applied Energy, Elsevier, vol. 331(C).
    11. Chen, Dongfang & Pan, Lyuming & Pei, Pucheng & Huang, Shangwei & Ren, Peng & Song, Xin, 2021. "Carbon-coated oxygen vacancies-rich Co3O4 nanoarrays grow on nickel foam as efficient bifunctional electrocatalysts for rechargeable zinc-air batteries," Energy, Elsevier, vol. 224(C).
    12. Nicolas Tobin & Ali M. Hamed & Leonardo P. Chamorro, 2015. "An Experimental Study on the Effects ofWinglets on the Wake and Performance of a ModelWind Turbine," Energies, MDPI, vol. 8(10), pages 1-18, October.
    13. Géremi Gilson Dranka & Paula Ferreira, 2020. "Electric Vehicles and Biofuels Synergies in the Brazilian Energy System," Energies, MDPI, vol. 13(17), pages 1-22, August.
    14. Anagnostopoulos, Sokratis J. & Bauer, Jens & Clare, Mariana C.A. & Piggott, Matthew D., 2023. "Accelerated wind farm yaw and layout optimisation with multi-fidelity deep transfer learning wake models," Renewable Energy, Elsevier, vol. 218(C).
    15. Yang, Jingluan & Chen, Wei, 2023. "Unravelling the landscape of global cobalt trade: Patterns, robustness, and supply chain security," Resources Policy, Elsevier, vol. 86(PB).
    16. Bon-Yong Koo & Dae-Yi Jung, 2019. "A Comparative Study on Primary Bearing Rating Life of a 5-MW Two-Blade Wind Turbine System Based on Two Different Control Domains," Energies, MDPI, vol. 12(13), pages 1-16, July.
    17. Li, Siyi & Zhang, Mingrui & Piggott, Matthew D., 2023. "End-to-end wind turbine wake modelling with deep graph representation learning," Applied Energy, Elsevier, vol. 339(C).
    18. Ti, Zilong & Deng, Xiao Wei & Yang, Hongxing, 2020. "Wake modeling of wind turbines using machine learning," Applied Energy, Elsevier, vol. 257(C).
    19. Siyu Tao & Andrés Feijóo & Jiemin Zhou & Gang Zheng, 2020. "Topology Design of an Offshore Wind Farm with Multiple Types of Wind Turbines in a Circular Layout," Energies, MDPI, vol. 13(3), pages 1-16, January.
    20. Zilong, Ti & Xiao Wei, Deng, 2022. "Layout optimization of offshore wind farm considering spatially inhomogeneous wave loads," Applied Energy, Elsevier, vol. 306(PA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:217:y:2023:i:c:s0960148123010431. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.