IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v217y2023ics0960148123010431.html
   My bibliography  Save this article

MARLYC: Multi-Agent Reinforcement Learning Yaw Control

Author

Listed:
  • Kadoche, Elie
  • Gourvénec, Sébastien
  • Pallud, Maxime
  • Levent, Tanguy

Abstract

Inside wind farms, turbines are subject to physical interactions such as the wake effects. Such phenomena damage the performance of wind turbines, especially offshore. Yaw control consists in rotating a turbine’s nacelle on a horizontal plane and can be used to reduce the detrimental consequences of wake effects by steering them. In this work, a new method called multi-agent reinforcement learning yaw control (MARLYC) is proposed to control the yaw of each turbine in order to improve the total energy production of the farm. MARLYC consists in the centralized training and decentralized execution of multiple reinforcement learning agents, each agent controlling the setting of one turbine’s yaw. Agents are trained together so that collective control strategies can emerge. During execution, agents are completely independent, making their usage simpler. Numerical simulations are conducted on 15 different wind farms whose size ranges from 4 to 151 turbines with real time-varying wind data. For each wind farm, MARLYC increases the total energy production by controlling the yaws of the turbines judiciously with negligible increase of the computation time.

Suggested Citation

  • Kadoche, Elie & Gourvénec, Sébastien & Pallud, Maxime & Levent, Tanguy, 2023. "MARLYC: Multi-Agent Reinforcement Learning Yaw Control," Renewable Energy, Elsevier, vol. 217(C).
    • Handle: RePEc:eee:renene:v:217:y:2023:i:c:s0960148123010431
    DOI: 10.1016/j.renene.2023.119129
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148123010431
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2023.119129?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dong, Hongyang & Zhang, Jincheng & Zhao, Xiaowei, 2021. "Intelligent wind farm control via deep reinforcement learning and high-fidelity simulations," Applied Energy, Elsevier, vol. 292(C).
    2. Steven Chu & Arun Majumdar, 2012. "Opportunities and challenges for a sustainable energy future," Nature, Nature, vol. 488(7411), pages 294-303, August.
    3. Njiri, Jackson G. & Söffker, Dirk, 2016. "State-of-the-art in wind turbine control: Trends and challenges," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 377-393.
    4. Sun, Xiaojing & Huang, Diangui & Wu, Guoqing, 2012. "The current state of offshore wind energy technology development," Energy, Elsevier, vol. 41(1), pages 298-312.
    5. Bastankhah, Majid & Porté-Agel, Fernando, 2014. "A new analytical model for wind-turbine wakes," Renewable Energy, Elsevier, vol. 70(C), pages 116-123.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Baisthakur, Shubham & Fitzgerald, Breiffni, 2024. "Physics-Informed Neural Network surrogate model for bypassing Blade Element Momentum theory in wind turbine aerodynamic load estimation," Renewable Energy, Elsevier, vol. 224(C).
    2. Pawar, Suraj & Sharma, Ashesh & Vijayakumar, Ganesh & Bay, Chrstopher J. & Yellapantula, Shashank & San, Omer, 2022. "Towards multi-fidelity deep learning of wind turbine wakes," Renewable Energy, Elsevier, vol. 200(C), pages 867-879.
    3. Chen, Long Xiang & Xie, Mei Na & Zhao, Pan Pan & Wang, Feng Xiang & Hu, Peng & Wang, Dong Xiang, 2018. "A novel isobaric adiabatic compressed air energy storage (IA-CAES) system on the base of volatile fluid," Applied Energy, Elsevier, vol. 210(C), pages 198-210.
    4. Cao, Lichao & Ge, Mingwei & Gao, Xiaoxia & Du, Bowen & Li, Baoliang & Huang, Zhi & Liu, Yongqian, 2022. "Wind farm layout optimization to minimize the wake induced turbulence effect on wind turbines," Applied Energy, Elsevier, vol. 323(C).
    5. Wang, Yubao & Huang, Xiaozhou & Huang, Zhendong, 2024. "Energy-related uncertainty and Chinese stock market returns," Finance Research Letters, Elsevier, vol. 62(PB).
    6. Chen, Xuejun & Yang, Yongming & Cui, Zhixin & Shen, Jun, 2019. "Vibration fault diagnosis of wind turbines based on variational mode decomposition and energy entropy," Energy, Elsevier, vol. 174(C), pages 1100-1109.
    7. Muhammad Habib Ur Rehman & Luigi Coppola & Ernestino Lufrano & Isabella Nicotera & Cataldo Simari, 2023. "Enhancing Water Retention, Transport, and Conductivity Performance in Fuel Cell Applications: Nafion-Based Nanocomposite Membranes with Organomodified Graphene Oxide Nanoplatelets," Energies, MDPI, vol. 16(23), pages 1-11, November.
    8. Pin Li & Jinsuo Zhang, 2019. "Is China’s Energy Supply Sustainable? New Research Model Based on the Exponential Smoothing and GM(1,1) Methods," Energies, MDPI, vol. 12(2), pages 1-30, January.
    9. Ziyu Zhang & Peng Huang & Haocheng Sun, 2020. "A Novel Analytical Wake Model with a Cosine-Shaped Velocity Deficit," Energies, MDPI, vol. 13(13), pages 1-20, June.
    10. Sung-Fu Hung & Aoni Xu & Xue Wang & Fengwang Li & Shao-Hui Hsu & Yuhang Li & Joshua Wicks & Eduardo González Cervantes & Armin Sedighian Rasouli & Yuguang C. Li & Mingchuan Luo & Dae-Hyun Nam & Ning W, 2022. "A metal-supported single-atom catalytic site enables carbon dioxide hydrogenation," Nature Communications, Nature, vol. 13(1), pages 1-9, December.
    11. Zheng, Bobo & Xu, Jiuping & Ni, Ting & Li, Meihui, 2015. "Geothermal energy utilization trends from a technological paradigm perspective," Renewable Energy, Elsevier, vol. 77(C), pages 430-441.
    12. Habibi, Hamed & Howard, Ian & Simani, Silvio, 2019. "Reliability improvement of wind turbine power generation using model-based fault detection and fault tolerant control: A review," Renewable Energy, Elsevier, vol. 135(C), pages 877-896.
    13. Zhang, Jincheng & Zhao, Xiaowei, 2021. "Three-dimensional spatiotemporal wind field reconstruction based on physics-informed deep learning," Applied Energy, Elsevier, vol. 300(C).
    14. Tanvir Ahmad & Abdul Basit & Muneeb Ahsan & Olivier Coupiac & Nicolas Girard & Behzad Kazemtabrizi & Peter C. Matthews, 2019. "Implementation and Analyses of Yaw Based Coordinated Control of Wind Farms," Energies, MDPI, vol. 12(7), pages 1-15, April.
    15. Arvesen, Ø. & Medbø, V. & Fleten, S.-E. & Tomasgard, A. & Westgaard, S., 2013. "Linepack storage valuation under price uncertainty," Energy, Elsevier, vol. 52(C), pages 155-164.
    16. Mao, Guozhu & Zou, Hongyang & Chen, Guanyi & Du, Huibin & Zuo, Jian, 2015. "Past, current and future of biomass energy research: A bibliometric analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 1823-1833.
    17. Sarlak, H. & Meneveau, C. & Sørensen, J.N., 2015. "Role of subgrid-scale modeling in large eddy simulation of wind turbine wake interactions," Renewable Energy, Elsevier, vol. 77(C), pages 386-399.
    18. Luo, Rongrong & Wang, Liuwei & Yu, Wei & Shao, Feilong & Shen, Haikuo & Xie, Huaqing, 2023. "High energy storage density titanium nitride-pentaerythritol solid–solid composite phase change materials for light-thermal-electric conversion," Applied Energy, Elsevier, vol. 331(C).
    19. Ewa C. E. Rönnebro & Greg Whyatt & Michael Powell & Matthew Westman & Feng (Richard) Zheng & Zhigang Zak Fang, 2015. "Metal Hydrides for High-Temperature Power Generation," Energies, MDPI, vol. 8(8), pages 1-25, August.
    20. Chen, Dongfang & Pan, Lyuming & Pei, Pucheng & Huang, Shangwei & Ren, Peng & Song, Xin, 2021. "Carbon-coated oxygen vacancies-rich Co3O4 nanoarrays grow on nickel foam as efficient bifunctional electrocatalysts for rechargeable zinc-air batteries," Energy, Elsevier, vol. 224(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:217:y:2023:i:c:s0960148123010431. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.