IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v297y2024ics0360544224010272.html
   My bibliography  Save this article

Environmental-Sensing and adaptive optimization of wave energy converter based on deep reinforcement learning and computational fluid dynamics

Author

Listed:
  • Liang, Hongjian
  • Qin, Hao
  • Su, Haowen
  • Wen, Zhixuan
  • Mu, Lin

Abstract

This paper introduces a novel coupled model for real-time control of the point absorber wave energy converter (WEC) using parallelized deep reinforcement learning (DRL), where the WEC is situated within a numerical wave tank (NWT) built with the method of computational fluid dynamics (CFD). An in-house solver is developed to couple with the DRL and CFD to solve the interaction between WEC and the fluid environment. Validations on wave generation, wave-floater interaction, and power take-off (PTO) unit are carried out. Then, neglecting the detailed model for the PTO technologies, the DRL-based strategy dynamically adjusts the PTO force as a function of the wave features and floater motion. Based on the interaction data, the model-free DRL is outstanding in adaptability and robustness. Simulation results reveal that DRL control improves the wave energy absorption in irregular wave environments, resulting in improvement of 107.5 % compared to the resistive control, with better device protection performance than the model predictive control (MPC). An additional analysis of model-free characteristics of DRL demonstrates the optimization ability independent of floater modeling. This work is the first in-depth study of DRL control of WECs in CFD simulation, providing a more accurate simulation and an optimization process closer to the reality.

Suggested Citation

  • Liang, Hongjian & Qin, Hao & Su, Haowen & Wen, Zhixuan & Mu, Lin, 2024. "Environmental-Sensing and adaptive optimization of wave energy converter based on deep reinforcement learning and computational fluid dynamics," Energy, Elsevier, vol. 297(C).
  • Handle: RePEc:eee:energy:v:297:y:2024:i:c:s0360544224010272
    DOI: 10.1016/j.energy.2024.131254
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224010272
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.131254?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ghasemi, Amirmahdi & Anbarsooz, Morteza & Malvandi, Amir & Ghasemi, Amirhossein & Hedayati, Faraz, 2017. "A nonlinear computational modeling of wave energy converters: A tethered point absorber and a bottom-hinged flap device," Renewable Energy, Elsevier, vol. 103(C), pages 774-785.
    2. Shabara, Mohamed A. & Abdelkhalik, Ossama, 2023. "Dynamic modeling of the motions of variable-shape wave energy converters," Renewable and Sustainable Energy Reviews, Elsevier, vol. 173(C).
    3. Majidi, AjabGul & Bingölbali, Bilal & Akpınar, Adem & Iglesias, Gregorio & Jafali, Halid, 2021. "Downscaling wave energy converters for optimum performance in low-energy seas," Renewable Energy, Elsevier, vol. 168(C), pages 705-722.
    4. Anbarsooz, M. & Passandideh-Fard, M. & Moghiman, M., 2014. "Numerical simulation of a submerged cylindrical wave energy converter," Renewable Energy, Elsevier, vol. 64(C), pages 132-143.
    5. Zhang, Hengming & Zhou, Binzhen & Vogel, Christopher & Willden, Richard & Zang, Jun & Zhang, Liang, 2020. "Hydrodynamic performance of a floating breakwater as an oscillating-buoy type wave energy converter," Applied Energy, Elsevier, vol. 257(C).
    6. Zhang, Jincheng & Zhao, Xiaowei & Greaves, Deborah & Jin, Siya, 2023. "Modeling of a hinged-raft wave energy converter via deep operator learning and wave tank experiments," Applied Energy, Elsevier, vol. 341(C).
    7. He, Zechen & Ning, Dezhi & Gou, Ying & Zhou, Zhimin, 2022. "Wave energy converter optimization based on differential evolution algorithm," Energy, Elsevier, vol. 246(C).
    8. Bozzi, Silvia & Archetti, Renata & Passoni, Giuseppe, 2014. "Wave electricity production in Italian offshore: A preliminary investigation," Renewable Energy, Elsevier, vol. 62(C), pages 407-416.
    9. Windt, Christian & Davidson, Josh & Ransley, Edward J. & Greaves, Deborah & Jakobsen, Morten & Kramer, Morten & Ringwood, John V., 2020. "Validation of a CFD-based numerical wave tank model for the power production assessment of the wavestar ocean wave energy converter," Renewable Energy, Elsevier, vol. 146(C), pages 2499-2516.
    10. Masoomi, Mobin & Sarlak, Hamid & Rezanejad, Kourosh, 2023. "Hydrodynamic performance analysis of a new hybrid wave energy converter system using OpenFOAM," Energy, Elsevier, vol. 269(C).
    11. Shadman, Milad & Guarniz Avalos, Gustavo Omar & Estefen, Segen F., 2021. "On the power performance of a wave energy converter with a direct mechanical drive power take-off system controlled by latching," Renewable Energy, Elsevier, vol. 169(C), pages 157-177.
    12. Son, Daewoong & Yeung, Ronald W., 2017. "Optimizing ocean-wave energy extraction of a dual coaxial-cylinder WEC using nonlinear model predictive control," Applied Energy, Elsevier, vol. 187(C), pages 746-757.
    13. Li, Liang & Yuan, Zhiming & Gao, Yan, 2018. "Maximization of energy absorption for a wave energy converter using the deep machine learning," Energy, Elsevier, vol. 165(PA), pages 340-349.
    14. Chan Roh & Kyong-Hwan Kim, 2022. "Deep Learning Prediction for Rotational Speed of Turbine in Oscillating Water Column-Type Wave Energy Converter," Energies, MDPI, vol. 15(2), pages 1-22, January.
    15. Berenjkoob, Mahdi Nazari & Ghiasi, Mahmoud & Soares, C.Guedes, 2021. "Influence of the shape of a buoy on the efficiency of its dual-motion wave energy conversion," Energy, Elsevier, vol. 214(C).
    16. Mahmoodi, Kumars & Nepomuceno, Erivelton & Razminia, Abolhassan, 2022. "Wave excitation force forecasting using neural networks," Energy, Elsevier, vol. 247(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pasta, Edoardo & Faedo, Nicolás & Mattiazzo, Giuliana & Ringwood, John V., 2023. "Towards data-driven and data-based control of wave energy systems: Classification, overview, and critical assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    2. Manuel Corrales-Gonzalez & George Lavidas & Giovanni Besio, 2023. "Feasibility of Wave Energy Harvesting in the Ligurian Sea, Italy," Sustainability, MDPI, vol. 15(11), pages 1-22, June.
    3. Jin, Siya & Patton, Ron J. & Guo, Bingyong, 2018. "Viscosity effect on a point absorber wave energy converter hydrodynamics validated by simulation and experiment," Renewable Energy, Elsevier, vol. 129(PA), pages 500-512.
    4. Shadmani, Alireza & Nikoo, Mohammad Reza & Gandomi, Amir H. & Chen, Mingjie & Nazari, Rouzbeh, 2024. "Advancements in optimizing wave energy converter geometry utilizing metaheuristic algorithms," Renewable and Sustainable Energy Reviews, Elsevier, vol. 197(C).
    5. Jin, Peng & Zheng, Zhi & Zhou, Zhaomin & Zhou, Binzhen & Wang, Lei & Yang, Yang & Liu, Yingyi, 2023. "Optimization and evaluation of a semi-submersible wind turbine and oscillating body wave energy converters hybrid system," Energy, Elsevier, vol. 282(C).
    6. Foteinis, Spyros, 2022. "Wave energy converters in low energy seas: Current state and opportunities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    7. Giorgi, Giuseppe & Gomes, Rui P.F. & Henriques, João C.C. & Gato, Luís M.C. & Bracco, Giovanni & Mattiazzo, Giuliana, 2020. "Detecting parametric resonance in a floating oscillating water column device for wave energy conversion: Numerical simulations and validation with physical model tests," Applied Energy, Elsevier, vol. 276(C).
    8. Li, Hui & Wang, LiGuo, 2023. "Numerical study on self-power supply of large marine monitoring buoys: Wave-excited vibration energy harvesting and harvester optimization," Energy, Elsevier, vol. 285(C).
    9. He, Zechen & Ning, Dezhi & Gou, Ying & Zhou, Zhimin, 2022. "Wave energy converter optimization based on differential evolution algorithm," Energy, Elsevier, vol. 246(C).
    10. Oliveira, D. & Lopes de Almeida, J.P.P.G. & Santiago, A. & Rigueiro, C., 2022. "Development of a CFD-based numerical wave tank of a novel multipurpose wave energy converter," Renewable Energy, Elsevier, vol. 199(C), pages 226-245.
    11. Chen, Weixing & Zhou, Boen & Huang, Hao & Lu, Yunfei & Li, Shaoxun & Gao, Feng, 2022. "Design, modeling and performance analysis of a deployable WEC for ocean robots," Applied Energy, Elsevier, vol. 327(C).
    12. Zhang, Zhenquan & Qin, Jian & Zhang, Yuchen & Huang, Shuting & Liu, Yanjun & Xue, Gang, 2023. "Cooperative model predictive control for Wave Energy Converter arrays," Renewable Energy, Elsevier, vol. 219(P1).
    13. José Carlos Ugaz Peña & Christian Luis Medina Rodríguez & Gustavo O. Guarniz Avalos, 2023. "Study of a New Wave Energy Converter with Perturb and Observe Maximum Power Point Tracking Method," Sustainability, MDPI, vol. 15(13), pages 1-18, July.
    14. Wang, Yuhan & Dong, Sheng, 2023. "Analytical investigation on a wave energy converter-dual-arc breakwater integration system," Energy, Elsevier, vol. 285(C).
    15. Xiao, Han & Wang, Xu, 2024. "Sensitivity analysis of design parameters and their interactions and performance prediction of a novel twin turbine wave energy converter," Energy, Elsevier, vol. 293(C).
    16. Ruijia Jin & Jiawei Wang & Hanbao Chen & Baolei Geng & Zhen Liu, 2022. "Numerical Investigation of Multi-Floater Truss-Type Wave Energy Convertor Platform," Energies, MDPI, vol. 15(15), pages 1-17, August.
    17. Giorgi, Giuseppe, 2024. "Embedding parametric resonance in a 2:1 wave energy converter to get a broader bandwidth," Renewable Energy, Elsevier, vol. 222(C).
    18. Zhou, Yu & Chen, Lifen & Zhao, Jie & Liu, Xiangjian & Ye, Xiaorong & Wang, Fei & Adcock, Thomas A.A. & Ning, Dezhi, 2023. "Power and dynamic performance of a floating multi-functional platform: An experimental study," Energy, Elsevier, vol. 285(C).
    19. Xiao, Han & Liu, Zhenwei & Zhang, Ran & Kelham, Andrew & Xu, Xiangyang & Wang, Xu, 2021. "Study of a novel rotational speed amplified dual turbine wheel wave energy converter," Applied Energy, Elsevier, vol. 301(C).
    20. Cheng, Yong & Xi, Chen & Dai, Saishuai & Ji, Chunyan & Cocard, Margot & Yuan, Zhiming & Incecik, Atilla, 2021. "Performance characteristics and parametric analysis of a novel multi-purpose platform combining a moonpool-type floating breakwater and an array of wave energy converters," Applied Energy, Elsevier, vol. 292(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:297:y:2024:i:c:s0360544224010272. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.