IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i23p10663-d1537228.html
   My bibliography  Save this article

Microgrid Optimization Strategy for Charging and Swapping Power Stations with New Energy Based on Multi-Agent Reinforcement Learning

Author

Listed:
  • Hongbin Sun

    (School of Electrical Engineering, Changchun Institute of Technology, Changchun 130012, China)

  • Zhenyu Duan

    (School of Electrical Engineering, Changchun Institute of Technology, Changchun 130012, China)

  • Anyun Yang

    (School of Electrical Engineering, Changchun Institute of Technology, Changchun 130012, China)

Abstract

Aiming at the coordinated control of charging and swapping loads in complex environments, this research proposes an optimization strategy for microgrids with new energy charging and swapping stations based on adaptive multi-agent reinforcement learning. First, a microgrid model including charging and swapping loads, photovoltaic power generation, and wind power generation was constructed, and the Markov decision process was used to characterize the stochastic characteristics of new energy power generation, including charging and swapping loads. The deep relationship between uncertainty factors and charging and swapping laws was explored, and an adaptive multi-agent deep reinforcement learning method was used to optimize the random action selection process, improve the convergence speed of the coordinated optimization model, and realize coordinated control of multiple charging and swapping loads. Finally, through the analysis of different scenarios, the effectiveness of the proposed adaptive multi-agent reinforcement learning model for coordinated control of charging and swapping loads was verified. The results show that the proposed method has a faster convergence speed and can effectively optimize the charging process of charging and swapping loads, reducing power fluctuations of the newly connected energy grid.

Suggested Citation

  • Hongbin Sun & Zhenyu Duan & Anyun Yang, 2024. "Microgrid Optimization Strategy for Charging and Swapping Power Stations with New Energy Based on Multi-Agent Reinforcement Learning," Sustainability, MDPI, vol. 16(23), pages 1-19, December.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:23:p:10663-:d:1537228
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/23/10663/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/23/10663/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yuxin Wen & Peixiao Fan & Jia Hu & Song Ke & Fuzhang Wu & Xu Zhu, 2022. "An Optimal Scheduling Strategy of a Microgrid with V2G Based on Deep Q-Learning," Sustainability, MDPI, vol. 14(16), pages 1-18, August.
    2. Abdullah Altamimi & Muhammad Bilal Ali & Syed Ali Abbas Kazmi & Zafar A. Khan, 2024. "Multi-Agent Reinforcement Learning Optimization Framework for On-Grid Electric Vehicle Charging from Base Transceiver Stations Using Renewable Energy and Storage Systems," Energies, MDPI, vol. 17(14), pages 1-33, July.
    3. Park, Keonwoo & Moon, Ilkyeong, 2022. "Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid," Applied Energy, Elsevier, vol. 328(C).
    4. Ali Ahmadian & Kumaraswamy Ponnambalam & Ali Almansoori & Ali Elkamel, 2023. "Optimal Management of a Virtual Power Plant Consisting of Renewable Energy Resources and Electric Vehicles Using Mixed-Integer Linear Programming and Deep Learning," Energies, MDPI, vol. 16(2), pages 1-17, January.
    5. Zhang, Xizheng & Wang, Zeyu & Lu, Zhangyu, 2022. "Multi-objective load dispatch for microgrid with electric vehicles using modified gravitational search and particle swarm optimization algorithm," Applied Energy, Elsevier, vol. 306(PA).
    6. Jianying Li & Minsheng Yang & Yuexing Zhang & Jianqi Li & Jianquan Lu, 2023. "Micro-Grid Day-Ahead Stochastic Optimal Dispatch Considering Multiple Demand Response and Electric Vehicles," Energies, MDPI, vol. 16(8), pages 1-15, April.
    7. Tabar, Vahid Sohrabi & Jirdehi, Mehdi Ahmadi & Hemmati, Reza, 2017. "Energy management in microgrid based on the multi objective stochastic programming incorporating portable renewable energy resource as demand response option," Energy, Elsevier, vol. 118(C), pages 827-839.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiankai Gao & Yang Li & Bin Wang & Haibo Wu, 2023. "Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm," Energies, MDPI, vol. 16(7), pages 1-21, April.
    2. Nyong-Bassey, Bassey Etim & Giaouris, Damian & Patsios, Charalampos & Papadopoulou, Simira & Papadopoulos, Athanasios I. & Walker, Sara & Voutetakis, Spyros & Seferlis, Panos & Gadoue, Shady, 2020. "Reinforcement learning based adaptive power pinch analysis for energy management of stand-alone hybrid energy storage systems considering uncertainty," Energy, Elsevier, vol. 193(C).
    3. Paulo M. De Oliveira-De Jesus & Jose M. Yusta, 2024. "Optimal Power Dispatch for Maximum Energy Community Welfare by Considering Closed Distribution Systems and Renewable Sources," Energies, MDPI, vol. 17(18), pages 1-21, September.
    4. Tan, Bifei & Lin, Zhenjia & Zheng, Xiaodong & Xiao, Fu & Wu, Qiuwei & Yan, Jinyue, 2023. "Distributionally robust energy management for multi-microgrids with grid-interactive EVs considering the multi-period coupling effect of user behaviors," Applied Energy, Elsevier, vol. 350(C).
    5. Jingjing Zhai & Xiaobei Wu & Zihao Li & Shaojie Zhu & Bo Yang & Haoming Liu, 2021. "Day-Ahead and Intra-Day Collaborative Optimized Operation among Multiple Energy Stations," Energies, MDPI, vol. 14(4), pages 1-33, February.
    6. Zeyue Sun & Mohsen Eskandari & Chaoran Zheng & Ming Li, 2022. "Handling Computation Hardness and Time Complexity Issue of Battery Energy Storage Scheduling in Microgrids by Deep Reinforcement Learning," Energies, MDPI, vol. 16(1), pages 1-20, December.
    7. Zhang, Tianren & Huang, Yuping & Liao, Hui & Liang, Yu, 2023. "A hybrid electric vehicle load classification and forecasting approach based on GBDT algorithm and temporal convolutional network," Applied Energy, Elsevier, vol. 351(C).
    8. Gabriella Ferruzzi & Giorgio Graditi & Federico Rossi, 2020. "A joint approach for strategic bidding of a microgrid in energy and spinning reserve markets," Energy & Environment, , vol. 31(1), pages 88-115, February.
    9. Ziyuan Liu & Junjing Tan & Wei Guo & Chong Fan & Wenhe Peng & Zhijian Fang & Jingke Gao, 2024. "Hierarchical Optimal Dispatching of Electric Vehicles Based on Photovoltaic-Storage Charging Stations," Mathematics, MDPI, vol. 12(21), pages 1-13, October.
    10. Chen, Pengzhan & Liu, Mengchao & Chen, Chuanxi & Shang, Xin, 2019. "A battery management strategy in microgrid for personalized customer requirements," Energy, Elsevier, vol. 189(C).
    11. Wisam Kareem Meteab & Salwan Ali Habeeb Alsultani & Francisco Jurado, 2023. "Energy Management of Microgrids with a Smart Charging Strategy for Electric Vehicles Using an Improved RUN Optimizer," Energies, MDPI, vol. 16(16), pages 1-18, August.
    12. Li, Da & Zhang, Zhaosheng & Zhou, Litao & Liu, Peng & Wang, Zhenpo & Deng, Junjun, 2022. "Multi-time-step and multi-parameter prediction for real-world proton exchange membrane fuel cell vehicles (PEMFCVs) toward fault prognosis and energy consumption prediction," Applied Energy, Elsevier, vol. 325(C).
    13. Shaterabadi, Mohammad & Jirdehi, Mehdi Ahmadi & Amiri, Nima & Omidi, Sina, 2020. "Enhancement the economical and environmental aspects of plus-zero energy buildings integrated with INVELOX turbines," Renewable Energy, Elsevier, vol. 153(C), pages 1355-1367.
    14. Xu, Xuesong & Xu, Kai & Zeng, Ziyang & Tang, Jiale & He, Yuanxing & Shi, Guangze & Zhang, Tao, 2024. "Collaborative optimization of multi-energy multi-microgrid system: A hierarchical trust-region multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 375(C).
    15. de la Hoz, Jordi & Martín, Helena & Alonso, Alex & Carolina Luna, Adriana & Matas, José & Vasquez, Juan C. & Guerrero, Josep M., 2019. "Regulatory-framework-embedded energy management system for microgrids: The case study of the Spanish self-consumption scheme," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    16. Zhang, Y.Q. & Chen, J.J. & Wang, Y.X. & Feng, L., 2024. "Enhancing resilience of agricultural microgrid through electricity–heat–water based multi-energy hub considering irradiation intensity uncertainty," Renewable Energy, Elsevier, vol. 220(C).
    17. Cheng, Xiu & Li, Wenbo & Yang, Jiameng & Zhang, Linling, 2023. "How convenience and informational tools shape waste separation behavior: A social network approach," Resources Policy, Elsevier, vol. 86(PB).
    18. Morteza Zare Oskouei & Ayşe Aybike Şeker & Süleyman Tunçel & Emin Demirbaş & Tuba Gözel & Mehmet Hakan Hocaoğlu & Mehdi Abapour & Behnam Mohammadi-Ivatloo, 2022. "A Critical Review on the Impacts of Energy Storage Systems and Demand-Side Management Strategies in the Economic Operation of Renewable-Based Distribution Network," Sustainability, MDPI, vol. 14(4), pages 1-34, February.
    19. Rodriguez, Mauricio & Arcos–Aviles, Diego & Martinez, Wilmar, 2023. "Fuzzy logic-based energy management for isolated microgrid using meta-heuristic optimization algorithms," Applied Energy, Elsevier, vol. 335(C).
    20. Arul Rajagopalan & Karthik Nagarajan & Oscar Danilo Montoya & Seshathiri Dhanasekaran & Inayathullah Abdul Kareem & Angalaeswari Sendraya Perumal & Natrayan Lakshmaiya & Prabhu Paramasivam, 2022. "Multi-Objective Optimal Scheduling of a Microgrid Using Oppositional Gradient-Based Grey Wolf Optimizer," Energies, MDPI, vol. 15(23), pages 1-24, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:23:p:10663-:d:1537228. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.