IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i15p5653-d1203953.html
   My bibliography  Save this article

A Multi-Agent Reinforcement Learning Method for Cooperative Secondary Voltage Control of Microgrids

Author

Listed:
  • Tianhao Wang

    (Electric Power Research Institute, State Grid Tianjin Electric Power Company, No. 8, Haitai Huake 4th Road, Huayuan Industrial Zone, Binhai High Tech Zone, Tianjin 300384, China)

  • Shiqian Ma

    (Electric Power Research Institute, State Grid Tianjin Electric Power Company, No. 8, Haitai Huake 4th Road, Huayuan Industrial Zone, Binhai High Tech Zone, Tianjin 300384, China)

  • Zhuo Tang

    (School of Electrical and Information Engineering, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin 300072, China)

  • Tianchun Xiang

    (State Grid Tianjin Electric Power Company, No. 39 Wujing, Guangfu Street, Hebei District, Tianjin 300010, China)

  • Chaoxu Mu

    (School of Electrical and Information Engineering, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin 300072, China)

  • Yao Jin

    (State Grid Tianjin Electric Power Company, No. 39 Wujing, Guangfu Street, Hebei District, Tianjin 300010, China)

Abstract

This paper proposes a novel cooperative voltage control strategy for an isolated microgrid based on the multi-agent advantage actor-critic (MA2C) algorithm. The proposed method facilitates the collaborative operation of a distributed energy system (DES) by adopting an attention mechanism to adaptively boost information processing effectiveness through the assignment of importance scores. Additionally, the algorithm we propose, executed through a centralized training and decentralized execution framework, implements secondary control and effectively restores voltage deviation. The introduction of an attention mechanism alleviates the burden of information transmission. Finally, we illustrate the effectiveness of the proposed method through a DES consisting of six energy nodes.

Suggested Citation

  • Tianhao Wang & Shiqian Ma & Zhuo Tang & Tianchun Xiang & Chaoxu Mu & Yao Jin, 2023. "A Multi-Agent Reinforcement Learning Method for Cooperative Secondary Voltage Control of Microgrids," Energies, MDPI, vol. 16(15), pages 1-18, July.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:15:p:5653-:d:1203953
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/15/5653/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/15/5653/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nikita Tomin & Nikolai Voropai & Victor Kurbatsky & Christian Rehtanz, 2021. "Management of Voltage Flexibility from Inverter-Based Distributed Generation Using Multi-Agent Reinforcement Learning," Energies, MDPI, vol. 14(24), pages 1-14, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Edward J. Smith & Duane A. Robinson & Sean Elphick, 2024. "DER Control and Management Strategies for Distribution Networks: A Review of Current Practices and Future Directions," Energies, MDPI, vol. 17(11), pages 1-40, May.
    2. Md Tariqul Islam & M. J. Hossain, 2023. "Artificial Intelligence for Hosting Capacity Analysis: A Systematic Literature Review," Energies, MDPI, vol. 16(4), pages 1-33, February.
    3. Jude Suchithra & Duane Robinson & Amin Rajabi, 2023. "Hosting Capacity Assessment Strategies and Reinforcement Learning Methods for Coordinated Voltage Control in Electricity Distribution Networks: A Review," Energies, MDPI, vol. 16(5), pages 1-28, March.
    4. Yu Fujimoto & Akihisa Kaneko & Yutaka Iino & Hideo Ishii & Yasuhiro Hayashi, 2023. "Challenges in Smartizing Operational Management of Functionally-Smart Inverters for Distributed Energy Resources: A Review on Machine Learning Aspects," Energies, MDPI, vol. 16(3), pages 1-26, January.
    5. Gharibvand, Hossein & Gharehpetian, G.B. & Anvari-Moghaddam, A., 2024. "A survey on microgrid flexibility resources, evaluation metrics and energy storage effects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 201(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:15:p:5653-:d:1203953. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.