IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v372y2024ics0306261924010080.html
   My bibliography  Save this article

A multi-agent reinforcement learning method for distribution system restoration considering dynamic network reconfiguration

Author

Listed:
  • Si, Ruiqi
  • Chen, Siyuan
  • Zhang, Jun
  • Xu, Jian
  • Zhang, Luxi

Abstract

Extreme weather, chain failures, and other events have increased the probability of wide-area blackouts, which highlights the importance of rapidly and efficiently restoring the affected loads. This paper proposes a multi-agent reinforcement learning method for distribution system restoration. Firstly, considering that the topology of the distribution system may change during network reconfiguration, a dynamic agent network (DAN) architecture is designed to address the challenge of input dimensions changing in neural network. Two encoders are created to capture observations of the environment and other agents respectively, and an attention mechanism is used to aggregate an arbitrary-sized neighboring agent feature set. Then, considering the operation constraints of the DSR, an action mask mechanism is implemented to filter out invalid actions, ensuring the security of the strategy. Finally, an IEEE 123-node test system is used for validation, and the experimental results showed that the proposed algorithm can effectively assist agents in accomplishing collaborative DSR tasks.

Suggested Citation

  • Si, Ruiqi & Chen, Siyuan & Zhang, Jun & Xu, Jian & Zhang, Luxi, 2024. "A multi-agent reinforcement learning method for distribution system restoration considering dynamic network reconfiguration," Applied Energy, Elsevier, vol. 372(C).
    • Handle: RePEc:eee:appene:v:372:y:2024:i:c:s0306261924010080
    DOI: 10.1016/j.apenergy.2024.123625
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924010080
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.123625?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bialek, Janusz, 2020. "What does the GB power outage on 9 August 2019 tell us about the current state of decarbonised power systems?," Energy Policy, Elsevier, vol. 146(C).
    2. Ding, Tao & Lin, Yanling & Bie, Zhaohong & Chen, Chen, 2017. "A resilient microgrid formation strategy for load restoration considering master-slave distributed generators and topology reconfiguration," Applied Energy, Elsevier, vol. 199(C), pages 205-216.
    3. Bai, Yuyang & Chen, Siyuan & Zhang, Jun & Xu, Jian & Gao, Tianlu & Wang, Xiaohui & Wenzhong Gao, David, 2023. "An adaptive active power rolling dispatch strategy for high proportion of renewable energy based on distributed deep reinforcement learning," Applied Energy, Elsevier, vol. 330(PA).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Younes Zahraoui & Tarmo Korõtko & Argo Rosin & Saad Mekhilef & Mehdi Seyedmahmoudian & Alex Stojcevski & Ibrahim Alhamrouni, 2024. "AI Applications to Enhance Resilience in Power Systems and Microgrids—A Review," Sustainability, MDPI, vol. 16(12), pages 1-35, June.
    2. Harri Aaltonen & Seppo Sierla & Rakshith Subramanya & Valeriy Vyatkin, 2021. "A Simulation Environment for Training a Reinforcement Learning Agent Trading a Battery Storage," Energies, MDPI, vol. 14(17), pages 1-20, September.
    3. Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
    4. Ziqian Zhang & Carina Lehmal & Philipp Hackl & Robert Schuerhuber, 2022. "Transient Stability Analysis and Post-Fault Restart Strategy for Current-Limited Grid-Forming Converter," Energies, MDPI, vol. 15(10), pages 1-26, May.
    5. Alex Guamán & Alex Valenzuela, 2021. "Distribution Network Reconfiguration Applied to Multiple Faulty Branches Based on Spanning Tree and Genetic Algorithms," Energies, MDPI, vol. 14(20), pages 1-16, October.
    6. Yang, Chao & Yao, Wei & Fang, Jiakun & Ai, Xiaomeng & Chen, Zhe & Wen, Jinyu & He, Haibo, 2019. "Dynamic event-triggered robust secondary frequency control for islanded AC microgrid," Applied Energy, Elsevier, vol. 242(C), pages 821-836.
    7. El-Sharafy, M. Zaki & Farag, Hany E.Z., 2017. "Back-feed power restoration using distributed constraint optimization in smart distribution grids clustered into microgrids," Applied Energy, Elsevier, vol. 206(C), pages 1102-1117.
    8. Shi, Qingxin & Li, Fangxing & Dong, Jin & Olama, Mohammed & Wang, Xiaofei & Winstead, Chris & Kuruganti, Teja, 2022. "Co-optimization of repairs and dynamic network reconfiguration for improved distribution system resilience," Applied Energy, Elsevier, vol. 318(C).
    9. Younesi, Abdollah & Shayeghi, Hossein & Wang, Zongjie & Siano, Pierluigi & Mehrizi-Sani, Ali & Safari, Amin, 2022. "Trends in modern power systems resilience: State-of-the-art review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    10. Kurz, Konstantin & Bock, Carolin & Knodt, Michèle & Stöckl, Anna, 2022. "A Friend in Need Is a Friend Indeed? Analysis of the Willingness to Share Self-Produced Electricity During a Long-lasting Power Outage," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 136773, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    11. Li, Kun & Wei, Lishen & Fang, Jiakun & Ai, Xiaomeng & Cui, Shichang & Zhu, Mengshu & Wen, Jinyu, 2024. "Incentive-compatible primary frequency response ancillary service market mechanism for incorporating diverse frequency support resources," Energy, Elsevier, vol. 306(C).
    12. Yixiao Fang & Junjie Yang & Wei Jiang, 2023. "Optimal Scheduling Strategy of Microgrid Based on Reactive Power Compensation of Electric Vehicles," Energies, MDPI, vol. 16(22), pages 1-23, November.
    13. Mehrjerdi, Hasan & Hemmati, Reza, 2020. "Coordination of vehicle-to-home and renewable capacity resources for energy management in resilience and self-healing building," Renewable Energy, Elsevier, vol. 146(C), pages 568-579.
    14. Hirase, Yuko & Abe, Kensho & Sugimoto, Kazushige & Sakimoto, Kenichi & Bevrani, Hassan & Ise, Toshifumi, 2018. "A novel control approach for virtual synchronous generators to suppress frequency and voltage fluctuations in microgrids," Applied Energy, Elsevier, vol. 210(C), pages 699-710.
    15. Habibollah Raoufi & Vahid Vahidinasab & Kamyar Mehran, 2020. "Power Systems Resilience Metrics: A Comprehensive Review of Challenges and Outlook," Sustainability, MDPI, vol. 12(22), pages 1-24, November.
    16. Ning Xin & Laijun Chen & Linrui Ma & Yang Si, 2022. "A Rolling Horizon Optimization Framework for Resilient Restoration of Active Distribution Systems," Energies, MDPI, vol. 15(9), pages 1-14, April.
    17. Mansouri, S.A. & Ahmarinejad, A. & Nematbakhsh, E. & Javadi, M.S. & Esmaeel Nezhad, A. & Catalão, J.P.S., 2022. "A sustainable framework for multi-microgrids energy management in automated distribution network by considering smart homes and high penetration of renewable energy resources," Energy, Elsevier, vol. 245(C).
    18. Mousavizadeh, Saeed & Haghifam, Mahmoud-Reza & Shariatkhah, Mohammad-Hossein, 2018. "A linear two-stage method for resiliency analysis in distribution systems considering renewable energy and demand response resources," Applied Energy, Elsevier, vol. 211(C), pages 443-460.
    19. Lee, J. & Razeghi, G. & Samuelsen, S., 2022. "Generic microgrid controller with self-healing capabilities," Applied Energy, Elsevier, vol. 308(C).
    20. Ghasemi, Sasan & Moshtagh, Jamal, 2022. "Distribution system restoration after extreme events considering distributed generators and static energy storage systems with mobile energy storage systems dispatch in transportation systems," Applied Energy, Elsevier, vol. 310(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:372:y:2024:i:c:s0306261924010080. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.