IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2024i1p44-d1553958.html
   My bibliography  Save this article

Multi-Fault-Tolerant Operation of Grid-Interfaced Photovoltaic Inverters Using Twin Delayed Deep Deterministic Policy Gradient Agent

Author

Listed:
  • Shyamal S. Chand

    (School of Electrical Engineering and Telecommunications (EET), University of New South Wales (UNSW), Sydney, NSW 2052, Australia)

  • Branislav Hredzak

    (School of Electrical Engineering and Telecommunications (EET), University of New South Wales (UNSW), Sydney, NSW 2052, Australia)

  • Maurizio Cirrincione

    (Université Marie et Louis Pasteur, UTBM, CNRS, Institut FEMTO-ST, F-90010 Belfort, France
    School of Information Technology, Engineering, Mathematics, and Physics (STEMP), University of the South Pacific (USP), Laucala Campus, Suva, Fiji.)

Abstract

The elevated penetration of renewable energy has seen a significant increase in the integration of inverter-based resources (IBRs) into the electricity network. According to various industrial standards on interconnection and interoperability, IBRs should be able to withstand variability in grid conditions. Positive sequence voltage-oriented control (PSVOC) with a feed-forward decoupling approach is often adopted to ensure closed-loop control of inverters. However, the dynamic response of this control scheme deteriorates during fluctuations in the grid voltage due to the sensitivity of proportional–integral controllers, the presence of the direct- and quadrature-axis voltage terms in the cross-coupling, and predefined saturation limits. As such, a twin delayed deep deterministic policy gradient-based voltage-oriented control (TD3VOC) is formulated and trained to provide effective current control of inverter-based resources under various dynamic conditions of the grid through transfer learning. The actor–critic-based reinforcement learning agent is designed and trained using the model-free Markov decision process through interaction with a grid-connected photovoltaic inverter environment developed in MATLAB/Simulink ® 2023b. Using the standard PSVOC method results in inverter input voltage overshoots of up to 2.50 p.u., with post-fault current restoration times of as high as 0.55 s during asymmetrical faults. The designed TD3VOC technique confines the DC link voltage overshoot to 1.05 p.u. and achieves a low current recovery duration of 0.01 s after fault clearance. In the event of a severe symmetric fault, the conventional control method is unable to restore the inverter operation, leading to integral-time absolute errors of 0.60 and 0.32 for the currents of the d and q axes, respectively. The newly proposed agent-based control strategy restricts cumulative errors to 0.03 and 0.09 for the d and q axes, respectively, thus improving inverter regulation. The results indicate the superior performance of the proposed control scheme in maintaining the stability of the inverter DC link bus voltage, reducing post-fault system recovery time, and limiting negative sequence currents during severe asymmetrical and symmetrical grid faults compared with the conventional PSVOC approach.

Suggested Citation

  • Shyamal S. Chand & Branislav Hredzak & Maurizio Cirrincione, 2024. "Multi-Fault-Tolerant Operation of Grid-Interfaced Photovoltaic Inverters Using Twin Delayed Deep Deterministic Policy Gradient Agent," Energies, MDPI, vol. 18(1), pages 1-29, December.
    • Handle: RePEc:gam:jeners:v:18:y:2024:i:1:p:44-:d:1553958
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/1/44/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/18/1/44/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rajesh, K.S. & Dash, S.S. & Rajagopal, Ragam & Sridhar, R., 2017. "A review on control of ac microgrid," Renewable and Sustainable Energy Reviews, Elsevier, vol. 71(C), pages 814-819.
    2. Sijia Li & Arman Oshnoei & Frede Blaabjerg & Amjad Anvari-Moghaddam, 2023. "Hierarchical Control for Microgrids: A Survey on Classical and Machine Learning-Based Methods," Sustainability, MDPI, vol. 15(11), pages 1-22, June.
    3. Cao, Yang & Chandrasekar, A. & Radhika, T. & Vijayakumar, V., 2024. "Input-to-state stability of stochastic Markovian jump genetic regulatory networks," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 222(C), pages 174-187.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jihed Hmad & Azeddine Houari & Allal El Moubarek Bouzid & Abdelhakim Saim & Hafedh Trabelsi, 2023. "A Review on Mode Transition Strategies between Grid-Connected and Standalone Operation of Voltage Source Inverters-Based Microgrids," Energies, MDPI, vol. 16(13), pages 1-41, June.
    2. Xu, Zhirong & Yang, Ping & Zheng, Chengli & Zhang, Yujia & Peng, Jiajun & Zeng, Zhiji, 2018. "Analysis on the organization and Development of multi-microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P2), pages 2204-2216.
    3. He, Wangli & Li, Chengyuan & Cai, Chenhao & Qing, Xiangyun & Du, Wenli, 2024. "Suppressing active power fluctuations at PCC in grid-connection microgrids via multiple BESSs: A collaborative multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 373(C).
    4. Hirase, Yuko & Abe, Kensho & Sugimoto, Kazushige & Sakimoto, Kenichi & Bevrani, Hassan & Ise, Toshifumi, 2018. "A novel control approach for virtual synchronous generators to suppress frequency and voltage fluctuations in microgrids," Applied Energy, Elsevier, vol. 210(C), pages 699-710.
    5. Yousef Asadi & Mohsen Eskandari & Milad Mansouri & Andrey V. Savkin & Erum Pathan, 2022. "Frequency and Voltage Control Techniques through Inverter-Interfaced Distributed Energy Resources in Microgrids: A Review," Energies, MDPI, vol. 15(22), pages 1-29, November.
    6. Solat, Amirhossein & Gharehpetian, G.B. & Naderi, Mehdi Salay & Anvari-Moghaddam, Amjad, 2024. "On the control of microgrids against cyber-attacks: A review of methods and applications," Applied Energy, Elsevier, vol. 353(PA).
    7. Shi, Jiaqi & Ma, Liya & Li, Chenchen & Liu, Nian & Zhang, Jianhua, 2022. "A comprehensive review of standards for distributed energy resource grid-integration and microgrid," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    8. Pan, Pengcheng & Sun, Yuwei & Yuan, Chengqing & Yan, Xinping & Tang, Xujing, 2021. "Research progress on ship power systems integrated with new energy sources: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    9. Nur Najihah Abu Bakar & Josep M. Guerrero & Juan C. Vasquez & Najmeh Bazmohammadi & Yun Yu & Abdullah Abusorrah & Yusuf A. Al-Turki, 2021. "A Review of the Conceptualization and Operational Management of Seaport Microgrids on the Shore and Seaside," Energies, MDPI, vol. 14(23), pages 1-31, November.
    10. Smriti Sharma & John O’Donnell & Wencong Su & Richard Mueller & Line Roald & Khurram Rehman & Andrey Bernstein, 2024. "Engineering Microgrids Amid the Evolving Electrical Distribution System," Energies, MDPI, vol. 17(19), pages 1-34, September.
    11. Pabel Alberto Cárdenas & Maximiliano Martínez & Marcelo Gustavo Molina & Pedro Enrique Mercado, 2023. "Development of Control Techniques for AC Microgrids: A Critical Assessment," Sustainability, MDPI, vol. 15(21), pages 1-28, October.
    12. Sahoo, Buddhadeva & Samantaray, Subhransu Ranjan & Rout, Pravat Kumar, 2024. "Enhanced supervisory control scheme for hybrid microgrid operation with virtual power plants," Applied Energy, Elsevier, vol. 372(C).
    13. Mbungu, Nsilulu T. & Ismail, Ali A. & AlShabi, Mohammad & Bansal, Ramesh C. & Elnady, A. & Hamid, Abdul Kadir, 2023. "Control and estimation techniques applied to smart microgrids: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 179(C).
    14. Yang, Chao & Yao, Wei & Fang, Jiakun & Ai, Xiaomeng & Chen, Zhe & Wen, Jinyu & He, Haibo, 2019. "Dynamic event-triggered robust secondary frequency control for islanded AC microgrid," Applied Energy, Elsevier, vol. 242(C), pages 821-836.
    15. Yaozhen Han & Ronglin Ma & Jinghan Cui, 2018. "Adaptive Higher-Order Sliding Mode Control for Islanding and Grid-Connected Operation of a Microgrid," Energies, MDPI, vol. 11(6), pages 1-17, June.
    16. Sathesh Murugan & Mohana Jaishankar & Kamaraj Premkumar, 2022. "Hybrid DC–AC Microgrid Energy Management System Using an Artificial Gorilla Troops Optimizer Optimized Neural Network," Energies, MDPI, vol. 15(21), pages 1-19, November.
    17. Ashabani, Mahdi & Gooi, Hoay Beng & Guerrero, Josep M., 2018. "Designing high-order power-source synchronous current converters for islanded and grid-connected microgrids," Applied Energy, Elsevier, vol. 219(C), pages 370-384.
    18. Hirase, Y. & Noro, O. & Nakagawa, H. & Yoshimura, E. & Katsura, S. & Abe, K. & Sugimoto, K. & Sakimoto, K., 2018. "Decentralised and interlink-less power interchange among residences in microgrids using virtual synchronous generator control," Applied Energy, Elsevier, vol. 228(C), pages 2437-2447.
    19. Jaber Alshehri & Muhammad Khalid & Ahmed Alzahrani, 2019. "An Intelligent Battery Energy Storage-Based Controller for Power Quality Improvement in Microgrids," Energies, MDPI, vol. 12(11), pages 1-21, June.
    20. Kanakadhurga, Dharmaraj & Prabaharan, Natarajan, 2022. "Demand side management in microgrid: A critical review of key issues and recent trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 156(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2024:i:1:p:44-:d:1553958. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.