IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i19p14452-d1253033.html
   My bibliography  Save this article

Adaptive Active Disturbance Rejection Load Frequency Control for Power System with Renewable Energies Using the Lyapunov Reward-Based Twin Delayed Deep Deterministic Policy Gradient Algorithm

Author

Listed:
  • Yuemin Zheng

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Jin Tao

    (Silo AI, 00100 Helsinki, Finland)

  • Qinglin Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Hao Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Zengqiang Chen

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Mingwei Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

Abstract

The substitution of renewable energy sources (RESs) for conventional fossil fuels in electricity generation is essential in addressing environmental pollution and resource depletion. However, the integration of RESs in the load frequency control (LFC) of power systems can have a negative impact on frequency deviation response, resulting in a decline in power quality. Moreover, load disturbances can also affect the stability of frequency deviation. Hence, this paper presents an LFC method that utilizes the Lyapunov reward-based twin delayed deep deterministic policy gradient (LTD3) algorithm to optimize the linear active disturbance rejection control (LADRC). With the advantages of being model-free and mitigating unknown disturbances, LADRC can regulate load disturbances and renewable energy deviations. Additionally, the LTD3 algorithm, based on the Lyapunov reward function, is employed to optimize controller parameters in real-time, resulting in enhanced control performance. Finally, the LADRC-LTD3 is evaluated using a power system containing two areas, comprising thermal, hydro, and gas power plants in each area, as well as RESs such as a noise-based wind turbine and photovoltaic (PV) system. A comparative analysis is conducted between the performance of the proposed controller and other control techniques, such as integral controller (IC), fractional-order proportional integral derivative (FOPID) controller, I-TD, ID-T, and TD3-optimized LADRC. The results indicate that the proposed method effectively addresses the LFC problem.

Suggested Citation

  • Yuemin Zheng & Jin Tao & Qinglin Sun & Hao Sun & Zengqiang Chen & Mingwei Sun, 2023. "Adaptive Active Disturbance Rejection Load Frequency Control for Power System with Renewable Energies Using the Lyapunov Reward-Based Twin Delayed Deep Deterministic Policy Gradient Algorithm," Sustainability, MDPI, vol. 15(19), pages 1-25, October.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:19:p:14452-:d:1253033
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/19/14452/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/19/14452/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zhou, Ping & Hu, Xikui & Zhu, Zhigang & Ma, Jun, 2021. "What is the most suitable Lyapunov function?," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    2. Yuemin Zheng & Jin Tao & Qinglin Sun & Hao Sun & Zengqiang Chen & Mingwei Sun & Feng Duan, 2022. "Deep-Reinforcement-Learning-Based Active Disturbance Rejection Control for Lateral Path Following of Parafoil System," Sustainability, MDPI, vol. 15(1), pages 1-18, December.
    3. Ruisheng Wang & Zhong Chen & Qiang Xing & Ziqi Zhang & Tian Zhang, 2022. "A Modified Rainbow-Based Deep Reinforcement Learning Method for Optimal Scheduling of Charging Station," Sustainability, MDPI, vol. 14(3), pages 1-14, February.
    4. Huang, Ruchen & He, Hongwen & Zhao, Xuyang & Wang, Yunlong & Li, Menglin, 2022. "Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm," Applied Energy, Elsevier, vol. 321(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xie, Ying & Zhou, Ping & Yao, Zhao & Ma, Jun, 2022. "Response mechanism in a functional neuron under multiple stimuli," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 607(C).
    2. Tavakolpour-Saleh, A.R., 2021. "A novel theorem on motion stability," Chaos, Solitons & Fractals, Elsevier, vol. 153(P2).
    3. Njitacke, Zeric Tabekoueng & Ramadoss, Janarthanan & Takembo, Clovis Ntahkie & Rajagopal, Karthikeyan & Awrejcewicz, Jan, 2023. "An enhanced FitzHugh–Nagumo neuron circuit, microcontroller-based hardware implementation: Light illumination and magnetic field effects on information patterns," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).
    4. Ma, Xiaowen & Xu, Ying, 2022. "Taming the hybrid synapse under energy balance between neurons," Chaos, Solitons & Fractals, Elsevier, vol. 159(C).
    5. Jia, Chunchun & Li, Kunang & He, Hongwen & Zhou, Jiaming & Li, Jianwei & Wei, Zhongbao, 2023. "Health-aware energy management strategy for fuel cell hybrid bus considering air-conditioning control based on TD3 algorithm," Energy, Elsevier, vol. 283(C).
    6. Zhou, Ping & Ma, Jun & Xu, Ying, 2023. "Phase synchronization between neurons under nonlinear coupling via hybrid synapse," Chaos, Solitons & Fractals, Elsevier, vol. 169(C).
    7. Lei, Yong & Xu, Xin-Jian & Wang, Xiaofan & Zou, Yong & Kurths, Jürgen, 2023. "A new criterion for optimizing synchrony of coupled oscillators," Chaos, Solitons & Fractals, Elsevier, vol. 168(C).
    8. Fescioglu-Unver, Nilgun & Yıldız Aktaş, Melike, 2023. "Electric vehicle charging service operations: A review of machine learning applications for infrastructure planning, control, pricing and routing," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    9. Basma, Hussein & Mansour, Charbel & Haddad, Marc & Nemer, Maroun & Stabat, Pascal, 2023. "A novel method for co-optimizing battery sizing and charging strategy of battery electric bus fleets: An application to the city of Paris," Energy, Elsevier, vol. 285(C).
    10. Njitacke, Zeric Tabekoueng & Ramakrishnan, Balamurali & Rajagopal, Karthikeyan & Fonzin Fozin, Théophile & Awrejcewicz, Jan, 2022. "Extremely rich dynamics of coupled heterogeneous neurons through a Josephson junction synapse," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
    11. Hamza Assia & Houari Merabet Boulouiha & William David Chicaiza & Juan Manuel Escaño & Abderrahmane Kacimi & José Luis Martínez-Ramos & Mouloud Denai, 2023. "Wind Turbine Active Fault Tolerant Control Based on Backstepping Active Disturbance Rejection Control and a Neurofuzzy Detector," Energies, MDPI, vol. 16(14), pages 1-22, July.
    12. Hou, Guolian & Huang, Ting & Zheng, Fumeng & Huang, Congzhi, 2024. "A hierarchical reinforcement learning GPC for flexible operation of ultra-supercritical unit considering economy," Energy, Elsevier, vol. 289(C).
    13. Ekaterina V. Orlova, 2023. "Dynamic Regimes for Corporate Human Capital Development Used Reinforcement Learning Methods," Mathematics, MDPI, vol. 11(18), pages 1-22, September.
    14. Feng, Zhiyan & Zhang, Qingang & Zhang, Yiming & Fei, Liangyu & Jiang, Fei & Zhao, Shengdun, 2024. "Practicability analysis of online deep reinforcement learning towards energy management strategy of 4WD-BEVs driven by dual-motor in-wheel motors," Energy, Elsevier, vol. 290(C).
    15. Huang, Xuejin & Zhang, Jingyi & Ou, Kai & Huang, Yin & Kang, Zehao & Mao, Xuping & Zhou, Yujie & Xuan, Dongji, 2024. "Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework," Energy, Elsevier, vol. 304(C).
    16. Hou, Yi-You & Lin, Ming-Hung & Saberi-Nik, Hassan & Arya, Yogendra, 2024. "Boundary analysis and energy feedback control of fractional-order extended Malkus–Robbins dynamo system," Chaos, Solitons & Fractals, Elsevier, vol. 183(C).
    17. Muhammad Moin & Waqas Ahmed & Muhammad Rehan & Muhammad Iqbal & Nasim Ullah & Kamran Zeb & Waqar Uddin, 2022. "A Novel Distributed Consensus-Based Approach to Solve the Economic Dispatch Problem Incorporating the Valve-Point Effect and Solar Energy Sources," Energies, MDPI, vol. 16(1), pages 1-23, December.
    18. Ma, Jun, 2024. "Energy function for some maps and nonlinear oscillators," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    19. Bolin He & Yong Chen & Qiang Wei & Cong Wang & Changyin Wei & Xiaoyu Li, 2023. "Performance Comparison of Pure Electric Vehicles with Two-Speed Transmission and Adaptive Gear Shifting Strategy Design," Energies, MDPI, vol. 16(7), pages 1-21, March.
    20. Ijaz Ahmed & Um-E-Habiba Alvi & Abdul Basit & Tayyaba Khursheed & Alwena Alvi & Keum-Shik Hong & Muhammad Rehan, 2022. "A novel hybrid soft computing optimization framework for dynamic economic dispatch problem of complex non-convex contiguous constrained machines," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-32, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:19:p:14452-:d:1253033. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.