IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v14y2021i16p4804-d610068.html
   My bibliography  Save this article

Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic

Author

Listed:
  • Yuemin Zheng

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Jin Tao

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China
    Department of Electrical Engineering and Automation, Aalto University, 02150 Espoo, Finland)

  • Hao Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Qinglin Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Zengqiang Chen

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China
    Key Laboratory of Intelligent Robotics of Tianjin, Nankai University, Tianjin 300350, China)

  • Matthias Dehmer

    (Department of Computer Science, Swiss Distance University of Applied Sciences, 3900 Brig, Switzerland)

  • Quan Zhou

    (Department of Electrical Engineering and Automation, Aalto University, 02150 Espoo, Finland)

Abstract

To ensure the safe operation of an interconnected power system, it is necessary to maintain the stability of the frequency and the tie-line exchanged power. This is one of the hottest issues in the power system field and is usually called load frequency control. To overcome the influences of load disturbances on multi-source power systems containing thermal power plants, hydropower plants, and gas turbine plants, we design a linear active disturbance rejection control (LADRC) based on the tie-line bias control mode. For LADRC, the parameter selection of the controller directly affects the response performance of the entire system, and it is usually not feasible to manually adjust parameters. Therefore, to obtain the optimal controller parameters, we use the Soft Actor-Critic algorithm in reinforcement learning to obtain the controller parameters in real time, and we design the reward function according to the needs of the power system. We carry out simulation experiments to verify the effectiveness of the proposed method. Compared with the results of other proportional–integral–derivative control techniques using optimization algorithms and LADRC with constant parameters, the proposed method shows significant advantages in terms of overshoot, undershoot, and settling time. In addition, by adding different disturbances to different areas of the multi-source power system, we demonstrate the robustness of the proposed control strategy.

Suggested Citation

  • Yuemin Zheng & Jin Tao & Hao Sun & Qinglin Sun & Zengqiang Chen & Matthias Dehmer & Quan Zhou, 2021. "Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic," Energies, MDPI, vol. 14(16), pages 1-17, August.
  • Handle: RePEc:gam:jeners:v:14:y:2021:i:16:p:4804-:d:610068
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/14/16/4804/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/14/16/4804/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Assareh, E. & Behrang, M.A. & Assari, M.R. & Ghanbarzadeh, A., 2010. "Application of PSO (particle swarm optimization) and GA (genetic algorithm) techniques on demand estimation of oil in Iran," Energy, Elsevier, vol. 35(12), pages 5223-5229.
    2. Guo-Qiang Zeng & Xiao-Qing Xie & Min-Rong Chen, 2017. "An Adaptive Model Predictive Load Frequency Control Method for Multi-Area Interconnected Power Systems with Photovoltaic Generations," Energies, MDPI, vol. 10(11), pages 1-23, November.
    3. Ana Fernández-Guillamón & Guillermo Martínez-Lucas & Ángel Molina-García & Jose Ignacio Sarasua, 2020. "An Adaptive Control Scheme for Variable Speed Wind Turbines Providing Frequency Regulation in Isolated Power Systems with Thermal Generation," Energies, MDPI, vol. 13(13), pages 1-19, July.
    4. Kyoungboo Yang & Kyungho Cho, 2019. "Simulated Annealing Algorithm for Wind Farm Layout Optimization: A Benchmark Study," Energies, MDPI, vol. 12(23), pages 1-15, November.
    5. Liu, Jizhen & Yao, Qi & Hu, Yang, 2019. "Model predictive control for load frequency of hybrid power system with wind power and thermal power," Energy, Elsevier, vol. 172(C), pages 555-565.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Atul Anand & L Suganthi, 2018. "Hybrid GA-PSO Optimization of Artificial Neural Network for Forecasting Electricity Demand," Energies, MDPI, vol. 11(4), pages 1-15, March.
    2. Sina Paryani & Aminreza Neshat & Saman Javadi & Biswajeet Pradhan, 2020. "Comparative performance of new hybrid ANFIS models in landslide susceptibility mapping," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 103(2), pages 1961-1988, September.
    3. Zhu, Yongbin & Shi, Yajuan & Wang, Zheng, 2014. "How much CO2 emissions will be reduced through industrial structure change if China focuses on domestic rather than international welfare?," Energy, Elsevier, vol. 72(C), pages 168-179.
    4. Youssef Ait Ali & Mohammed Ouassaid & Zineb Cabrane & Soo-Hyoung Lee, 2023. "Enhanced Primary Frequency Control Using Model Predictive Control in Large-Islanded Power Grids with High Penetration of DFIG-Based Wind Farm," Energies, MDPI, vol. 16(11), pages 1-24, May.
    5. Tania García-Sánchez & Arbinda Kumar Mishra & Elías Hurtado-Pérez & Rubén Puché-Panadero & Ana Fernández-Guillamón, 2020. "A Controller for Optimum Electrical Power Extraction from a Small Grid-Interconnected Wind Turbine," Energies, MDPI, vol. 13(21), pages 1-16, November.
    6. Penghui Qiang & Peng Wu & Tao Pan & Huaiquan Zang, 2021. "Real-Time Approximate Equivalent Consumption Minimization Strategy Based on the Single-Shaft Parallel Hybrid Powertrain," Energies, MDPI, vol. 14(23), pages 1-22, November.
    7. Ke, Ming-Tsun & Yeh, Chia-Hung & Su, Cheng-Jie, 2017. "Cloud computing platform for real-time measurement and verification of energy performance," Applied Energy, Elsevier, vol. 188(C), pages 497-507.
    8. Kaleem Ullah & Abdul Basit & Zahid Ullah & Sheraz Aslam & Herodotos Herodotou, 2021. "Automatic Generation Control Strategies in Conventional and Modern Power Systems: A Comprehensive Overview," Energies, MDPI, vol. 14(9), pages 1-43, April.
    9. Askarzadeh, Alireza, 2014. "Comparison of particle swarm optimization and other metaheuristics on electricity demand estimation: A case study of Iran," Energy, Elsevier, vol. 72(C), pages 484-491.
    10. Babak Mohammadi & Farshad Ahmadi & Saeid Mehdizadeh & Yiqing Guan & Quoc Bao Pham & Nguyen Thi Thuy Linh & Doan Quang Tri, 2020. "Developing Novel Robust Models to Improve the Accuracy of Daily Streamflow Modeling," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 34(10), pages 3387-3409, August.
    11. Uzlu, Ergun & Akpınar, Adem & Özturk, Hasan Tahsin & Nacar, Sinan & Kankal, Murat, 2014. "Estimates of hydroelectric generation using neural networks with the artificial bee colony algorithm for Turkey," Energy, Elsevier, vol. 69(C), pages 638-647.
    12. Md. Shafiul Alam & Tanzi Ahmed Chowdhury & Abhishak Dhar & Fahad Saleh Al-Ismail & M. S. H. Choudhury & Md Shafiullah & Md. Ismail Hossain & Md. Alamgir Hossain & Aasim Ullah & Syed Masiur Rahman, 2023. "Solar and Wind Energy Integrated System Frequency Control: A Critical Review on Recent Developments," Energies, MDPI, vol. 16(2), pages 1-31, January.
    13. Chaudhary, Aniket Karan & Roy, Satyabrata & Guha, Dipayan & Negi, Richa & Banerjee, Subrata, 2024. "Adaptive cyber-tolerant finite-time frequency control framework for renewable-integrated power system under deception and periodic denial-of-service attacks," Energy, Elsevier, vol. 302(C).
    14. Reza Mikaeil & Sina Shaffiee Haghshenas & Zoheir Sedaghati, 2019. "Geotechnical risk evaluation of tunneling projects using optimization techniques (case study: the second part of Emamzade Hashem tunnel)," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 97(3), pages 1099-1113, July.
    15. Ma, Weimin & Zhu, Xiaoxi & Wang, Miaomiao, 2013. "Forecasting iron ore import and consumption of China using grey model optimized by particle swarm optimization algorithm," Resources Policy, Elsevier, vol. 38(4), pages 613-620.
    16. Muhammad Nabeel Hussain & Nadeem Shaukat & Ammar Ahmad & Muhammad Abid & Abrar Hashmi & Zohreh Rajabi & Muhammad Atiq Ur Rehman Tariq, 2022. "Micro-Siting of Wind Turbines in an Optimal Wind Farm Area Using Teaching–Learning-Based Optimization Technique," Sustainability, MDPI, vol. 14(14), pages 1-24, July.
    17. Younes, Mimoun & Khodja, Fouad & Kherfane, Riad Lakhdar, 2014. "Multi-objective economic emission dispatch solution using hybrid FFA (firefly algorithm) and considering wind power penetration," Energy, Elsevier, vol. 67(C), pages 595-606.
    18. Danny Ochoa & Sergio Martinez, 2021. "Analytical Approach to Understanding the Effects of Implementing Fast-Frequency Response by Wind Turbines on the Short-Term Operation of Power Systems," Energies, MDPI, vol. 14(12), pages 1-22, June.
    19. Ana Fernández-Guillamón & Antonio Vigueras-Rodríguez & Emilio Gómez-Lázaro & Ángel Molina-García, 2018. "Fast Power Reserve Emulation Strategy for VSWT Supporting Frequency Control in Multi-Area Power Systems," Energies, MDPI, vol. 11(10), pages 1-20, October.
    20. Rafael Sebastián, 2022. "Modeling, Simulation and Control of Wind Diesel Power Systems," Energies, MDPI, vol. 15(5), pages 1-2, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:14:y:2021:i:16:p:4804-:d:610068. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.