IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v178y2021icp363-376.html
   My bibliography  Save this article

A novel deep reinforcement learning enabled sparsity promoting adaptive control method to improve the stability of power systems with wind energy penetration

Author

Listed:
  • Zhang, Guozhou
  • Hu, Weihao
  • Cao, Di
  • Huang, Qi
  • Chen, Zhe
  • Blaabjerg, Frede

Abstract

With increasing proportion of wind energy in power systems, the intermittence of such energy makes the system run a wide range of operating conditions. In this context, ordinary power system stabilizers (PSS) tuned based on the linearized model of the system at one operating condition may not be able to effectively damp low frequency oscillations (LFO), which brings great challenges to the stability of the system. To this end, this paper proposes a novel sparsity promoting adaptive control method for the online self-tuning of the PSS parameter settings. Different from the existing adaptive control methods, the proposed method combines deep deterministic policy gradient (DDPG) algorithm and sensitivity analysis theory to train an agent to learn the sparse coordinated control policy of multi-PSS. After training, the well-trained agent can be employed for online sparse coordinated adaptive control, and the control signal is only applied, when it is required and only to the key PSS parameters that have the maximum influence on the system stability. Simulation results verify that the proposed method can make the PSS achieve the better performance of damping oscillation and robustness against the change of wind energy in comparison with other methods.

Suggested Citation

  • Zhang, Guozhou & Hu, Weihao & Cao, Di & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2021. "A novel deep reinforcement learning enabled sparsity promoting adaptive control method to improve the stability of power systems with wind energy penetration," Renewable Energy, Elsevier, vol. 178(C), pages 363-376.
    • Handle: RePEc:eee:renene:v:178:y:2021:i:c:p:363-376
    DOI: 10.1016/j.renene.2021.06.081
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148121009484
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2021.06.081?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chen, Jian & Yao, Wei & Zhang, Chuan-Ke & Ren, Yaxing & Jiang, Lin, 2019. "Design of robust MPPT controller for grid-connected PMSG-Based wind turbine via perturbation observation based nonlinear adaptive control," Renewable Energy, Elsevier, vol. 134(C), pages 478-495.
    2. Tsoutsanis, Elias & Meskin, Nader & Benammar, Mohieddine & Khorasani, Khashayar, 2016. "A dynamic prognosis scheme for flexible operation of gas turbines," Applied Energy, Elsevier, vol. 164(C), pages 686-701.
    3. Yan, Cai & Yao, Wei & Wen, Jianfeng & Fang, Jiakun & Ai, Xiaomeng & Wen, Jinyu, 2020. "Optimal design of probabilistic robust damping controllers to suppress multiband oscillations of power systems integrated with wind farm," Renewable Energy, Elsevier, vol. 158(C), pages 75-90.
    4. Cuk Supriyadi, A.N. & Takano, H. & Murata, J. & Goda, T., 2014. "Adaptive robust PSS to enhance stabilization of interconnected power systems with high renewable energy penetration," Renewable Energy, Elsevier, vol. 63(C), pages 767-774.
    5. Derafshian, Mehdi & Amjady, Nima, 2015. "Optimal design of power system stabilizer for power systems including doubly fed induction generator wind turbines," Energy, Elsevier, vol. 84(C), pages 1-14.
    6. Li, Shenghu, 2017. "Low-frequency oscillations of wind power systems caused by doubly-fed induction generators," Renewable Energy, Elsevier, vol. 104(C), pages 129-138.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Qingyan Li & Tao Lin & Qianyi Yu & Hui Du & Jun Li & Xiyue Fu, 2023. "Review of Deep Reinforcement Learning and Its Application in Modern Renewable Power System Control," Energies, MDPI, vol. 16(10), pages 1-23, May.
    2. M. A. Hannan & Ali Q. Al-Shetwi & M. S. Mollik & Pin Jern Ker & M. Mannan & M. Mansor & Hussein M. K. Al-Masri & T. M. Indra Mahlia, 2023. "Wind Energy Conversions, Controls, and Applications: A Review for Sustainable Technologies and Directions," Sustainability, MDPI, vol. 15(5), pages 1-30, February.
    3. Ashok Bhansali & Namala Narasimhulu & Rocío Pérez de Prado & Parameshachari Bidare Divakarachari & Dayanand Lal Narayan, 2023. "A Review on Sustainable Energy Sources Using Machine Learning and Deep Learning Models," Energies, MDPI, vol. 16(17), pages 1-18, August.
    4. Zhang, Bin & Hu, Weihao & Xu, Xiao & Li, Tao & Zhang, Zhenyuan & Chen, Zhe, 2022. "Physical-model-free intelligent energy management for a grid-connected hybrid wind-microturbine-PV-EV energy system via deep reinforcement learning approach," Renewable Energy, Elsevier, vol. 200(C), pages 433-448.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mojtaba Nasiri & Saleh Mobayen & Quan Min Zhu, 2019. "Super-Twisting Sliding Mode Control for Gearless PMSG-Based Wind Turbine," Complexity, Hindawi, vol. 2019, pages 1-15, April.
    2. Yang, Chao & Yao, Wei & Fang, Jiakun & Ai, Xiaomeng & Chen, Zhe & Wen, Jinyu & He, Haibo, 2019. "Dynamic event-triggered robust secondary frequency control for islanded AC microgrid," Applied Energy, Elsevier, vol. 242(C), pages 821-836.
    3. Chen, Yu-Zhi & Tsoutsanis, Elias & Xiang, Heng-Chao & Li, Yi-Guang & Zhao, Jun-Jie, 2022. "A dynamic performance diagnostic method applied to hydrogen powered aero engines operating under transient conditions," Applied Energy, Elsevier, vol. 317(C).
    4. Anto Anbarasu Yesudhas & Young Hoon Joo & Seong Ryong Lee, 2022. "Reference Model Adaptive Control Scheme on PMVG-Based WECS for MPPT under a Real Wind Speed," Energies, MDPI, vol. 15(9), pages 1-17, April.
    5. Wang, Qin & Yao, Wei & Fang, Jiakun & Ai, Xiaomeng & Wen, Jinyu & Yang, Xiaobo & Xie, Hailian & Huang, Xing, 2020. "Dynamic modeling and small signal stability analysis of distributed photovoltaic grid-connected system with large scale of panel level DC optimizers," Applied Energy, Elsevier, vol. 259(C).
    6. Yang, Bo & Wu, Shaocong & Li, Qiang & Yan, Yingjie & Li, Danyang & Luo, Enbo & Zeng, Chunyuan & Chen, Yijun & Guo, Zhengxun & Shu, Hongchun & Li, Zilin & Wang, Jingbo, 2023. "Jellyfish search algorithm based optimal thermoelectric generation array reconfiguration under non-uniform temperature distribution condition," Renewable Energy, Elsevier, vol. 204(C), pages 197-217.
    7. Huazhen Cao & Chong Gao & Xuan He & Yang Li & Tao Yu, 2020. "Multi-Agent Cooperation Based Reduced-Dimension Q(λ) Learning for Optimal Carbon-Energy Combined-Flow," Energies, MDPI, vol. 13(18), pages 1-22, September.
    8. Kang, Do Won & Kim, Tong Seop, 2018. "Model-based performance diagnostics of heavy-duty gas turbines using compressor map adaptation," Applied Energy, Elsevier, vol. 212(C), pages 1345-1359.
    9. Xuesong Zhou & Yongliang Zhou & Youjie Ma & Luyong Yang & Xia Yang & Bo Zhang, 2020. "DC Bus Voltage Control of Grid-Side Converter in Permanent Magnet Synchronous Generator Based on Improved Second-Order Linear Active Disturbance Rejection Control," Energies, MDPI, vol. 13(18), pages 1-19, September.
    10. Youssef, Abdel-Raheem & Mousa, Hossam H.H. & Mohamed, Essam E.M., 2020. "Development of self-adaptive P&O MPPT algorithm for wind generation systems with concentrated search area," Renewable Energy, Elsevier, vol. 154(C), pages 875-893.
    11. Lin Wang & Anke Xue, 2021. "Equivalent Modeling of Microgrids Based on Optimized Broad Learning System," Energies, MDPI, vol. 14(23), pages 1-11, November.
    12. Yang, Bo & Wang, Jingbo & Sang, Yiyan & Yu, Lei & Shu, Hongchun & Li, Shengnan & He, Tingyi & Yang, Lei & Zhang, Xiaoshun & Yu, Tao, 2019. "Applications of supercapacitor energy storage systems in microgrid with distributed generators via passive fractional-order sliding-mode control," Energy, Elsevier, vol. 187(C).
    13. Mo, Huadong & Sansavini, Giovanni, 2019. "Impact of aging and performance degradation on the operational costs of distributed generation systems," Renewable Energy, Elsevier, vol. 143(C), pages 426-439.
    14. Zagorowska, Marta & Schulze Spüntrup, Frederik & Ditlefsen, Arne-Marius & Imsland, Lars & Lunde, Erling & Thornhill, Nina F., 2020. "Adaptive detection and prediction of performance degradation in off-shore turbomachinery," Applied Energy, Elsevier, vol. 268(C).
    15. Yang, Bo & Zeng, Chunyuan & Li, Danyang & Guo, Zhengxun & Chen, Yijun & Shu, Hongchun & Cao, Pulin & Li, Zilin, 2022. "Improved immune genetic algorithm based TEG system reconfiguration under non-uniform temperature distribution," Applied Energy, Elsevier, vol. 325(C).
    16. González-Hernández, José Genaro & Salas-Cabrera, Rubén & Vázquez-Bautista, Roberto & Ong-de-la-Cruz, Luis Manuel & Rodríguez-Guillén, Joel, 2021. "A novel MPPT PI discrete reverse-acting controller for a wind energy conversion system," Renewable Energy, Elsevier, vol. 178(C), pages 904-915.
    17. Rui Zhang & Hao Zhang & Jianqiao Ye & Jiaqing Wang & Qing Liu & Shenghu Li, 2023. "Eigen-Sensitivity-Based Sliding Mode Control for LFO Damping in DFIG-Integrated Power Systems," Energies, MDPI, vol. 16(10), pages 1-18, May.
    18. Powell, Kody M. & Rashid, Khalid & Ellingwood, Kevin & Tuttle, Jake & Iverson, Brian D., 2017. "Hybrid concentrated solar thermal power systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 80(C), pages 215-237.
    19. Jesus L. Lobo & Igor Ballesteros & Izaskun Oregi & Javier Del Ser & Sancho Salcedo-Sanz, 2020. "Stream Learning in Energy IoT Systems: A Case Study in Combined Cycle Power Plants," Energies, MDPI, vol. 13(3), pages 1-28, February.
    20. Humberto Verdejo & Rodrigo Torres & Victor Pino & Wolfgang Kliemann & Cristhian Becker & José Delpiano, 2019. "Tuning of Controllers in Power Systems Using a Heuristic-Stochastic Approach," Energies, MDPI, vol. 12(12), pages 1-25, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:178:y:2021:i:c:p:363-376. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.