IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v307y2022ics0306261921015282.html
   My bibliography  Save this article

Mode-decomposition memory reinforcement network strategy for smart generation control in multi-area power systems containing renewable energy

Author

Listed:
  • Yin, Linfei
  • Wu, Yunzhi

Abstract

The large-scale application of renewable energy can promote the global goal of carbon neutrality. However, the stochastic nature of wind and solar energy aggravates the active power imbalance and increases the frequency deviation. These obstacles hinder the load frequency control with the traditional proportional-integral-derivative as the primary approach for automatic generation control. Inspired by the “Divide and Conquer” strategy, a mode-decomposition memory reinforcement network strategy is proposed to reduce the impact of random fluctuations and uncertainties on power systems. The proposed strategy combines the traditional methods and intelligent algorithms for smart generation control. The proposed strategy includes empirical mode decomposition, proportional-integral-derivative, long short-term memory networks, and reinforcement learning algorithms. Firstly, the historical data that has been decomposed by the empirical mode decomposition is utilized to train long short-term memory networks. Then, the trained long short-term memory networks decompose and reorganize the frequency deviation into the high-frequency and low-frequency signals in real-time. Finally, reinforcement learning and proportional-integral-derivative respectively optimize the generation commands by the high-frequency and low-frequency signals to mitigate frequency deviation. Two cases results prove that the mode-decomposition memory reinforcement network has a higher control effect and lower generation cost than the other four strategies. Significantly, the frequency deviation and generation cost are respectively reduced by at least 9.77% and 4.39% in the four-area power system.

Suggested Citation

  • Yin, Linfei & Wu, Yunzhi, 2022. "Mode-decomposition memory reinforcement network strategy for smart generation control in multi-area power systems containing renewable energy," Applied Energy, Elsevier, vol. 307(C).
    • Handle: RePEc:eee:appene:v:307:y:2022:i:c:s0306261921015282
    DOI: 10.1016/j.apenergy.2021.118266
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921015282
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2021.118266?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tsianikas, Stamatis & Yousefi, Nooshin & Zhou, Jian & Rodgers, Mark D. & Coit, David, 2021. "A storage expansion planning framework using reinforcement learning and simulation-based optimization," Applied Energy, Elsevier, vol. 290(C).
    2. Chang, Zihan & Zhang, Yang & Chen, Wenbo, 2019. "Electricity price prediction based on hybrid model of adam optimized LSTM neural network and wavelet transform," Energy, Elsevier, vol. 187(C).
    3. Bu, Chujie & Cui, Xueqin & Li, Ruiyao & Li, Jin & Zhang, Yaxin & Wang, Can & Cai, Wenjia, 2021. "Achieving net-zero emissions in China’s passenger transport sector through regionally tailored mitigation strategies," Applied Energy, Elsevier, vol. 284(C).
    4. Zhang, Xiongfeng & Lu, Renzhi & Jiang, Junhui & Hong, Seung Ho & Song, Won Seok, 2021. "Testbed implementation of reinforcement learning-based demand response energy management system," Applied Energy, Elsevier, vol. 297(C).
    5. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    6. Tian, Zhongda & Chen, Hao, 2021. "Multi-step short-term wind speed prediction based on integrated multi-model fusion," Applied Energy, Elsevier, vol. 298(C).
    7. Salvia, Monica & Reckien, Diana & Pietrapertosa, Filomena & Eckersley, Peter & Spyridaki, Niki-Artemis & Krook-Riekkola, Anna & Olazabal, Marta & De Gregorio Hurtado, Sonia & Simoes, Sofia G. & Genele, 2021. "Will climate mitigation ambitions lead to carbon neutrality? An analysis of the local-level plans of 327 cities in the EU," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    8. Bai, Yulong & Liu, Ming-De & Ding, Lin & Ma, Yong-Jie, 2021. "Double-layer staged training echo-state networks for wind speed prediction using variational mode decomposition," Applied Energy, Elsevier, vol. 301(C).
    9. Latif, Abdul & Hussain, S.M. Suhail & Das, Dulal Chandra & Ustun, Taha Selim, 2020. "State-of-the-art of controllers and soft computing techniques for regulated load frequency management of single/multi-area traditional and renewable energy based power systems," Applied Energy, Elsevier, vol. 266(C).
    10. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun, 2022. "Coordinated load frequency control of multi-area integrated energy system using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 306(PA).
    11. Yin, Linfei & Zhang, Bin, 2021. "Time series generative adversarial network controller for long-term smart generation control of microgrids," Applied Energy, Elsevier, vol. 281(C).
    12. Ouyang, Tinghui & Zha, Xiaoming & Qin, Liang & He, Yusen & Tang, Zhenhao, 2019. "Prediction of wind power ramp events based on residual correction," Renewable Energy, Elsevier, vol. 136(C), pages 781-792.
    13. Elsisi, Mahmoud & Bazmohammadi, Najmeh & Guerrero, Josep M. & Ebrahim, Mohamed A., 2021. "Energy management of controllable loads in multi-area power systems with wind power penetration based on new supervisor fuzzy nonlinear sliding mode control," Energy, Elsevier, vol. 221(C).
    14. Terrén-Serrano, Guillermo & Martínez-Ramón, Manel, 2021. "Multi-layer wind velocity field visualization in infrared images of clouds for solar irradiance forecasting," Applied Energy, Elsevier, vol. 288(C).
    15. Li, Huan & Li, Kun & Zafetti, Nicholas & Gu, Jianfeng, 2020. "Improvement of energy supply configuration for telecommunication system in remote area s based on improved chaotic world cup optimization algorithm," Energy, Elsevier, vol. 192(C).
    16. Shahid, Farah & Zameer, Aneela & Muneeb, Muhammad, 2021. "A novel genetic LSTM model for wind power forecast," Energy, Elsevier, vol. 223(C).
    17. Liu, Hui & Huang, Kai & Wang, Ni & Qi, Junjian & Wu, Qiuwei & Ma, Shicong & Li, Canbing, 2019. "Optimal dispatch for participation of electric vehicles in frequency regulation based on area control error and area regulation requirement," Applied Energy, Elsevier, vol. 240(C), pages 46-55.
    18. Patnaik, Bhaskar & Mishra, Manohar & Bansal, Ramesh C. & Jena, Ranjan K., 2021. "MODWT-XGBoost based smart energy solution for fault detection and classification in a smart microgrid," Applied Energy, Elsevier, vol. 285(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shen, Rendong & Zhong, Shengyuan & Wen, Xin & An, Qingsong & Zheng, Ruifan & Li, Yang & Zhao, Jun, 2022. "Multi-agent deep reinforcement learning optimization framework for building energy system with renewable energy," Applied Energy, Elsevier, vol. 312(C).
    2. Gao, Yuan & Matsunami, Yuki & Miyata, Shohei & Akashi, Yasunori, 2022. "Multi-agent reinforcement learning dealing with hybrid action spaces: A case study for off-grid oriented renewable building energy system," Applied Energy, Elsevier, vol. 326(C).
    3. Jin, Jingliang & Wen, Qinglan & Zhao, Liya & Zhou, Chaoyang & Guo, Xiaojun, 2023. "Measuring environmental performance of power dispatch influenced by low-carbon approaches," Renewable Energy, Elsevier, vol. 209(C), pages 325-339.
    4. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).
    5. Gong, Linjuan & Hou, Guolian & Li, Jun & Gao, Haidong & Gao, Lin & Wang, Lin & Gao, Yaokui & Zhou, Junbo & Wang, Mingkun, 2023. "Intelligent fuzzy modeling of heavy-duty gas turbine for smart power generation," Energy, Elsevier, vol. 277(C).
    6. Zhao, Lulin & Yin, Linfei, 2024. "Knowledge-shareable adaptive deep dynamic programming for hierarchical generation control of distributed high-percentage renewable energy systems," Renewable Energy, Elsevier, vol. 228(C).
    7. Yin, Linfei & Li, Yu, 2022. "Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems," Applied Energy, Elsevier, vol. 324(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abulanwar, Sayed & Ghanem, Abdelhady & Rizk, Mohammad E.M. & Hu, Weihao, 2021. "Adaptive synergistic control strategy for a hybrid AC/DC microgrid during normal operation and contingencies," Applied Energy, Elsevier, vol. 304(C).
    2. Bhargav Appasani & Amitkumar V. Jha & Deepak Kumar Gupta & Nicu Bizon & Phatiphat Thounthong, 2023. "PSO α : A Fragmented Swarm Optimisation for Improved Load Frequency Control of a Hybrid Power System Using FOPID," Energies, MDPI, vol. 16(5), pages 1-17, February.
    3. Sharma, Abhishek & Jain, Sachin Kumar, 2022. "A novel seasonal segmentation approach for day-ahead load forecasting," Energy, Elsevier, vol. 257(C).
    4. Yin, Linfei & Li, Yu, 2022. "Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems," Applied Energy, Elsevier, vol. 324(C).
    5. Xu, Xuefang & Hu, Shiting & Shi, Peiming & Shao, Huaishuang & Li, Ruixiong & Li, Zhi, 2023. "Natural phase space reconstruction-based broad learning system for short-term wind speed prediction: Case studies of an offshore wind farm," Energy, Elsevier, vol. 262(PA).
    6. Han, Kunlun & Yang, Kai & Yin, Linfei, 2022. "Lightweight actor-critic generative adversarial networks for real-time smart generation control of microgrids," Applied Energy, Elsevier, vol. 317(C).
    7. Xiaoou Li & Yingqin Zhu, 2024. "Neural Networks with Transfer Learning and Frequency Decomposition for Wind Speed Prediction with Missing Data," Mathematics, MDPI, vol. 12(8), pages 1-20, April.
    8. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    9. Kui Yang & Bofu Wang & Xiang Qiu & Jiahua Li & Yuze Wang & Yulu Liu, 2022. "Multi-Step Short-Term Wind Speed Prediction Models Based on Adaptive Robust Decomposition Coupled with Deep Gated Recurrent Unit," Energies, MDPI, vol. 15(12), pages 1-24, June.
    10. Gao, Huanxiang & Hu, Gang & Zhang, Dongqin & Jiang, Wenjun & Ren, Hehe & Chen, Wenli, 2024. "Prediction of wind fields in mountains at multiple elevations using deep learning models," Applied Energy, Elsevier, vol. 353(PA).
    11. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).
    12. Kandpal, Bakul & Pareek, Parikshit & Verma, Ashu, 2022. "A robust day-ahead scheduling strategy for EV charging stations in unbalanced distribution grid," Energy, Elsevier, vol. 249(C).
    13. Shafqat Jawad & Junyong Liu, 2020. "Electrical Vehicle Charging Services Planning and Operation with Interdependent Power Networks and Transportation Networks: A Review of the Current Scenario and Future Trends," Energies, MDPI, vol. 13(13), pages 1-24, July.
    14. Yang, Sheng & Shao, Xue-Feng & Luo, Jia-Hao & Baghaei Oskouei, Seyedmohsen & Bayer, Özgür & Fan, Li-Wu, 2023. "A novel cascade latent heat thermal energy storage system consisting of erythritol and paraffin wax for deep recovery of medium-temperature industrial waste heat," Energy, Elsevier, vol. 265(C).
    15. Ding, Song & Cai, Zhijian & Qin, Xinghuan & Shen, Xingao, 2024. "Comparative assessment and policy analysis of forecasting quarterly renewable energy demand: Fresh evidence from an innovative seasonal approach with superior matching algorithms," Applied Energy, Elsevier, vol. 367(C).
    16. Antje Otto & Kristine Kern & Wolfgang Haupt & Peter Eckersley & Annegret H. Thieken, 2021. "Ranking local climate policy: assessing the mitigation and adaptation activities of 104 German cities," Climatic Change, Springer, vol. 167(1), pages 1-23, July.
    17. Liu, Xiangsheng & Lv, Lingli, 2023. "The effect of China's low carbon city pilot policy on corporate financialization," Finance Research Letters, Elsevier, vol. 54(C).
    18. Noura Metawa & Mohamemd I. Alghamdi & Ibrahim M. El-Hasnony & Mohamed Elhoseny, 2021. "Return Rate Prediction in Blockchain Financial Products Using Deep Learning," Sustainability, MDPI, vol. 13(21), pages 1-16, October.
    19. Wang, Xiaodi & Hao, Yan & Yang, Wendong, 2024. "Novel wind power ensemble forecasting system based on mixed-frequency modeling and interpretable base model selection strategy," Energy, Elsevier, vol. 297(C).
    20. Yin, Linfei & He, Xiaoyu, 2023. "Artificial emotional deep Q learning for real-time smart voltage control of cyber-physical social power systems," Energy, Elsevier, vol. 273(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:307:y:2022:i:c:s0306261921015282. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.