IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v281y2021ics0306261920314975.html
   My bibliography  Save this article

Time series generative adversarial network controller for long-term smart generation control of microgrids

Author

Listed:
  • Yin, Linfei
  • Zhang, Bin

Abstract

The conventional combined generation control framework of microgrids, which contains two time-scales, i.e., the time slot of economic dispatch is set to 15 min; and the total time slot of smart generation control and generation command dispatch is set to 4 s, could lead to uncoordinated problems. To avoid uncoordinated problems, this paper proposes a long-term smart generation control framework with a single time-scale to replace the conventional combined generation control framework with two time-scales, and then proposes time series generative adversarial network controller for long-term smart generation control of microgrids. The proposed time series generative adversarial network controller contains reinforcement learning, generator deep neural networks, and discriminator deep neural networks. The generator deep neural networks generate predicted states from multiple historical states, multiple historical actions, and multiple long-term actions. The discriminator deep neural networks judge whether the data from the generator deep neural networks or real-life data. This paper compares the proposed controller with conventional optimization algorithms and control algorithms, which are applied for economic dispatch, smart generation control, and generation commands dispatch in microgrids. The numerical simulation results under Hainan Power Grid, IEEE 300-bus power system, and IEEE 1951-bus power system verify that the proposed time series generative adversarial network controller can simultaneously obtain higher control performance and smaller economic cost than conventional combined control algorithm and optimization algorithms in the long-term. Consequently, the uncoordinated problem of economic dispatch, smart generation control, and generation commands dispatch can be solved by the proposed approach with one single long-term time-scale.

Suggested Citation

  • Yin, Linfei & Zhang, Bin, 2021. "Time series generative adversarial network controller for long-term smart generation control of microgrids," Applied Energy, Elsevier, vol. 281(C).
    • Handle: RePEc:eee:appene:v:281:y:2021:i:c:s0306261920314975
    DOI: 10.1016/j.apenergy.2020.116069
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261920314975
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2020.116069?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yin, Linfei & Yu, Tao & Zhang, Xiaoshun & Yang, Bo, 2018. "Relaxed deep learning for real-time economic generation dispatch and control with unified time scale," Energy, Elsevier, vol. 149(C), pages 11-23.
    2. Xi, Lei & Chen, Jianfeng & Huang, Yuehua & Xu, Yanchun & Liu, Lang & Zhou, Yimin & Li, Yudan, 2018. "Smart generation control based on multi-agent reinforcement learning with the idea of the time tunnel," Energy, Elsevier, vol. 153(C), pages 977-987.
    3. Jiang, C.X. & Jing, Z.X. & Cui, X.R. & Ji, T.Y. & Wu, Q.H., 2018. "Multiple agents and reinforcement learning for modelling charging loads of electric taxis," Applied Energy, Elsevier, vol. 222(C), pages 158-168.
    4. AL-Musaylh, Mohanad S. & Deo, Ravinesh C. & Li, Yan & Adamowski, Jan F., 2018. "Two-phase particle swarm optimized-support vector regression hybrid model integrated with improved empirical mode decomposition with adaptive noise for multiple-horizon electricity demand forecasting," Applied Energy, Elsevier, vol. 217(C), pages 422-439.
    5. Chan, C.M. & Bai, H.L. & He, D.Q., 2018. "Blade shape optimization of the Savonius wind turbine using a genetic algorithm," Applied Energy, Elsevier, vol. 213(C), pages 148-157.
    6. Christos-Spyridon Karavas & Konstantinos Arvanitis & George Papadakis, 2017. "A Game Theory Approach to Multi-Agent Decentralized Energy Management of Autonomous Polygeneration Microgrids," Energies, MDPI, vol. 10(11), pages 1, November.
    7. Han, Xuefeng & He, Hongwen & Wu, Jingda & Peng, Jiankun & Li, Yuecheng, 2019. "Energy management based on reinforcement learning with double deep Q-learning for a hybrid electric tracked vehicle," Applied Energy, Elsevier, vol. 254(C).
    8. Zhang, Xiaoshun & Tan, Tian & Yang, Bo & Wang, Jingbo & Li, Shengnan & He, Tingyi & Yang, Lei & Yu, Tao & Sun, Liming, 2020. "Greedy search based data-driven algorithm of centralized thermoelectric generation system under non-uniform temperature distribution," Applied Energy, Elsevier, vol. 260(C).
    9. Wei, Hu & Hongxuan, Zhang & Yu, Dong & Yiting, Wang & Ling, Dong & Ming, Xiao, 2019. "Short-term optimal operation of hydro-wind-solar hybrid system with improved generative adversarial networks," Applied Energy, Elsevier, vol. 250(C), pages 389-403.
    10. Ghasemi-Marzbali, Ali, 2020. "Multi-area multi-source automatic generation control in deregulated power system," Energy, Elsevier, vol. 201(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alabi, Tobi Michael & Aghimien, Emmanuel I. & Agbajor, Favour D. & Yang, Zaiyue & Lu, Lin & Adeoye, Adebusola R. & Gopaluni, Bhushan, 2022. "A review on the integrated optimization techniques and machine learning approaches for modeling, prediction, and decision making on integrated energy systems," Renewable Energy, Elsevier, vol. 194(C), pages 822-849.
    2. Yin, Linfei & Wu, Yunzhi, 2022. "Mode-decomposition memory reinforcement network strategy for smart generation control in multi-area power systems containing renewable energy," Applied Energy, Elsevier, vol. 307(C).
    3. Yin, Linfei & Lin, Chen, 2024. "Matrix Wasserstein distance generative adversarial network with gradient penalty for fast low-carbon economic dispatch of novel power systems," Energy, Elsevier, vol. 298(C).
    4. Yin, Linfei & Zhang, Bin, 2023. "Relaxed deep generative adversarial networks for real-time economic smart generation dispatch and control of integrated energy systems," Applied Energy, Elsevier, vol. 330(PA).
    5. Wang, Yihan & Wen, Zongguo & Cao, Xin & Dinga, Christian Doh, 2022. "Is information and communications technology effective for industrial energy conservation and emission reduction? Evidence from three energy-intensive industries in China," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    6. Turowski, M. & Heidrich, B. & Weingärtner, L. & Springer, L. & Phipps, K. & Schäfer, B. & Mikut, R. & Hagenmeyer, V., 2024. "Generating synthetic energy time series: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 206(C).
    7. Han, Kunlun & Yang, Kai & Yin, Linfei, 2022. "Lightweight actor-critic generative adversarial networks for real-time smart generation control of microgrids," Applied Energy, Elsevier, vol. 317(C).
    8. Zhao, Lulin & Yin, Linfei, 2024. "Knowledge-shareable adaptive deep dynamic programming for hierarchical generation control of distributed high-percentage renewable energy systems," Renewable Energy, Elsevier, vol. 228(C).
    9. Chen, Weidong & Wang, Junnan & Yu, Guanyi & Chen, Jiajia & Hu, Yumeng, 2022. "Research on day-ahead transactions between multi-microgrid based on cooperative game model," Applied Energy, Elsevier, vol. 316(C).
    10. Wang, Yuwei & Song, Minghao & Jia, Mengyao & Shi, Lin & Li, Bingkang, 2023. "TimeGAN based distributionally robust optimization for biomass-photovoltaic-hydrogen scheduling under source-load-market uncertainties," Energy, Elsevier, vol. 284(C).
    11. Yin, Linfei & He, Xiaoyu, 2023. "Artificial emotional deep Q learning for real-time smart voltage control of cyber-physical social power systems," Energy, Elsevier, vol. 273(C).
    12. Yin, Linfei & Luo, Shikui & Ma, Chenxiao, 2021. "Expandable depth and width adaptive dynamic programming for economic smart generation control of smart grids," Energy, Elsevier, vol. 232(C).
    13. Yin, Linfei & Li, Yu, 2022. "Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems," Applied Energy, Elsevier, vol. 324(C).
    14. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yin, Linfei & Luo, Shikui & Ma, Chenxiao, 2021. "Expandable depth and width adaptive dynamic programming for economic smart generation control of smart grids," Energy, Elsevier, vol. 232(C).
    2. Li, Jiawen & Yu, Tao & Zhang, Xiaoshun & Li, Fusheng & Lin, Dan & Zhu, Hanxin, 2021. "Efficient experience replay based deep deterministic policy gradient for AGC dispatch in integrated energy system," Applied Energy, Elsevier, vol. 285(C).
    3. Yin, Linfei & Li, Yu, 2022. "Hybrid multi-agent emotional deep Q network for generation control of multi-area integrated energy systems," Applied Energy, Elsevier, vol. 324(C).
    4. Yin, Linfei & Gao, Qi & Zhao, Lulin & Wang, Tao, 2020. "Expandable deep learning for real-time economic generation dispatch and control of three-state energies based future smart grids," Energy, Elsevier, vol. 191(C).
    5. Wang, Jin & Zhao, Zhipeng & Zhou, Jinglin & Cheng, Chuntian & Su, Huaying, 2024. "Co-optimization for day-ahead scheduling and flexibility response mode of a hydro–wind–solar hybrid system considering forecast uncertainty of variable renewable energy," Energy, Elsevier, vol. 311(C).
    6. Sun, Alexander Y., 2020. "Optimal carbon storage reservoir management through deep reinforcement learning," Applied Energy, Elsevier, vol. 278(C).
    7. Matteo Acquarone & Claudio Maino & Daniela Misul & Ezio Spessa & Antonio Mastropietro & Luca Sorrentino & Enrico Busto, 2023. "Influence of the Reward Function on the Selection of Reinforcement Learning Agents for Hybrid Electric Vehicles Real-Time Control," Energies, MDPI, vol. 16(6), pages 1-22, March.
    8. Jean-Michel Clairand & Paulo Guerra-Terán & Xavier Serrano-Guerrero & Mario González-Rodríguez & Guillermo Escrivá-Escrivá, 2019. "Electric Vehicles for Public Transportation in Power Systems: A Review of Methodologies," Energies, MDPI, vol. 12(16), pages 1-22, August.
    9. Yang, Ningkang & Han, Lijin & Xiang, Changle & Liu, Hui & Li, Xunmin, 2021. "An indirect reinforcement learning based real-time energy management strategy via high-order Markov Chain model for a hybrid electric vehicle," Energy, Elsevier, vol. 236(C).
    10. Zhou, Yuzhou & Zhao, Jiexing & Zhai, Qiaozhu, 2021. "100% renewable energy: A multi-stage robust scheduling approach for cascade hydropower system with wind and photovoltaic power," Applied Energy, Elsevier, vol. 301(C).
    11. Das, Pronob & Das, Barun K. & Rahman, Mushfiqur & Hassan, Rakibul, 2022. "Evaluating the prospect of utilizing excess energy and creating employments from a hybrid energy system meeting electricity and freshwater demands using multi-objective evolutionary algorithms," Energy, Elsevier, vol. 238(PB).
    12. Zhang, Wei & Wang, Jixin & Liu, Yong & Gao, Guangzong & Liang, Siwen & Ma, Hongfeng, 2020. "Reinforcement learning-based intelligent energy management architecture for hybrid construction machinery," Applied Energy, Elsevier, vol. 275(C).
    13. Tang, Tianfeng & Peng, Qianlong & Shi, Qing & Peng, Qingguo & Zhao, Jin & Chen, Chaoyi & Wang, Guangwei, 2024. "Energy management of fuel cell hybrid electric bus in mountainous regions: A deep reinforcement learning approach considering terrain characteristics," Energy, Elsevier, vol. 311(C).
    14. Lifang Zhang & Jianzhou Wang & Zhenkun Liu, 2023. "Power grid operation optimization and forecasting using a combined forecasting system," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(1), pages 124-153, January.
    15. Haddad, Hassan Z. & Mohamed, Mohamed H. & Shabana, Yasser M. & Elsayed, Khairy, 2023. "Optimization of Savonius wind turbine with additional blades by surrogate model using artificial neural networks," Energy, Elsevier, vol. 270(C).
    16. Yin, Linfei & Zhang, Bin, 2023. "Relaxed deep generative adversarial networks for real-time economic smart generation dispatch and control of integrated energy systems," Applied Energy, Elsevier, vol. 330(PA).
    17. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    18. Ju, Fei & Zhuang, Weichao & Wang, Liangmo & Zhang, Zhe, 2020. "Comparison of four-wheel-drive hybrid powertrain configurations," Energy, Elsevier, vol. 209(C).
    19. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    20. Feng, Yu & Hao, Weiping & Li, Haoru & Cui, Ningbo & Gong, Daozhi & Gao, Lili, 2020. "Machine learning models to quantify and map daily global solar radiation and photovoltaic power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 118(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:281:y:2021:i:c:s0306261920314975. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.