IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v232y2021ics0360544221012123.html
   My bibliography  Save this article

Expandable depth and width adaptive dynamic programming for economic smart generation control of smart grids

Author

Listed:
  • Yin, Linfei
  • Luo, Shikui
  • Ma, Chenxiao

Abstract

The uncertainty of renewable energy sources (RESs) puts pressure on the economic dispatch of smart grids. However, many traditional multiple time-scales dispatching approaches lead to problems such as inverse regulation and cost increase. To optimize the economic dispatch of smart grids, firstly, a three-state energy prosumers (TSEPs) model is proposed to facilitate flexible dispatching of RESs. Secondly, an economic smart generation control (ESGC) framework is designed to replace the traditional multiple time-scales framework. The ESGC allows TSEPs to enter and exit at any time and improves the economy of economic dispatch. Furthermore, an expandable depth and width adaptive dynamic programming (EDP) algorithm is proposed. The EDP can match the entering and exiting characteristics of TSEPs, and has high algorithm accuracy and calculation speed with reducing the network redundancy of the EDP. Finally, compared with compared algorithms, the EDP reduces 69.559% and 61.2% in |Δf| and improves 1.783% and 0.668% in profit under a two-area smart grid and a modified 1888-bus French based smart grid, respectively. The simulation results verify the feasibility and reliability of the EDP for the ESGC of smart grids.

Suggested Citation

  • Yin, Linfei & Luo, Shikui & Ma, Chenxiao, 2021. "Expandable depth and width adaptive dynamic programming for economic smart generation control of smart grids," Energy, Elsevier, vol. 232(C).
    • Handle: RePEc:eee:energy:v:232:y:2021:i:c:s0360544221012123
    DOI: 10.1016/j.energy.2021.120964
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221012123
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2021.120964?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mahmoudimehr, Javad & Sebghati, Parvin, 2019. "A novel multi-objective Dynamic Programming optimization method: Performance management of a solar thermal power plant as a case study," Energy, Elsevier, vol. 168(C), pages 796-814.
    2. Yin, Linfei & Yu, Tao & Zhang, Xiaoshun & Yang, Bo, 2018. "Relaxed deep learning for real-time economic generation dispatch and control with unified time scale," Energy, Elsevier, vol. 149(C), pages 11-23.
    3. He, Zhongzheng & Zhou, Jianzhong & Qin, Hui & Jia, Benjun & He, Feifei & Liu, Guangbiao & Feng, Kuaile, 2020. "A fast water level optimal control method based on two stage analysis for long term power generation scheduling of hydropower station," Energy, Elsevier, vol. 210(C).
    4. Zhu, Tao & Wills, Richard G.A. & Lot, Roberto & Kong, Xiaodan & Yan, Xingda, 2021. "Optimal sizing and sensitivity analysis of a battery-supercapacitor energy storage system for electric vehicles," Energy, Elsevier, vol. 221(C).
    5. Guo, Yuanjun & Yang, Zhile & Liu, Kailong & Zhang, Yanhui & Feng, Wei, 2021. "A compact and optimized neural network approach for battery state-of-charge estimation of energy storage system," Energy, Elsevier, vol. 219(C).
    6. Feng, Zhong-kai & Niu, Wen-jing & Cheng, Chun-tian & Liao, Sheng-li, 2017. "Hydropower system operation optimization by discrete differential dynamic programming based on orthogonal experiment design," Energy, Elsevier, vol. 126(C), pages 720-732.
    7. Vitale, F. & Rispoli, N. & Sorrentino, M. & Rosen, M.A. & Pianese, C., 2021. "On the use of dynamic programming for optimal energy management of grid-connected reversible solid oxide cell-based renewable microgrids," Energy, Elsevier, vol. 225(C).
    8. Alipour, Mohammadali & Aghaei, Jamshid & Norouzi, Mohammadali & Niknam, Taher & Hashemi, Sattar & Lehtonen, Matti, 2020. "A novel electrical net-load forecasting model based on deep neural networks and wavelet transform integration," Energy, Elsevier, vol. 205(C).
    9. Zheng, Lingwei & Zhou, Xingqiu & Qiu, Qi & Yang, Lan, 2020. "Day-ahead optimal dispatch of an integrated energy system considering time-frequency characteristics of renewable energy source output," Energy, Elsevier, vol. 209(C).
    10. Yin, Linfei & Gao, Qi & Zhao, Lulin & Wang, Tao, 2020. "Expandable deep learning for real-time economic generation dispatch and control of three-state energies based future smart grids," Energy, Elsevier, vol. 191(C).
    11. Alirezazadeh, Atefeh & Rashidinejad, Masoud & Abdollahi, Amir & Afzali, Peyman & Bakhshai, Alireza, 2020. "A new flexible model for generation scheduling in a smart grid," Energy, Elsevier, vol. 191(C).
    12. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    13. Parsa, Navid & Bahmani-Firouzi, Bahman & Niknam, Taher, 2021. "A social-economic-technical framework for reinforcing the automated distribution systems considering optimal switching and plug-in hybrid electric vehicles," Energy, Elsevier, vol. 220(C).
    14. Liu, Jia & Zeng, Peter Pingliang & Xing, Hao & Li, Yalou & Wu, Qiuwei, 2020. "Hierarchical duality-based planning of transmission networks coordinating active distribution network operation," Energy, Elsevier, vol. 213(C).
    15. He, Zhongzheng & Wang, Chao & Wang, Yongqiang & Wei, Bowen & Zhou, Jianzhong & Zhang, Hairong & Qin, Hui, 2021. "Dynamic programming with successive approximation and relaxation strategy for long-term joint power generation scheduling of large-scale hydropower station group," Energy, Elsevier, vol. 222(C).
    16. El-Bidairi, Kutaiba S. & Nguyen, Hung Duc & Mahmoud, Thair S. & Jayasinghe, S.D.G. & Guerrero, Josep M., 2020. "Optimal sizing of Battery Energy Storage Systems for dynamic frequency control in an islanded microgrid: A case study of Flinders Island, Australia," Energy, Elsevier, vol. 195(C).
    17. Ajanovic, Amela & Hiesl, Albert & Haas, Reinhard, 2020. "On the role of storage for electricity in smart energy systems," Energy, Elsevier, vol. 200(C).
    18. Olabi, A.G. & Onumaegbu, C. & Wilberforce, Tabbi & Ramadan, Mohamad & Abdelkareem, Mohammad Ali & Al – Alami, Abdul Hai, 2021. "Critical review of energy storage systems," Energy, Elsevier, vol. 214(C).
    19. Coppitters, Diederik & De Paepe, Ward & Contino, Francesco, 2020. "Robust design optimization and stochastic performance analysis of a grid-connected photovoltaic system with battery storage and hydrogen storage," Energy, Elsevier, vol. 213(C).
    20. Ghasemi-Marzbali, Ali, 2020. "Multi-area multi-source automatic generation control in deregulated power system," Energy, Elsevier, vol. 201(C).
    21. Graber, Giuseppe & Calderaro, Vito & Mancarella, Pierluigi & Galdi, Vincenzo, 2020. "Two-stage stochastic sizing and packetized energy scheduling of BEV charging stations with quality of service constraints," Applied Energy, Elsevier, vol. 260(C).
    22. Abdul Ghani Olabi & Tabbi Wilberforce & Mohammad Ali Abdelkareem & Mohamad Ramadan, 2021. "Critical Review of Flywheel Energy Storage System," Energies, MDPI, vol. 14(8), pages 1-33, April.
    23. Pan, Zhenning & Yu, Tao & Li, Jie & Qu, Kaiping & Yang, Bo, 2020. "Risk-averse real-time dispatch of integrated electricity and heat system using a modified approximate dynamic programming approach," Energy, Elsevier, vol. 198(C).
    24. Jafari, Mina & Kavousi-Fard, Abdollah & Niknam, Taher & Avatefipour, Omid, 2021. "Stochastic synergies of urban transportation system and smart grid in smart cities considering V2G and V2S concepts," Energy, Elsevier, vol. 215(PB).
    25. Xi, Lei & Chen, Jianfeng & Huang, Yuehua & Xu, Yanchun & Liu, Lang & Zhou, Yimin & Li, Yudan, 2018. "Smart generation control based on multi-agent reinforcement learning with the idea of the time tunnel," Energy, Elsevier, vol. 153(C), pages 977-987.
    26. Zhou, Kaile & Cheng, Lexin & Wen, Lulu & Lu, Xinhui & Ding, Tao, 2020. "A coordinated charging scheduling method for electric vehicles considering different charging demands," Energy, Elsevier, vol. 213(C).
    27. Tan, Qinliang & Ding, Yihong & Zheng, Jin & Dai, Mei & Zhang, Yimei, 2021. "The effects of carbon emissions trading and renewable portfolio standards on the integrated wind–photovoltaic–thermal power-dispatching system: Real case studies in China," Energy, Elsevier, vol. 222(C).
    28. Schmid, Fabian & Winzer, Joscha & Pasemann, André & Behrendt, Frank, 2021. "An open-source modeling tool for multi-objective optimization of renewable nano/micro-off-grid power supply system: Influence of temporal resolution, simulation period, and location," Energy, Elsevier, vol. 219(C).
    29. Feng, Zhong-kai & Niu, Wen-jing & Cheng, Chun-tian & Wu, Xin-yu, 2017. "Optimization of hydropower system operation by uniform dynamic programming for dimensionality reduction," Energy, Elsevier, vol. 134(C), pages 718-730.
    30. Ajoulabadi, Ata & Ravadanegh, Sajad Najafi & Behnam Mohammadi-Ivatloo,, 2020. "Flexible scheduling of reconfigurable microgrid-based distribution networks considering demand response program," Energy, Elsevier, vol. 196(C).
    31. Huang, Pei & Sun, Yongjun & Lovati, Marco & Zhang, Xingxing, 2021. "Solar-photovoltaic-power-sharing-based design optimization of distributed energy storage systems for performance improvements," Energy, Elsevier, vol. 222(C).
    32. Yin, Linfei & Zhang, Bin, 2021. "Time series generative adversarial network controller for long-term smart generation control of microgrids," Applied Energy, Elsevier, vol. 281(C).
    33. Ma, Zhao & Li, Ming-Jia & Zhang, K. Max & Yuan, Fan, 2021. "Novel designs of hybrid thermal energy storage system and operation strategies for concentrated solar power plant," Energy, Elsevier, vol. 216(C).
    34. Kong, Xiangyu & Sun, Fangyuan & Huo, Xianxu & Li, Xue & Shen, Yu, 2020. "Hierarchical optimal scheduling method of heat-electricity integrated energy system based on Power Internet of Things," Energy, Elsevier, vol. 210(C).
    35. Yin, Linfei & Wang, Tao & Zheng, Baomin, 2021. "Analytical adaptive distributed multi-objective optimization algorithm for optimal power flow problems," Energy, Elsevier, vol. 216(C).
    36. Carli, Raffaele & Dotoli, Mariagrazia & Jantzen, Jan & Kristensen, Michael & Ben Othman, Sarah, 2020. "Energy scheduling of a smart microgrid with shared photovoltaic panels and storage: The case of the Ballen marina in Samsø," Energy, Elsevier, vol. 198(C).
    37. Viesi, Diego & Crema, Luigi & Mahbub, Md Shahriar & Verones, Sara & Brunelli, Roberto & Baggio, Paolo & Fauri, Maurizio & Prada, Alessandro & Bello, Andrea & Nodari, Benedetta & Silvestri, Silvia & To, 2020. "Integrated and dynamic energy modelling of a regional system: A cost-optimized approach in the deep decarbonisation of the Province of Trento (Italy)," Energy, Elsevier, vol. 209(C).
    38. Jiang, Yinghua & Kang, Lixia & Liu, Yongzhong, 2020. "Optimal configuration of battery energy storage system with multiple types of batteries based on supply-demand characteristics," Energy, Elsevier, vol. 206(C).
    39. Yin, Linfei & Zhao, Lulin, 2021. "Rejectable deep differential dynamic programming for real-time integrated generation dispatch and control of micro-grids," Energy, Elsevier, vol. 225(C).
    40. Guan, Jinyu & Tang, Hao & Wang, Ke & Yao, Jianguo & Yang, Shengchun, 2020. "A parallel multi-scenario learning method for near-real-time power dispatch optimization," Energy, Elsevier, vol. 202(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Han, Kunlun & Yang, Kai & Yin, Linfei, 2022. "Lightweight actor-critic generative adversarial networks for real-time smart generation control of microgrids," Applied Energy, Elsevier, vol. 317(C).
    2. Zhao, Lulin & Yin, Linfei, 2024. "Knowledge-shareable adaptive deep dynamic programming for hierarchical generation control of distributed high-percentage renewable energy systems," Renewable Energy, Elsevier, vol. 228(C).
    3. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Lulin & Yin, Linfei, 2024. "Knowledge-shareable adaptive deep dynamic programming for hierarchical generation control of distributed high-percentage renewable energy systems," Renewable Energy, Elsevier, vol. 228(C).
    2. Yin, Linfei & Zhang, Bin, 2021. "Time series generative adversarial network controller for long-term smart generation control of microgrids," Applied Energy, Elsevier, vol. 281(C).
    3. Yin, Linfei & Zhang, Bin, 2023. "Relaxed deep generative adversarial networks for real-time economic smart generation dispatch and control of integrated energy systems," Applied Energy, Elsevier, vol. 330(PA).
    4. Savolainen, Rebecka & Lahdelma, Risto, 2022. "Optimization of renewable energy for buildings with energy storages and 15-minute power balance," Energy, Elsevier, vol. 243(C).
    5. Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).
    6. Mahfoud, Rabea Jamil & Alkayem, Nizar Faisal & Zhang, Yuquan & Zheng, Yuan & Sun, Yonghui & Alhelou, Hassan Haes, 2023. "Optimal operation of pumped hydro storage-based energy systems: A compendium of current challenges and future perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 178(C).
    7. Nielsen, Tore Bach & Lund, Henrik & Østergaard, Poul Alberg & Duic, Neven & Mathiesen, Brian Vad, 2021. "Perspectives on energy efficiency and smart energy systems from the 5th SESAAU2019 conference," Energy, Elsevier, vol. 216(C).
    8. Tawalbeh, Muhammad & Murtaza, Sana Z.M. & Al-Othman, Amani & Alami, Abdul Hai & Singh, Karnail & Olabi, Abdul Ghani, 2022. "Ammonia: A versatile candidate for the use in energy storage systems," Renewable Energy, Elsevier, vol. 194(C), pages 955-977.
    9. Wu, Di & Wang, Dexin & Ramachandran, Thiagarajan & Holladay, Jamie, 2022. "A techno-economic assessment framework for hydrogen energy storage toward multiple energy delivery pathways and grid services," Energy, Elsevier, vol. 249(C).
    10. Yin, Linfei & Zhao, Lulin, 2021. "Rejectable deep differential dynamic programming for real-time integrated generation dispatch and control of micro-grids," Energy, Elsevier, vol. 225(C).
    11. Feng, Zhong-kai & Niu, Wen-jing & Wang, Wen-chuan & Zhou, Jian-zhong & Cheng, Chun-tian, 2019. "A mixed integer linear programming model for unit commitment of thermal plants with peak shaving operation aspect in regional power grid lack of flexible hydropower energy," Energy, Elsevier, vol. 175(C), pages 618-629.
    12. Cheayb, Mohamad & Marin Gallego, Mylène & Tazerout, Mohand & Poncet, Sébastien, 2022. "A techno-economic analysis of small-scale trigenerative compressed air energy storage system," Energy, Elsevier, vol. 239(PA).
    13. Jānis Krūmiņš & Māris Kļaviņš, 2023. "Investigating the Potential of Nuclear Energy in Achieving a Carbon-Free Energy Future," Energies, MDPI, vol. 16(9), pages 1-31, April.
    14. Ameen, Muhammad Tahir & Ma, Zhiwei & Smallbone, Andrew & Norman, Rose & Roskilly, Anthony Paul, 2023. "Demonstration system of pumped heat energy storage (PHES) and its round-trip efficiency," Applied Energy, Elsevier, vol. 333(C).
    15. Li, Chengchen & Wang, Huanran & He, Xin & Zhang, Yan, 2022. "Experimental and thermodynamic investigation on isothermal performance of large-scaled liquid piston," Energy, Elsevier, vol. 249(C).
    16. Yin, Linfei & He, Xiaoyu, 2023. "Artificial emotional deep Q learning for real-time smart voltage control of cyber-physical social power systems," Energy, Elsevier, vol. 273(C).
    17. Dzido, Aleksandra & Krawczyk, Piotr & Wołowicz, Marcin & Badyda, Krzysztof, 2022. "Comparison of advanced air liquefaction systems in Liquid Air Energy Storage applications," Renewable Energy, Elsevier, vol. 184(C), pages 727-739.
    18. Toufani, Parinaz & Nadar, Emre & Kocaman, Ayse Selin, 2022. "Short-term assessment of pumped hydro energy storage configurations: Up, down, or closed?," Renewable Energy, Elsevier, vol. 201(P1), pages 1086-1095.
    19. Herc, Luka & Pfeifer, Antun & Duić, Neven & Wang, Fei, 2022. "Economic viability of flexibility options for smart energy systems with high penetration of renewable energy," Energy, Elsevier, vol. 252(C).
    20. Liu, Mingyi & Qian, Feng & Mi, Jia & Zuo, Lei, 2022. "Biomechanical energy harvesting for wearable and mobile devices: State-of-the-art and future directions," Applied Energy, Elsevier, vol. 321(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:232:y:2021:i:c:s0360544221012123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.