IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v232y2021ics0360544221012123.html
   My bibliography  Save this article

Expandable depth and width adaptive dynamic programming for economic smart generation control of smart grids

Author

Listed:
  • Yin, Linfei
  • Luo, Shikui
  • Ma, Chenxiao

Abstract

The uncertainty of renewable energy sources (RESs) puts pressure on the economic dispatch of smart grids. However, many traditional multiple time-scales dispatching approaches lead to problems such as inverse regulation and cost increase. To optimize the economic dispatch of smart grids, firstly, a three-state energy prosumers (TSEPs) model is proposed to facilitate flexible dispatching of RESs. Secondly, an economic smart generation control (ESGC) framework is designed to replace the traditional multiple time-scales framework. The ESGC allows TSEPs to enter and exit at any time and improves the economy of economic dispatch. Furthermore, an expandable depth and width adaptive dynamic programming (EDP) algorithm is proposed. The EDP can match the entering and exiting characteristics of TSEPs, and has high algorithm accuracy and calculation speed with reducing the network redundancy of the EDP. Finally, compared with compared algorithms, the EDP reduces 69.559% and 61.2% in |Δf| and improves 1.783% and 0.668% in profit under a two-area smart grid and a modified 1888-bus French based smart grid, respectively. The simulation results verify the feasibility and reliability of the EDP for the ESGC of smart grids.

Suggested Citation

  • Yin, Linfei & Luo, Shikui & Ma, Chenxiao, 2021. "Expandable depth and width adaptive dynamic programming for economic smart generation control of smart grids," Energy, Elsevier, vol. 232(C).
    • Handle: RePEc:eee:energy:v:232:y:2021:i:c:s0360544221012123
    DOI: 10.1016/j.energy.2021.120964
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221012123
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2021.120964?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pan, Zhenning & Yu, Tao & Li, Jie & Qu, Kaiping & Yang, Bo, 2020. "Risk-averse real-time dispatch of integrated electricity and heat system using a modified approximate dynamic programming approach," Energy, Elsevier, vol. 198(C).
    2. Yin, Linfei & Zhang, Bin, 2021. "Time series generative adversarial network controller for long-term smart generation control of microgrids," Applied Energy, Elsevier, vol. 281(C).
    3. Jafari, Mina & Kavousi-Fard, Abdollah & Niknam, Taher & Avatefipour, Omid, 2021. "Stochastic synergies of urban transportation system and smart grid in smart cities considering V2G and V2S concepts," Energy, Elsevier, vol. 215(PB).
    4. Mahmoudimehr, Javad & Sebghati, Parvin, 2019. "A novel multi-objective Dynamic Programming optimization method: Performance management of a solar thermal power plant as a case study," Energy, Elsevier, vol. 168(C), pages 796-814.
    5. Yin, Linfei & Yu, Tao & Zhang, Xiaoshun & Yang, Bo, 2018. "Relaxed deep learning for real-time economic generation dispatch and control with unified time scale," Energy, Elsevier, vol. 149(C), pages 11-23.
    6. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    7. Ma, Zhao & Li, Ming-Jia & Zhang, K. Max & Yuan, Fan, 2021. "Novel designs of hybrid thermal energy storage system and operation strategies for concentrated solar power plant," Energy, Elsevier, vol. 216(C).
    8. Parsa, Navid & Bahmani-Firouzi, Bahman & Niknam, Taher, 2021. "A social-economic-technical framework for reinforcing the automated distribution systems considering optimal switching and plug-in hybrid electric vehicles," Energy, Elsevier, vol. 220(C).
    9. Liu, Jia & Zeng, Peter Pingliang & Xing, Hao & Li, Yalou & Wu, Qiuwei, 2020. "Hierarchical duality-based planning of transmission networks coordinating active distribution network operation," Energy, Elsevier, vol. 213(C).
    10. Xi, Lei & Chen, Jianfeng & Huang, Yuehua & Xu, Yanchun & Liu, Lang & Zhou, Yimin & Li, Yudan, 2018. "Smart generation control based on multi-agent reinforcement learning with the idea of the time tunnel," Energy, Elsevier, vol. 153(C), pages 977-987.
    11. He, Zhongzheng & Wang, Chao & Wang, Yongqiang & Wei, Bowen & Zhou, Jianzhong & Zhang, Hairong & Qin, Hui, 2021. "Dynamic programming with successive approximation and relaxation strategy for long-term joint power generation scheduling of large-scale hydropower station group," Energy, Elsevier, vol. 222(C).
    12. He, Zhongzheng & Zhou, Jianzhong & Qin, Hui & Jia, Benjun & He, Feifei & Liu, Guangbiao & Feng, Kuaile, 2020. "A fast water level optimal control method based on two stage analysis for long term power generation scheduling of hydropower station," Energy, Elsevier, vol. 210(C).
    13. Zhu, Tao & Wills, Richard G.A. & Lot, Roberto & Kong, Xiaodan & Yan, Xingda, 2021. "Optimal sizing and sensitivity analysis of a battery-supercapacitor energy storage system for electric vehicles," Energy, Elsevier, vol. 221(C).
    14. Guo, Yuanjun & Yang, Zhile & Liu, Kailong & Zhang, Yanhui & Feng, Wei, 2021. "A compact and optimized neural network approach for battery state-of-charge estimation of energy storage system," Energy, Elsevier, vol. 219(C).
    15. Feng, Zhong-kai & Niu, Wen-jing & Cheng, Chun-tian & Liao, Sheng-li, 2017. "Hydropower system operation optimization by discrete differential dynamic programming based on orthogonal experiment design," Energy, Elsevier, vol. 126(C), pages 720-732.
    16. El-Bidairi, Kutaiba S. & Nguyen, Hung Duc & Mahmoud, Thair S. & Jayasinghe, S.D.G. & Guerrero, Josep M., 2020. "Optimal sizing of Battery Energy Storage Systems for dynamic frequency control in an islanded microgrid: A case study of Flinders Island, Australia," Energy, Elsevier, vol. 195(C).
    17. Vitale, F. & Rispoli, N. & Sorrentino, M. & Rosen, M.A. & Pianese, C., 2021. "On the use of dynamic programming for optimal energy management of grid-connected reversible solid oxide cell-based renewable microgrids," Energy, Elsevier, vol. 225(C).
    18. Alipour, Mohammadali & Aghaei, Jamshid & Norouzi, Mohammadali & Niknam, Taher & Hashemi, Sattar & Lehtonen, Matti, 2020. "A novel electrical net-load forecasting model based on deep neural networks and wavelet transform integration," Energy, Elsevier, vol. 205(C).
    19. Kong, Xiangyu & Sun, Fangyuan & Huo, Xianxu & Li, Xue & Shen, Yu, 2020. "Hierarchical optimal scheduling method of heat-electricity integrated energy system based on Power Internet of Things," Energy, Elsevier, vol. 210(C).
    20. Yin, Linfei & Wang, Tao & Zheng, Baomin, 2021. "Analytical adaptive distributed multi-objective optimization algorithm for optimal power flow problems," Energy, Elsevier, vol. 216(C).
    21. Carli, Raffaele & Dotoli, Mariagrazia & Jantzen, Jan & Kristensen, Michael & Ben Othman, Sarah, 2020. "Energy scheduling of a smart microgrid with shared photovoltaic panels and storage: The case of the Ballen marina in Samsø," Energy, Elsevier, vol. 198(C).
    22. Zheng, Lingwei & Zhou, Xingqiu & Qiu, Qi & Yang, Lan, 2020. "Day-ahead optimal dispatch of an integrated energy system considering time-frequency characteristics of renewable energy source output," Energy, Elsevier, vol. 209(C).
    23. Viesi, Diego & Crema, Luigi & Mahbub, Md Shahriar & Verones, Sara & Brunelli, Roberto & Baggio, Paolo & Fauri, Maurizio & Prada, Alessandro & Bello, Andrea & Nodari, Benedetta & Silvestri, Silvia & To, 2020. "Integrated and dynamic energy modelling of a regional system: A cost-optimized approach in the deep decarbonisation of the Province of Trento (Italy)," Energy, Elsevier, vol. 209(C).
    24. Jiang, Yinghua & Kang, Lixia & Liu, Yongzhong, 2020. "Optimal configuration of battery energy storage system with multiple types of batteries based on supply-demand characteristics," Energy, Elsevier, vol. 206(C).
    25. Ajanovic, Amela & Hiesl, Albert & Haas, Reinhard, 2020. "On the role of storage for electricity in smart energy systems," Energy, Elsevier, vol. 200(C).
    26. Yin, Linfei & Zhao, Lulin, 2021. "Rejectable deep differential dynamic programming for real-time integrated generation dispatch and control of micro-grids," Energy, Elsevier, vol. 225(C).
    27. Olabi, A.G. & Onumaegbu, C. & Wilberforce, Tabbi & Ramadan, Mohamad & Abdelkareem, Mohammad Ali & Al – Alami, Abdul Hai, 2021. "Critical review of energy storage systems," Energy, Elsevier, vol. 214(C).
    28. Yin, Linfei & Gao, Qi & Zhao, Lulin & Wang, Tao, 2020. "Expandable deep learning for real-time economic generation dispatch and control of three-state energies based future smart grids," Energy, Elsevier, vol. 191(C).
    29. Coppitters, Diederik & De Paepe, Ward & Contino, Francesco, 2020. "Robust design optimization and stochastic performance analysis of a grid-connected photovoltaic system with battery storage and hydrogen storage," Energy, Elsevier, vol. 213(C).
    30. Ghasemi-Marzbali, Ali, 2020. "Multi-area multi-source automatic generation control in deregulated power system," Energy, Elsevier, vol. 201(C).
    31. Zhou, Kaile & Cheng, Lexin & Wen, Lulu & Lu, Xinhui & Ding, Tao, 2020. "A coordinated charging scheduling method for electric vehicles considering different charging demands," Energy, Elsevier, vol. 213(C).
    32. Guan, Jinyu & Tang, Hao & Wang, Ke & Yao, Jianguo & Yang, Shengchun, 2020. "A parallel multi-scenario learning method for near-real-time power dispatch optimization," Energy, Elsevier, vol. 202(C).
    33. Alirezazadeh, Atefeh & Rashidinejad, Masoud & Abdollahi, Amir & Afzali, Peyman & Bakhshai, Alireza, 2020. "A new flexible model for generation scheduling in a smart grid," Energy, Elsevier, vol. 191(C).
    34. Tan, Qinliang & Ding, Yihong & Zheng, Jin & Dai, Mei & Zhang, Yimei, 2021. "The effects of carbon emissions trading and renewable portfolio standards on the integrated wind–photovoltaic–thermal power-dispatching system: Real case studies in China," Energy, Elsevier, vol. 222(C).
    35. Graber, Giuseppe & Calderaro, Vito & Mancarella, Pierluigi & Galdi, Vincenzo, 2020. "Two-stage stochastic sizing and packetized energy scheduling of BEV charging stations with quality of service constraints," Applied Energy, Elsevier, vol. 260(C).
    36. Schmid, Fabian & Winzer, Joscha & Pasemann, André & Behrendt, Frank, 2021. "An open-source modeling tool for multi-objective optimization of renewable nano/micro-off-grid power supply system: Influence of temporal resolution, simulation period, and location," Energy, Elsevier, vol. 219(C).
    37. Feng, Zhong-kai & Niu, Wen-jing & Cheng, Chun-tian & Wu, Xin-yu, 2017. "Optimization of hydropower system operation by uniform dynamic programming for dimensionality reduction," Energy, Elsevier, vol. 134(C), pages 718-730.
    38. Ajoulabadi, Ata & Ravadanegh, Sajad Najafi & Behnam Mohammadi-Ivatloo,, 2020. "Flexible scheduling of reconfigurable microgrid-based distribution networks considering demand response program," Energy, Elsevier, vol. 196(C).
    39. Abdul Ghani Olabi & Tabbi Wilberforce & Mohammad Ali Abdelkareem & Mohamad Ramadan, 2021. "Critical Review of Flywheel Energy Storage System," Energies, MDPI, vol. 14(8), pages 1-33, April.
    40. Huang, Pei & Sun, Yongjun & Lovati, Marco & Zhang, Xingxing, 2021. "Solar-photovoltaic-power-sharing-based design optimization of distributed energy storage systems for performance improvements," Energy, Elsevier, vol. 222(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Han, Kunlun & Yang, Kai & Yin, Linfei, 2022. "Lightweight actor-critic generative adversarial networks for real-time smart generation control of microgrids," Applied Energy, Elsevier, vol. 317(C).
    2. Yin, Linfei & Zheng, Da, 2024. "Decomposition prediction fractional-order PID reinforcement learning for short-term smart generation control of integrated energy systems," Applied Energy, Elsevier, vol. 355(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yin, Linfei & Zhang, Bin, 2021. "Time series generative adversarial network controller for long-term smart generation control of microgrids," Applied Energy, Elsevier, vol. 281(C).
    2. Savolainen, Rebecka & Lahdelma, Risto, 2022. "Optimization of renewable energy for buildings with energy storages and 15-minute power balance," Energy, Elsevier, vol. 243(C).
    3. Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).
    4. Tawalbeh, Muhammad & Murtaza, Sana Z.M. & Al-Othman, Amani & Alami, Abdul Hai & Singh, Karnail & Olabi, Abdul Ghani, 2022. "Ammonia: A versatile candidate for the use in energy storage systems," Renewable Energy, Elsevier, vol. 194(C), pages 955-977.
    5. Yin, Linfei & Zhao, Lulin, 2021. "Rejectable deep differential dynamic programming for real-time integrated generation dispatch and control of micro-grids," Energy, Elsevier, vol. 225(C).
    6. Yin, Linfei & Zhang, Bin, 2023. "Relaxed deep generative adversarial networks for real-time economic smart generation dispatch and control of integrated energy systems," Applied Energy, Elsevier, vol. 330(PA).
    7. Mahfoud, Rabea Jamil & Alkayem, Nizar Faisal & Zhang, Yuquan & Zheng, Yuan & Sun, Yonghui & Alhelou, Hassan Haes, 2023. "Optimal operation of pumped hydro storage-based energy systems: A compendium of current challenges and future perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 178(C).
    8. Nielsen, Tore Bach & Lund, Henrik & Østergaard, Poul Alberg & Duic, Neven & Mathiesen, Brian Vad, 2021. "Perspectives on energy efficiency and smart energy systems from the 5th SESAAU2019 conference," Energy, Elsevier, vol. 216(C).
    9. Wu, Di & Wang, Dexin & Ramachandran, Thiagarajan & Holladay, Jamie, 2022. "A techno-economic assessment framework for hydrogen energy storage toward multiple energy delivery pathways and grid services," Energy, Elsevier, vol. 249(C).
    10. Ameen, Muhammad Tahir & Ma, Zhiwei & Smallbone, Andrew & Norman, Rose & Roskilly, Anthony Paul, 2023. "Demonstration system of pumped heat energy storage (PHES) and its round-trip efficiency," Applied Energy, Elsevier, vol. 333(C).
    11. Yin, Linfei & He, Xiaoyu, 2023. "Artificial emotional deep Q learning for real-time smart voltage control of cyber-physical social power systems," Energy, Elsevier, vol. 273(C).
    12. Toufani, Parinaz & Nadar, Emre & Kocaman, Ayse Selin, 2022. "Short-term assessment of pumped hydro energy storage configurations: Up, down, or closed?," Renewable Energy, Elsevier, vol. 201(P1), pages 1086-1095.
    13. Herc, Luka & Pfeifer, Antun & Duić, Neven & Wang, Fei, 2022. "Economic viability of flexibility options for smart energy systems with high penetration of renewable energy," Energy, Elsevier, vol. 252(C).
    14. Lopez-Ruiz, G. & Alava, I. & Blanco, J.M., 2021. "Study on the feasibility of the micromix combustion principle in low NOx H2 burners for domestic and industrial boilers: A numerical approach," Energy, Elsevier, vol. 236(C).
    15. Hilario J. Torres-Herrera & Alexis Lozano-Medina, 2021. "Methodological Proposal for the Assessment Potential of Pumped Hydropower Energy Storage: Case of Gran Canaria Island," Energies, MDPI, vol. 14(12), pages 1-27, June.
    16. Shuo Huang & Xinyu Wu & Yiyang Wu & Zheng Zhang, 2023. "Mid-Term Optimal Scheduling of Low-Head Cascaded Hydropower Stations Considering Inflow Unevenness," Energies, MDPI, vol. 16(17), pages 1-13, September.
    17. Li, Jing & Zuo, Wei & E, Jiaqiang & Zhang, Yuntian & Li, Qingqing & Sun, Ke & Zhou, Kun & Zhang, Guangde, 2022. "Multi-objective optimization of mini U-channel cold plate with SiO2 nanofluid by RSM and NSGA-II," Energy, Elsevier, vol. 242(C).
    18. Alammar, Ahmed A. & Rezk, Ahmed & Alaswad, Abed & Fernando, Julia & Olabi, A.G. & Decker, Stephanie & Ruhumuliza, Joseph & Gasana, Quénan, 2022. "The technical, economic, and environmental feasibility of a bioheat-driven adsorption cooling system for food cold storing: A case study of Rwanda," Energy, Elsevier, vol. 258(C).
    19. Zhu, Lingfeng & Wang, Yinshun & Guo, Yuetong & Liu, Wei & Hu, Chengyang, 2023. "Current decay and compensation of a closed-loop HTS magnet in non-uniform magnetic fields based on electro-magneto-thermal semi-analytical analysis," Energy, Elsevier, vol. 277(C).
    20. Abdul Ghani Olabi & Enas Taha Sayed & Tabbi Wilberforce & Aisha Jamal & Abdul Hai Alami & Khaled Elsaid & Shek Mohammod Atiqure Rahman & Sheikh Khaleduzzaman Shah & Mohammad Ali Abdelkareem, 2021. "Metal-Air Batteries—A Review," Energies, MDPI, vol. 14(21), pages 1-46, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:232:y:2021:i:c:s0360544221012123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.