Improving real-time energy decision-making model with an actor-critic agent in modern microgrids with energy storage devices
Author
Abstract
Suggested Citation
DOI: 10.1016/j.energy.2022.126105
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Tooryan, Fatemeh & HassanzadehFard, Hamid & Collins, Edward R. & Jin, Shuangshuang & Ramezani, Bahram, 2020. "Smart integration of renewable energy resources, electrical, and thermal energy storage in microgrid applications," Energy, Elsevier, vol. 212(C).
- Hao, Ran & Lu, Tianguang & Ai, Qian & Wang, Zhe & Wang, Xiaolong, 2020. "Distributed online learning and dynamic robust standby dispatch for networked microgrids," Applied Energy, Elsevier, vol. 274(C).
- Iris, Çağatay & Lam, Jasmine Siu Lee, 2021. "Optimal energy management and operations planning in seaports with smart grid while harnessing renewable energy under uncertainty," Omega, Elsevier, vol. 103(C).
- Sunyong Kim & Hyuk Lim, 2018. "Reinforcement Learning Based Energy Management Algorithm for Smart Energy Buildings," Energies, MDPI, vol. 11(8), pages 1-19, August.
- Seongwoo Lee & Joonho Seon & Chanuk Kyeong & Soohyun Kim & Youngghyu Sun & Jinyoung Kim, 2021. "Novel Energy Trading System Based on Deep-Reinforcement Learning in Microgrids," Energies, MDPI, vol. 14(17), pages 1-14, September.
- Brida V. Mbuwir & Frederik Ruelens & Fred Spiessens & Geert Deconinck, 2017. "Battery Energy Management in a Microgrid Using Batch Reinforcement Learning," Energies, MDPI, vol. 10(11), pages 1-19, November.
- MansourLakouraj, Mohammad & Shahabi, Majid & Shafie-khah, Miadreza & Catalão, João P.S., 2022. "Optimal market-based operation of microgrid with the integration of wind turbines, energy storage system and demand response resources," Energy, Elsevier, vol. 239(PB).
- Ferahtia, Seydali & Djeroui, Ali & Rezk, Hegazy & Houari, Azeddine & Zeghlache, Samir & Machmoum, Mohamed, 2022. "Optimal control and implementation of energy management strategy for a DC microgrid," Energy, Elsevier, vol. 238(PB).
- Guo, Jiacheng & Zhang, Peiwen & Wu, Di & Liu, Zhijian & Liu, Xuan & Zhang, Shicong & Yang, Xinyan & Ge, Hua, 2022. "Multi-objective optimization design and multi-attribute decision-making method of a distributed energy system based on nearly zero-energy community load forecasting," Energy, Elsevier, vol. 239(PC).
- Perera, A.T.D. & Kamalaruban, Parameswaran, 2021. "Applications of reinforcement learning in energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 137(C).
- Yang, Kang & Li, Chunhua & Jing, Xu & Zhu, Zhiyu & Wang, Yuting & Ma, Haodong & Zhang, Yu, 2022. "Energy dispatch optimization of islanded multi-microgrids based on symbiotic organisms search and improved multi-agent consensus algorithm," Energy, Elsevier, vol. 239(PC).
- Zhu, Junjie & Huang, Shengjun & Liu, Yajie & Lei, Hongtao & Sang, Bo, 2021. "Optimal energy management for grid-connected microgrids via expected-scenario-oriented robust optimization," Energy, Elsevier, vol. 216(C).
- Ying Ji & Jianhui Wang & Jiacan Xu & Xiaoke Fang & Huaguang Zhang, 2019. "Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning," Energies, MDPI, vol. 12(12), pages 1-21, June.
- Zhao Luo & Wei Gu & Yong Sun & Xiang Yin & Yiyuan Tang & Xiaodong Yuan, 2016. "Performance Analysis of the Combined Operation of Interconnected-BCCHP Microgrids in China," Sustainability, MDPI, vol. 8(10), pages 1-20, September.
- Guo, Chenyu & Wang, Xin & Zheng, Yihui & Zhang, Feng, 2022. "Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
- Yang, Ting & Zhao, Liyuan & Li, Wei & Zomaya, Albert Y., 2021. "Dynamic energy dispatch strategy for integrated energy system based on improved deep reinforcement learning," Energy, Elsevier, vol. 235(C).
- Wang, Hao-ran & Feng, Tian-tian & Xiong, Wei, 2022. "How can the dynamic game be integrated into blockchain-based distributed energy resources multi-agent transactions for decision-making?," Energy, Elsevier, vol. 254(PB).
- Gomes, I.L.R. & Melicio, R. & Mendes, V.M.F., 2021. "A novel microgrid support management system based on stochastic mixed-integer linear programming," Energy, Elsevier, vol. 223(C).
- Zia, Muhammad Fahad & Elbouchikhi, Elhoussin & Benbouzid, Mohamed, 2018. "Microgrids energy management systems: A critical review on methods, solutions, and prospects," Applied Energy, Elsevier, vol. 222(C), pages 1033-1055.
- Shams, Mohammad H. & Shahabi, Majid & Kia, Mohsen & Heidari, Alireza & Lotfi, Mohamed & Shafie-khah, Miadreza & Catalão, João P.S., 2019. "Optimal operation of electrical and thermal resources in microgrids with energy hubs considering uncertainties," Energy, Elsevier, vol. 187(C).
- Guanglin Zhang & Yu Cao & Yongsheng Cao & Demin Li & Lin Wang, 2017. "Optimal Energy Management for Microgrids with Combined Heat and Power (CHP) Generation, Energy Storages, and Renewable Energy Sources," Energies, MDPI, vol. 10(9), pages 1-18, August.
- Naghikhani, Ali & Hosseini, Seyed Mohammad Hassan, 2022. "Optimal thermal and power planning considering economic and environmental issues in peak load management," Energy, Elsevier, vol. 239(PA).
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Guo, Tianyu & Guo, Qi & Huang, Libin & Guo, Haiping & Lu, Yuanhong & Tu, Liang, 2023. "Microgrid source-network-load-storage master-slave game optimization method considering the energy storage overcharge/overdischarge risk," Energy, Elsevier, vol. 282(C).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
- Grace Muriithi & Sunetra Chowdhury, 2021. "Optimal Energy Management of a Grid-Tied Solar PV-Battery Microgrid: A Reinforcement Learning Approach," Energies, MDPI, vol. 14(9), pages 1-24, May.
- Lilia Tightiz & Joon Yoo, 2022. "A Review on a Data-Driven Microgrid Management System Integrating an Active Distribution Network: Challenges, Issues, and New Trends," Energies, MDPI, vol. 15(22), pages 1-24, November.
- Ritu Kandari & Neeraj Neeraj & Alexander Micallef, 2022. "Review on Recent Strategies for Integrating Energy Storage Systems in Microgrids," Energies, MDPI, vol. 16(1), pages 1-24, December.
- Khawaja Haider Ali & Mohammad Abusara & Asif Ali Tahir & Saptarshi Das, 2023. "Dual-Layer Q-Learning Strategy for Energy Management of Battery Storage in Grid-Connected Microgrids," Energies, MDPI, vol. 16(3), pages 1-17, January.
- Zhou, Yanting & Ma, Zhongjing & Zhang, Jinhui & Zou, Suli, 2022. "Data-driven stochastic energy management of multi energy system using deep reinforcement learning," Energy, Elsevier, vol. 261(PA).
- Soleimanzade, Mohammad Amin & Kumar, Amit & Sadrzadeh, Mohtada, 2022. "Novel data-driven energy management of a hybrid photovoltaic-reverse osmosis desalination system using deep reinforcement learning," Applied Energy, Elsevier, vol. 317(C).
- Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
- Fathy, Ahmed & Ferahtia, Seydali & Rezk, Hegazy & Yousri, Dalia & Abdelkareem, Mohammad Ali & Olabi, A.G., 2022. "Optimal adaptive fuzzy management strategy for fuel cell-based DC microgrid," Energy, Elsevier, vol. 247(C).
- Khawaja Haider Ali & Marvin Sigalo & Saptarshi Das & Enrico Anderlini & Asif Ali Tahir & Mohammad Abusara, 2021. "Reinforcement Learning for Energy-Storage Systems in Grid-Connected Microgrids: An Investigation of Online vs. Offline Implementation," Energies, MDPI, vol. 14(18), pages 1-18, September.
- Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
- Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
- Álex Omar Topa Gavilema & José Domingo Álvarez & José Luis Torres Moreno & Manuel Pérez García, 2021. "Towards Optimal Management in Microgrids: An Overview," Energies, MDPI, vol. 14(16), pages 1-25, August.
- Ferahtia, Seydali & Rezk, Hegazy & Abdelkareem, Mohammad Ali & Olabi, A.G., 2022. "Optimal techno-economic energy management strategy for building’s microgrids based bald eagle search optimization algorithm," Applied Energy, Elsevier, vol. 306(PB).
- Àlex Alonso-Travesset & Helena Martín & Sergio Coronas & Jordi de la Hoz, 2022. "Optimization Models under Uncertainty in Distributed Generation Systems: A Review," Energies, MDPI, vol. 15(5), pages 1-40, March.
- Alqahtani, Mohammed & Hu, Mengqi, 2022. "Dynamic energy scheduling and routing of multiple electric vehicles using deep reinforcement learning," Energy, Elsevier, vol. 244(PA).
- Alexander N. Kozlov & Nikita V. Tomin & Denis N. Sidorov & Electo E. S. Lora & Victor G. Kurbatsky, 2020. "Optimal Operation Control of PV-Biomass Gasifier-Diesel-Hybrid Systems Using Reinforcement Learning Techniques," Energies, MDPI, vol. 13(10), pages 1-20, May.
- Pinciroli, Luca & Baraldi, Piero & Compare, Michele & Zio, Enrico, 2023. "Optimal operation and maintenance of energy storage systems in grid-connected microgrids by deep reinforcement learning," Applied Energy, Elsevier, vol. 352(C).
- Zhu, Dafeng & Yang, Bo & Liu, Yuxiang & Wang, Zhaojian & Ma, Kai & Guan, Xinping, 2022. "Energy management based on multi-agent deep reinforcement learning for a multi-energy industrial park," Applied Energy, Elsevier, vol. 311(C).
- Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).
More about this item
Keywords
Actor-critic; Reinforcement learning; Linear programming; Microgrid; Energy management system; Power flow;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:263:y:2023:i:pe:s0360544222029917. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.