Optimal operation and maintenance of energy storage systems in grid-connected microgrids by deep reinforcement learning
Author
Abstract
Suggested Citation
DOI: 10.1016/j.apenergy.2023.121947
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Hector Beltran & Pablo Ayuso & Emilio Pérez, 2020. "Lifetime Expectancy of Li-Ion Batteries used for Residential Solar Storage," Energies, MDPI, vol. 13(3), pages 1-18, January.
- Hossain, Md Alamgir & Pota, Hemanshu Roy & Squartini, Stefano & Abdou, Ahmed Fathi, 2019. "Modified PSO algorithm for real-time energy management in grid-connected microgrids," Renewable Energy, Elsevier, vol. 136(C), pages 746-757.
- Kuznetsova, Elizaveta & Li, Yan-Fu & Ruiz, Carlos & Zio, Enrico & Ault, Graham & Bell, Keith, 2013. "Reinforcement learning for microgrid energy management," Energy, Elsevier, vol. 59(C), pages 133-146.
- Xuejie Wang & Yanchao Ji & Jianze Wang & Yuanjun Wang & Lei Qi, 2020. "Optimal energy management of microgrid based on multi-parameter dynamic programming," International Journal of Distributed Sensor Networks, , vol. 16(6), pages 15501477209, June.
- Wang, Shuoqi & Guo, Dongxu & Han, Xuebing & Lu, Languang & Sun, Kai & Li, Weihan & Sauer, Dirk Uwe & Ouyang, Minggao, 2020. "Impact of battery degradation models on energy management of a grid-connected DC microgrid," Energy, Elsevier, vol. 207(C).
- Comodi, Gabriele & Giantomassi, Andrea & Severini, Marco & Squartini, Stefano & Ferracuti, Francesco & Fonti, Alessandro & Nardi Cesarini, Davide & Morodo, Matteo & Polonara, Fabio, 2015. "Multi-apartment residential microgrid with electrical and thermal storage devices: Experimental analysis and simulation of energy management strategies," Applied Energy, Elsevier, vol. 137(C), pages 854-866.
- Hu, Ming-Che & Lu, Su-Ying & Chen, Yen-Haw, 2016. "Stochastic programming and market equilibrium analysis of microgrids energy management systems," Energy, Elsevier, vol. 113(C), pages 662-670.
- Saberi-Beglar, Kasra & Zare, Kazem & Seyedi, Heresh & Marzband, Mousa & Nojavan, Sayyad, 2023. "Risk-embedded scheduling of a CCHP integrated with electric vehicle parking lot in a residential energy hub considering flexible thermal and electrical loads," Applied Energy, Elsevier, vol. 329(C).
- Guo, Chenyu & Wang, Xin & Zheng, Yihui & Zhang, Feng, 2022. "Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
- Jafari, Mohammad & Malekjamshidi, Zahra, 2020. "Optimal energy management of a residential-based hybrid renewable energy system using rule-based real-time control and 2D dynamic programming optimization method," Renewable Energy, Elsevier, vol. 146(C), pages 254-266.
- Khawaja Haider Ali & Marvin Sigalo & Saptarshi Das & Enrico Anderlini & Asif Ali Tahir & Mohammad Abusara, 2021. "Reinforcement Learning for Energy-Storage Systems in Grid-Connected Microgrids: An Investigation of Online vs. Offline Implementation," Energies, MDPI, vol. 14(18), pages 1-18, September.
- Velik, Rosemarie & Nicolay, Pascal, 2014. "Grid-price-dependent energy management in microgrids using a modified simulated annealing triple-optimizer," Applied Energy, Elsevier, vol. 130(C), pages 384-395.
- Christer, A. H. & Wang, W., 1995. "A simple condition monitoring model for a direct monitoring process," European Journal of Operational Research, Elsevier, vol. 82(2), pages 258-269, April.
- Zia, Muhammad Fahad & Elbouchikhi, Elhoussin & Benbouzid, Mohamed, 2018. "Microgrids energy management systems: A critical review on methods, solutions, and prospects," Applied Energy, Elsevier, vol. 222(C), pages 1033-1055.
- Matti Koivisto & Kaushik Das & Feng Guo & Poul Sørensen & Edgar Nuño & Nicolaos Cutululis & Petr Maule, 2019. "Using time series simulation tools for assessing the effects of variable renewable energy generation on power and energy systems," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 8(3), May.
- Guodong Liu & Thomas B. Ollis & Maximiliano F. Ferrari & Aditya Sundararajan & Kevin Tomsovic, 2022. "Robust Scheduling of Networked Microgrids for Economics and Resilience Improvement," Energies, MDPI, vol. 15(6), pages 1-19, March.
- Dey, Bishwajit & Misra, Srikant & Garcia Marquez, Fausto Pedro, 2023. "Microgrid system energy management with demand response program for clean and economical operation," Applied Energy, Elsevier, vol. 334(C).
- Grace Muriithi & Sunetra Chowdhury, 2021. "Optimal Energy Management of a Grid-Tied Solar PV-Battery Microgrid: A Reinforcement Learning Approach," Energies, MDPI, vol. 14(9), pages 1-24, May.
- Aghdam, Farid Hamzeh & Mudiyanselage, Manthila Wijesooriya & Mohammadi-Ivatloo, Behnam & Marzband, Mousa, 2023. "Optimal scheduling of multi-energy type virtual energy storage system in reconfigurable distribution networks for congestion management," Applied Energy, Elsevier, vol. 333(C).
- Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
- Zhipeng Liang & Hao Chen & Junhao Zhu & Kangkang Jiang & Yanran Li, 2018. "Adversarial Deep Reinforcement Learning in Portfolio Management," Papers 1808.09940, arXiv.org, revised Nov 2018.
- Pinciroli, Luca & Baraldi, Piero & Zio, Enrico, 2023. "Maintenance optimization in industry 4.0," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
- Pascual, Julio & Barricarte, Javier & Sanchis, Pablo & Marroyo, Luis, 2015. "Energy management strategy for a renewable-based residential microgrid with generation and demand forecasting," Applied Energy, Elsevier, vol. 158(C), pages 12-25.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- de la Hoz, Jordi & Martín, Helena & Alonso, Alex & Carolina Luna, Adriana & Matas, José & Vasquez, Juan C. & Guerrero, Josep M., 2019. "Regulatory-framework-embedded energy management system for microgrids: The case study of the Spanish self-consumption scheme," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
- Zia, Muhammad Fahad & Elbouchikhi, Elhoussin & Benbouzid, Mohamed, 2018. "Microgrids energy management systems: A critical review on methods, solutions, and prospects," Applied Energy, Elsevier, vol. 222(C), pages 1033-1055.
- Sadaqat Ali & Zhixue Zheng & Michel Aillerie & Jean-Paul Sawicki & Marie-Cécile Péra & Daniel Hissel, 2021. "A Review of DC Microgrid Energy Management Systems Dedicated to Residential Applications," Energies, MDPI, vol. 14(14), pages 1-26, July.
- Fontenot, Hannah & Dong, Bing, 2019. "Modeling and control of building-integrated microgrids for optimal energy management – A review," Applied Energy, Elsevier, vol. 254(C).
- Álex Omar Topa Gavilema & José Domingo Álvarez & José Luis Torres Moreno & Manuel Pérez García, 2021. "Towards Optimal Management in Microgrids: An Overview," Energies, MDPI, vol. 14(16), pages 1-25, August.
- Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
- Ahmad Khan, Aftab & Naeem, Muhammad & Iqbal, Muhammad & Qaisar, Saad & Anpalagan, Alagan, 2016. "A compendium of optimization objectives, constraints, tools and algorithms for energy management in microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 58(C), pages 1664-1683.
- Weitzel, Timm & Glock, Christoph H., 2018. "Energy management for stationary electric energy storage systems: A systematic literature review," European Journal of Operational Research, Elsevier, vol. 264(2), pages 582-606.
- Pascual, Julio & Arcos-Aviles, Diego & Ursúa, Alfredo & Sanchis, Pablo & Marroyo, Luis, 2021. "Energy management for an electro-thermal renewable–based residential microgrid with energy balance forecasting and demand side management," Applied Energy, Elsevier, vol. 295(C).
- Yamashita, Daniela Yassuda & Vechiu, Ionel & Gaubert, Jean-Paul, 2020. "A review of hierarchical control for building microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 118(C).
- Zhang, Bin & Hu, Weihao & Xu, Xiao & Li, Tao & Zhang, Zhenyuan & Chen, Zhe, 2022. "Physical-model-free intelligent energy management for a grid-connected hybrid wind-microturbine-PV-EV energy system via deep reinforcement learning approach," Renewable Energy, Elsevier, vol. 200(C), pages 433-448.
- Solanke, Tirupati U. & Khatua, Pradeep K. & Ramachandaramurthy, Vigna K. & Yong, Jia Ying & Tan, Kang Miao, 2021. "Control and management of a multilevel electric vehicles infrastructure integrated with distributed resources: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
- Sreedharan, P. & Farbes, J. & Cutter, E. & Woo, C.K. & Wang, J., 2016. "Microgrid and renewable generation integration: University of California, San Diego," Applied Energy, Elsevier, vol. 169(C), pages 709-720.
- Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
- Md Mainul Islam & Mahmood Nagrial & Jamal Rizk & Ali Hellany, 2021. "General Aspects, Islanding Detection, and Energy Management in Microgrids: A Review," Sustainability, MDPI, vol. 13(16), pages 1-45, August.
- Oussama Ouramdane & Elhoussin Elbouchikhi & Yassine Amirat & Ehsan Sedgh Gooya, 2021. "Optimal Sizing and Energy Management of Microgrids with Vehicle-to-Grid Technology: A Critical Review and Future Trends," Energies, MDPI, vol. 14(14), pages 1-45, July.
- Muhammad Salman Sami & Muhammad Abrar & Rizwan Akram & Muhammad Majid Hussain & Mian Hammad Nazir & Muhammad Saad Khan & Safdar Raza, 2021. "Energy Management of Microgrids for Smart Cities: A Review," Energies, MDPI, vol. 14(18), pages 1-18, September.
- Nyong-Bassey, Bassey Etim & Giaouris, Damian & Patsios, Charalampos & Papadopoulou, Simira & Papadopoulos, Athanasios I. & Walker, Sara & Voutetakis, Spyros & Seferlis, Panos & Gadoue, Shady, 2020. "Reinforcement learning based adaptive power pinch analysis for energy management of stand-alone hybrid energy storage systems considering uncertainty," Energy, Elsevier, vol. 193(C).
- Lu, Yu & Xiang, Yue & Huang, Yuan & Yu, Bin & Weng, Liguo & Liu, Junyong, 2023. "Deep reinforcement learning based optimal scheduling of active distribution system considering distributed generation, energy storage and flexible load," Energy, Elsevier, vol. 271(C).
- Yang, Ting & Zhao, Liyuan & Li, Wei & Zomaya, Albert Y., 2021. "Dynamic energy dispatch strategy for integrated energy system based on improved deep reinforcement learning," Energy, Elsevier, vol. 235(C).
More about this item
Keywords
Microgrid; Energy storage systems; Operation and maintenance; Optimization; Deep reinforcement learning;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:352:y:2023:i:c:s0306261923013119. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.