Bidding a Battery on Electricity Markets and Minimizing Battery Aging Costs: A Reinforcement Learning Approach
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Niko Karhula & Seppo Sierla & Valeriy Vyatkin, 2021. "Validating the Real-Time Performance of Distributed Energy Resources Participating on Primary Frequency Reserves," Energies, MDPI, vol. 14(21), pages 1-19, October.
- Kempitiya, Thimal & Sierla, Seppo & De Silva, Daswin & Yli-Ojanperä, Matti & Alahakoon, Damminda & Vyatkin, Valeriy, 2020. "An Artificial Intelligence framework for bidding optimization with uncertainty in multiple frequency reserve markets," Applied Energy, Elsevier, vol. 280(C).
- Beltrán, Sergio & Castro, Alain & Irizar, Ion & Naveran, Gorka & Yeregui, Imanol, 2022. "Framework for collaborative intelligence in forecasting day-ahead electricity price," Applied Energy, Elsevier, vol. 306(PA).
- Evgeny Nefedov & Seppo Sierla & Valeriy Vyatkin, 2018. "Internet of Energy Approach for Sustainable Use of Electric Vehicles as Energy Storage of Prosumer Buildings," Energies, MDPI, vol. 11(8), pages 1-18, August.
- Hua, Haochen & Qin, Yuchao & Hao, Chuantong & Cao, Junwei, 2019. "Optimal energy management strategies for energy Internet via deep reinforcement learning approach," Applied Energy, Elsevier, vol. 239(C), pages 598-609.
- Sachin Kahawala & Daswin De Silva & Seppo Sierla & Damminda Alahakoon & Rashmika Nawaratne & Evgeny Osipov & Andrew Jennings & Valeriy Vyatkin, 2021. "Robust Multi-Step Predictor for Electricity Markets with Real-Time Pricing," Energies, MDPI, vol. 14(14), pages 1-20, July.
- Harri Aaltonen & Seppo Sierla & Rakshith Subramanya & Valeriy Vyatkin, 2021. "A Simulation Environment for Training a Reinforcement Learning Agent Trading a Battery Storage," Energies, MDPI, vol. 14(17), pages 1-20, September.
- Piotr F. Borowski, 2020. "Zonal and Nodal Models of Energy Market in European Union," Energies, MDPI, vol. 13(16), pages 1-21, August.
- Omar, Noshin & Monem, Mohamed Abdel & Firouz, Yousef & Salminen, Justin & Smekens, Jelle & Hegazy, Omar & Gaulous, Hamid & Mulder, Grietus & Van den Bossche, Peter & Coosemans, Thierry & Van Mierlo, J, 2014. "Lithium iron phosphate based battery – Assessment of the aging parameters and development of cycle life model," Applied Energy, Elsevier, vol. 113(C), pages 1575-1585.
- Yang, Ting & Zhao, Liyuan & Li, Wei & Zomaya, Albert Y., 2021. "Dynamic energy dispatch strategy for integrated energy system based on improved deep reinforcement learning," Energy, Elsevier, vol. 235(C).
- Grace Muriithi & Sunetra Chowdhury, 2021. "Optimal Energy Management of a Grid-Tied Solar PV-Battery Microgrid: A Reinforcement Learning Approach," Energies, MDPI, vol. 14(9), pages 1-24, May.
- Christian Giovanelli & Seppo Sierla & Ryutaro Ichise & Valeriy Vyatkin, 2018. "Exploiting Artificial Neural Networks for the Prediction of Ancillary Energy Market Prices," Energies, MDPI, vol. 11(7), pages 1-22, July.
- Zhou, Jianhao & Xue, Siwu & Xue, Yuan & Liao, Yuhui & Liu, Jun & Zhao, Wanzhong, 2021. "A novel energy management strategy of hybrid electric vehicle via an improved TD3 deep reinforcement learning," Energy, Elsevier, vol. 224(C).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Harri Aaltonen & Seppo Sierla & Rakshith Subramanya & Valeriy Vyatkin, 2021. "A Simulation Environment for Training a Reinforcement Learning Agent Trading a Battery Storage," Energies, MDPI, vol. 14(17), pages 1-20, September.
- Rakshith Subramanya & Matti Yli-Ojanperä & Seppo Sierla & Taneli Hölttä & Jori Valtakari & Valeriy Vyatkin, 2021. "A Virtual Power Plant Solution for Aggregating Photovoltaic Systems and Other Distributed Energy Resources for Northern European Primary Frequency Reserves," Energies, MDPI, vol. 14(5), pages 1-23, February.
- Fathy, Ahmed, 2023. "Bald eagle search optimizer-based energy management strategy for microgrid with renewable sources and electric vehicles," Applied Energy, Elsevier, vol. 334(C).
- Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
- Zhang, Bin & Wu, Xuewei & Ghias, Amer M.Y.M. & Chen, Zhe, 2023. "Coordinated carbon capture systems and power-to-gas dynamic economic energy dispatch strategy for electricity–gas coupled systems considering system uncertainty: An improved soft actor–critic approach," Energy, Elsevier, vol. 271(C).
- Zhou, Yanting & Ma, Zhongjing & Zhang, Jinhui & Zou, Suli, 2022. "Data-driven stochastic energy management of multi energy system using deep reinforcement learning," Energy, Elsevier, vol. 261(PA).
- Gideon Ude Nnachi & Yskandar Hamam & Coneth Graham Richards, 2022. "Appraising the Optimal Power Flow and Generation Capacity in Existing Power Grid Topology with Increase in Energy Demand," Energies, MDPI, vol. 15(7), pages 1-23, March.
- Yin, Linfei & Qiu, Yao, 2022. "Neural network dynamic differential control for long-term price guidance mechanism of flexible energy service providers," Energy, Elsevier, vol. 255(C).
- Niko Karhula & Seppo Sierla & Valeriy Vyatkin, 2021. "Validating the Real-Time Performance of Distributed Energy Resources Participating on Primary Frequency Reserves," Energies, MDPI, vol. 14(21), pages 1-19, October.
- Xue, Lin & Wang, Jianxue & Zhang, Yao & Yong, Weizhen & Qi, Jie & Li, Haotian, 2023. "Model-data-event based community integrated energy system low-carbon economic scheduling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
- Berecibar, M. & Gandiaga, I. & Villarreal, I. & Omar, N. & Van Mierlo, J. & Van den Bossche, P., 2016. "Critical review of state of health estimation methods of Li-ion batteries for real applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 56(C), pages 572-587.
- Ayman Al-Quraan & Muhannad Al-Qaisi, 2021. "Modelling, Design and Control of a Standalone Hybrid PV-Wind Micro-Grid System," Energies, MDPI, vol. 14(16), pages 1-23, August.
- Yi, Zonggen & Luo, Yusheng & Westover, Tyler & Katikaneni, Sravya & Ponkiya, Binaka & Sah, Suba & Mahmud, Sadab & Raker, David & Javaid, Ahmad & Heben, Michael J. & Khanna, Raghav, 2022. "Deep reinforcement learning based optimization for a tightly coupled nuclear renewable integrated energy system," Applied Energy, Elsevier, vol. 328(C).
- Ester Vasta & Tommaso Scimone & Giovanni Nobile & Otto Eberhardt & Daniele Dugo & Massimiliano Maurizio De Benedetti & Luigi Lanuzza & Giuseppe Scarcella & Luca Patanè & Paolo Arena & Mario Cacciato, 2023. "Models for Battery Health Assessment: A Comparative Evaluation," Energies, MDPI, vol. 16(2), pages 1-34, January.
- Zhu, Jiaoyiling & Hu, Weihao & Xu, Xiao & Liu, Haoming & Pan, Li & Fan, Haoyang & Zhang, Zhenyuan & Chen, Zhe, 2022. "Optimal scheduling of a wind energy dominated distribution network via a deep reinforcement learning approach," Renewable Energy, Elsevier, vol. 201(P1), pages 792-801.
- Sun, Li & Walker, Paul & Feng, Kaiwu & Zhang, Nong, 2018. "Multi-objective component sizing for a battery-supercapacitor power supply considering the use of a power converter," Energy, Elsevier, vol. 142(C), pages 436-446.
- Zhang, Yijie & Ma, Tao & Elia Campana, Pietro & Yamaguchi, Yohei & Dai, Yanjun, 2020. "A techno-economic sizing method for grid-connected household photovoltaic battery systems," Applied Energy, Elsevier, vol. 269(C).
- Ma, Jian & Xu, Shu & Shang, Pengchao & ding, Yu & Qin, Weili & Cheng, Yujie & Lu, Chen & Su, Yuzhuan & Chong, Jin & Jin, Haizu & Lin, Yongshou, 2020. "Cycle life test optimization for different Li-ion power battery formulations using a hybrid remaining-useful-life prediction method," Applied Energy, Elsevier, vol. 262(C).
- Ahmad, Tanveer & Chen, Huanxin, 2019. "Deep learning for multi-scale smart energy forecasting," Energy, Elsevier, vol. 175(C), pages 98-112.
- Gao, Sichen & Zong, Yuhua & Ju, Fei & Wang, Qun & Huo, Weiwei & Wang, Liangmo & Wang, Tao, 2024. "Scenario-oriented adaptive ECMS using speed prediction for fuel cell vehicles in real-world driving," Energy, Elsevier, vol. 304(C).
More about this item
Keywords
battery storage; reinforcement learning; machine learning; primary frequency reserve; frequency containment reserve; simulation;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:14:p:4960-:d:857302. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.