A trustworthy reinforcement learning framework for autonomous control of a large-scale complex heating system: Simulation and field implementation
Author
Abstract
Suggested Citation
DOI: 10.1016/j.apenergy.2024.124815
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Lihan Chen & Lihong Xu & Ruihua Wei, 2023. "Energy-Saving Control Algorithm of Venlo Greenhouse Skylight and Wet Curtain Fan Based on Reinforcement Learning with Soft Action Mask," Agriculture, MDPI, vol. 13(1), pages 1-16, January.
- Kazmi, Hussain & Mehmood, Fahad & Lodeweyckx, Stefan & Driesen, Johan, 2018. "Gigawatt-hour scale savings on a budget of zero: Deep reinforcement learning based optimal control of hot water systems," Energy, Elsevier, vol. 144(C), pages 159-168.
- Henchoz, Samuel & Weber, Céline & Maréchal, François & Favrat, Daniel, 2015. "Performance and profitability perspectives of a CO2 based district energy network in Geneva's City Centre," Energy, Elsevier, vol. 85(C), pages 221-235.
- Lei, Yue & Zhan, Sicheng & Ono, Eikichi & Peng, Yuzhen & Zhang, Zhiang & Hasama, Takamasa & Chong, Adrian, 2022. "A practical deep reinforcement learning framework for multivariate occupant-centric control in buildings," Applied Energy, Elsevier, vol. 324(C).
- H. Kazmi & Fahad Mehmood & S. Lodeweyckx & J. Driesen, 2018. "Gigawatt-Hour Scale Savings on a Budget of Zero: Deep Reinforcement Learning Based Optimal Control of Hot Water Systems," Post-Print hal-04317815, HAL.
- Heidari, Amirreza & Maréchal, François & Khovalyg, Dolaana, 2022. "Reinforcement Learning for proactive operation of residential energy systems by learning stochastic occupant behavior and fluctuating solar energy: Balancing comfort, hygiene and energy use," Applied Energy, Elsevier, vol. 318(C).
- Langer, Lissy & Volling, Thomas, 2022. "A reinforcement learning approach to home energy management for modulating heat pumps and photovoltaic systems," Applied Energy, Elsevier, vol. 327(C).
- Gao, Yuan & Miyata, Shohei & Akashi, Yasunori, 2023. "Energy saving and indoor temperature control for an office building using tube-based robust model predictive control," Applied Energy, Elsevier, vol. 341(C).
- Suciu, Raluca & Girardin, Luc & Maréchal, François, 2018. "Energy integration of CO2 networks and power to gas for emerging energy autonomous cities in Europe," Energy, Elsevier, vol. 157(C), pages 830-842.
- Jonas Degrave & Federico Felici & Jonas Buchli & Michael Neunert & Brendan Tracey & Francesco Carpanese & Timo Ewalds & Roland Hafner & Abbas Abdolmaleki & Diego de las Casas & Craig Donner & Leslie F, 2022. "Magnetic control of tokamak plasmas through deep reinforcement learning," Nature, Nature, vol. 602(7897), pages 414-419, February.
- Naylor, Sophie & Gillott, Mark & Lau, Tom, 2018. "A review of occupant-centric building control strategies to reduce building energy use," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 1-10.
- David Silver & Aja Huang & Chris J. Maddison & Arthur Guez & Laurent Sifre & George van den Driessche & Julian Schrittwieser & Ioannis Antonoglou & Veda Panneershelvam & Marc Lanctot & Sander Dieleman, 2016. "Mastering the game of Go with deep neural networks and tree search," Nature, Nature, vol. 529(7587), pages 484-489, January.
- Heidari, Amirreza & Maréchal, François & Khovalyg, Dolaana, 2022. "An occupant-centric control framework for balancing comfort, energy use and hygiene in hot water systems: A model-free reinforcement learning approach," Applied Energy, Elsevier, vol. 312(C).
- Weber, Céline & Favrat, Daniel, 2010. "Conventional and advanced CO2 based district energy systems," Energy, Elsevier, vol. 35(12), pages 5070-5081.
- Blad, C. & Bøgh, S. & Kallesøe, C. & Raftery, Paul, 2023. "A laboratory test of an Offline-trained Multi-Agent Reinforcement Learning Algorithm for Heating Systems," Applied Energy, Elsevier, vol. 337(C).
- Kim, Hakpyeong & Hong, Taehoon, 2020. "Determining the optimal set-point temperature considering both labor productivity and energy saving in an office building," Applied Energy, Elsevier, vol. 276(C).
- Biemann, Marco & Scheller, Fabian & Liu, Xiufeng & Huang, Lizhen, 2021. "Experimental evaluation of model-free reinforcement learning algorithms for continuous HVAC control," Applied Energy, Elsevier, vol. 298(C).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Ayas Shaqour & Aya Hagishima, 2022. "Systematic Review on Deep Reinforcement Learning-Based Energy Management for Different Building Types," Energies, MDPI, vol. 15(22), pages 1-27, November.
- Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
- Keerthana Sivamayil & Elakkiya Rajasekar & Belqasem Aljafari & Srete Nikolovski & Subramaniyaswamy Vairavasundaram & Indragandhi Vairavasundaram, 2023. "A Systematic Study on Reinforcement Learning Based Applications," Energies, MDPI, vol. 16(3), pages 1-23, February.
- Ungar, Pietro & Schifflechner, Christopher & Wieland, Christoph & Spliethoff, Hartmut & Manfrida, Giampaolo, 2024. "Thermo-economic comparison of CO2 and water as a heat carrier for long-distance heat transport from geothermal sources: A Bavarian case study," Energy, Elsevier, vol. 298(C).
- Gao, Yuan & Matsunami, Yuki & Miyata, Shohei & Akashi, Yasunori, 2022. "Multi-agent reinforcement learning dealing with hybrid action spaces: A case study for off-grid oriented renewable building energy system," Applied Energy, Elsevier, vol. 326(C).
- Yin, Linfei & Xiong, Yi, 2024. "Fast-apply deep autoregressive recurrent proximal policy optimization for controlling hot water systems," Applied Energy, Elsevier, vol. 367(C).
- Panagiotis Michailidis & Iakovos Michailidis & Dimitrios Vamvakas & Elias Kosmatopoulos, 2023. "Model-Free HVAC Control in Buildings: A Review," Energies, MDPI, vol. 16(20), pages 1-45, October.
- Huang, Ruchen & He, Hongwen & Gao, Miaojue, 2023. "Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning framework," Applied Energy, Elsevier, vol. 346(C).
- Zhang, Bin & Hu, Weihao & Ghias, Amer M.Y.M. & Xu, Xiao & Chen, Zhe, 2022. "Multi-agent deep reinforcement learning-based coordination control for grid-aware multi-buildings," Applied Energy, Elsevier, vol. 328(C).
- Zhang, Yiwen & Lin, Rui & Mei, Zhen & Lyu, Minghao & Jiang, Huaiguang & Xue, Ying & Zhang, Jun & Gao, David Wenzhong, 2024. "Interior-point policy optimization based multi-agent deep reinforcement learning method for secure home energy management under various uncertainties," Applied Energy, Elsevier, vol. 376(PA).
- Wang, Xuezheng & Dong, Bing, 2024. "Long-term experimental evaluation and comparison of advanced controls for HVAC systems," Applied Energy, Elsevier, vol. 371(C).
- Weifan Long & Taixian Hou & Xiaoyi Wei & Shichao Yan & Peng Zhai & Lihua Zhang, 2023. "A Survey on Population-Based Deep Reinforcement Learning," Mathematics, MDPI, vol. 11(10), pages 1-17, May.
- Nagano, Takahiro & Kajita, Jungo & Yoshida, Akira & Amano, Yoshiharu, 2021. "Estimation of the utility value of unused heat sources for a CO2 network system in Tokyo," Energy, Elsevier, vol. 226(C).
- Mooyoung Yoo, 2024. "Development of Energy Efficient Domestic Hot Water Loop System Integrated with a Chilled Water Plant in Commercial Building," Sustainability, MDPI, vol. 17(1), pages 1-16, December.
- Zhou, Xinlei & Du, Han & Xue, Shan & Ma, Zhenjun, 2024. "Recent advances in data mining and machine learning for enhanced building energy management," Energy, Elsevier, vol. 307(C).
- Yan, Biao & Yang, Wansheng & He, Fuquan & Zeng, Wenhao, 2023. "Occupant behavior impact in buildings and the artificial intelligence-based techniques and data-driven approach solutions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
- Shen, Rendong & Zhong, Shengyuan & Wen, Xin & An, Qingsong & Zheng, Ruifan & Li, Yang & Zhao, Jun, 2022. "Multi-agent deep reinforcement learning optimization framework for building energy system with renewable energy," Applied Energy, Elsevier, vol. 312(C).
- Henchoz, Samuel & Chatelan, Patrick & Maréchal, François & Favrat, Daniel, 2016. "Key energy and technological aspects of three innovative concepts of district energy networks," Energy, Elsevier, vol. 117(P2), pages 465-477.
- Raluca Suciu & Paul Stadler & Ivan Kantor & Luc Girardin & François Maréchal, 2019. "Systematic Integration of Energy-Optimal Buildings With District Networks," Energies, MDPI, vol. 12(15), pages 1-38, July.
- Heidari, Amirreza & Maréchal, François & Khovalyg, Dolaana, 2022. "Reinforcement Learning for proactive operation of residential energy systems by learning stochastic occupant behavior and fluctuating solar energy: Balancing comfort, hygiene and energy use," Applied Energy, Elsevier, vol. 318(C).
More about this item
Keywords
Deep Reinforcement Learning; Soft actor–critic; Maskable Proximal Policy Optimization; HVAC; Building energy management; Field implementation;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:378:y:2025:i:pa:s0306261924021986. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.