IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v371y2024ics0306261924010894.html
   My bibliography  Save this article

Long-term experimental evaluation and comparison of advanced controls for HVAC systems

Author

Listed:
  • Wang, Xuezheng
  • Dong, Bing

Abstract

The tremendous energy usage from buildings leads to research studies on their improvement, among which advanced building control plays an important role. In advanced building controls, data-driven predictive control (DDPC), differentiable predictive control (DPC), and reinforcement learning (RL) have shown advantages, but their comparison often lacks in existing studies. The simulation-based prior comparison studies have inconsistent results due to different assumptions and simplifications. Therefore, to comprehensively compare the three advanced strategies for real-time building HVAC controls, we implemented DDPC, specifically, hierarchical DDPC (HDDPC), DPC, and RL in a real building testbed for more than 5 months. The results show that all three advanced controls maintained the indoor environmental quality (IEQ) cost-effectively. Overall, HDDPC outperformed the baseline control with more than 50% energy savings, followed by RL with 48%, and DPC with 30.6%. Most control failures were related to API communication issues. Besides, the information gaps between room and system level controllers and non-optimal control decisions will degrade HDDPC's performance. Such degradation did not happen in DPC and RL, which led to better performance of agent-based control over HDDPC. Moreover, HDDPC needs minutes to make control decisions whereas DPC and RL need milliseconds, indicating higher online computing resources required by HDDPC. For agent training, DPC is faster than RL, as DPC training needs minutes and RL needs hours, but its performance is not as good as RL. This study provides a comprehensive understanding and assessment of the pros and cons of advanced building controls and sheds light on future research on building controls.

Suggested Citation

  • Wang, Xuezheng & Dong, Bing, 2024. "Long-term experimental evaluation and comparison of advanced controls for HVAC systems," Applied Energy, Elsevier, vol. 371(C).
    • Handle: RePEc:eee:appene:v:371:y:2024:i:c:s0306261924010894
    DOI: 10.1016/j.apenergy.2024.123706
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924010894
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.123706?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lei, Yue & Zhan, Sicheng & Ono, Eikichi & Peng, Yuzhen & Zhang, Zhiang & Hasama, Takamasa & Chong, Adrian, 2022. "A practical deep reinforcement learning framework for multivariate occupant-centric control in buildings," Applied Energy, Elsevier, vol. 324(C).
    2. Yang, Lei & Nagy, Zoltan & Goffin, Philippe & Schlueter, Arno, 2015. "Reinforcement learning for optimal control of low exergy buildings," Applied Energy, Elsevier, vol. 156(C), pages 577-586.
    3. Kong, Meng & Dong, Bing & Zhang, Rongpeng & O'Neill, Zheng, 2022. "HVAC energy savings, thermal comfort and air quality for occupant-centric control through a side-by-side experimental study," Applied Energy, Elsevier, vol. 306(PA).
    4. Frederik Ruelens & Sandro Iacovella & Bert J. Claessens & Ronnie Belmans, 2015. "Learning Agent for a Heat-Pump Thermostat with a Set-Back Strategy Using Model-Free Reinforcement Learning," Energies, MDPI, vol. 8(8), pages 1-19, August.
    5. Zhao, Dafang & Watari, Daichi & Ozawa, Yuki & Taniguchi, Ittetsu & Suzuki, Toshihiro & Shimoda, Yoshiyuki & Onoye, Takao, 2023. "Data-driven online energy management framework for HVAC systems: An experimental study," Applied Energy, Elsevier, vol. 352(C).
    6. Arroyo, Javier & Manna, Carlo & Spiessens, Fred & Helsen, Lieve, 2022. "Reinforced model predictive control (RL-MPC) for building energy management," Applied Energy, Elsevier, vol. 309(C).
    7. Xiao, Tianqi & You, Fengqi, 2023. "Building thermal modeling and model predictive control with physically consistent deep learning for decarbonization and energy optimization," Applied Energy, Elsevier, vol. 342(C).
    8. Joe, Jaewan & Karava, Panagiota, 2019. "A model predictive control strategy to optimize the performance of radiant floor heating and cooling systems in office buildings," Applied Energy, Elsevier, vol. 245(C), pages 65-77.
    9. Di Natale, L. & Svetozarevic, B. & Heer, P. & Jones, C.N., 2023. "Towards scalable physically consistent neural networks: An application to data-driven multi-zone thermal building models," Applied Energy, Elsevier, vol. 340(C).
    10. Wang, Zhe & Hong, Tianzhen, 2020. "Reinforcement learning for building controls: The opportunities and challenges," Applied Energy, Elsevier, vol. 269(C).
    11. Jiang, Zixin & Deng, Zhipeng & Wang, Xuezheng & Dong, Bing, 2023. "PANDEMIC: Occupancy driven predictive ventilation control to minimize energy consumption and infection risk," Applied Energy, Elsevier, vol. 334(C).
    12. Blum, David & Wang, Zhe & Weyandt, Chris & Kim, Donghun & Wetter, Michael & Hong, Tianzhen & Piette, Mary Ann, 2022. "Field demonstration and implementation analysis of model predictive control in an office HVAC system," Applied Energy, Elsevier, vol. 318(C).
    13. Drgoňa, Ján & Picard, Damien & Kvasnica, Michal & Helsen, Lieve, 2018. "Approximate model predictive building control via machine learning," Applied Energy, Elsevier, vol. 218(C), pages 199-216.
    14. Yang, Shiyu & Wan, Man Pun & Chen, Wanyu & Ng, Bing Feng & Dubey, Swapnil, 2020. "Model predictive control with adaptive machine-learning-based model for building energy efficiency and comfort optimization," Applied Energy, Elsevier, vol. 271(C).
    15. Biemann, Marco & Scheller, Fabian & Liu, Xiufeng & Huang, Lizhen, 2021. "Experimental evaluation of model-free reinforcement learning algorithms for continuous HVAC control," Applied Energy, Elsevier, vol. 298(C).
    16. Yang, Shiyu & Wan, Man Pun & Ng, Bing Feng & Dubey, Swapnil & Henze, Gregor P. & Chen, Wanyu & Baskaran, Krishnamoorthy, 2020. "Experimental study of model predictive control for an air-conditioning system with dedicated outdoor air system," Applied Energy, Elsevier, vol. 257(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ayas Shaqour & Aya Hagishima, 2022. "Systematic Review on Deep Reinforcement Learning-Based Energy Management for Different Building Types," Energies, MDPI, vol. 15(22), pages 1-27, November.
    2. Gao, Yuan & Matsunami, Yuki & Miyata, Shohei & Akashi, Yasunori, 2022. "Multi-agent reinforcement learning dealing with hybrid action spaces: A case study for off-grid oriented renewable building energy system," Applied Energy, Elsevier, vol. 326(C).
    3. Xu, Wenjie & Svetozarevic, Bratislav & Di Natale, Loris & Heer, Philipp & Jones, Colin N., 2024. "Data-driven adaptive building thermal controller tuning with constraints: A primal–dual contextual Bayesian optimization approach," Applied Energy, Elsevier, vol. 358(C).
    4. Yassine Chemingui & Adel Gastli & Omar Ellabban, 2020. "Reinforcement Learning-Based School Energy Management System," Energies, MDPI, vol. 13(23), pages 1-21, December.
    5. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    6. Nweye, Kingsley & Sankaranarayanan, Siva & Nagy, Zoltan, 2023. "MERLIN: Multi-agent offline and transfer learning for occupant-centric operation of grid-interactive communities," Applied Energy, Elsevier, vol. 346(C).
    7. Yang, Shiyu & Wan, Man Pun & Chen, Wanyu & Ng, Bing Feng & Dubey, Swapnil, 2021. "Experiment study of machine-learning-based approximate model predictive control for energy-efficient building control," Applied Energy, Elsevier, vol. 288(C).
    8. Dongsu Kim & Jongman Lee & Sunglok Do & Pedro J. Mago & Kwang Ho Lee & Heejin Cho, 2022. "Energy Modeling and Model Predictive Control for HVAC in Buildings: A Review of Current Research Trends," Energies, MDPI, vol. 15(19), pages 1-30, October.
    9. Zhuang, Dian & Gan, Vincent J.L. & Duygu Tekler, Zeynep & Chong, Adrian & Tian, Shuai & Shi, Xing, 2023. "Data-driven predictive control for smart HVAC system in IoT-integrated buildings with time-series forecasting and reinforcement learning," Applied Energy, Elsevier, vol. 338(C).
    10. Yang, Shiyu & Wan, Man Pun & Ng, Bing Feng & Dubey, Swapnil & Henze, Gregor P. & Chen, Wanyu & Baskaran, Krishnamoorthy, 2021. "Model predictive control for integrated control of air-conditioning and mechanical ventilation, lighting and shading systems," Applied Energy, Elsevier, vol. 297(C).
    11. Guo, Yanhua & Wang, Ningbo & Shao, Shuangquan & Huang, Congqi & Zhang, Zhentao & Li, Xiaoqiong & Wang, Youdong, 2024. "A review on hybrid physics and data-driven modeling methods applied in air source heat pump systems for energy efficiency improvement," Renewable and Sustainable Energy Reviews, Elsevier, vol. 204(C).
    12. Schmitz, Simon & Brucke, Karoline & Kasturi, Pranay & Ansari, Esmail & Klement, Peter, 2024. "Forecast-based and data-driven reinforcement learning for residential heat pump operation," Applied Energy, Elsevier, vol. 371(C).
    13. Lei, Yue & Zhan, Sicheng & Ono, Eikichi & Peng, Yuzhen & Zhang, Zhiang & Hasama, Takamasa & Chong, Adrian, 2022. "A practical deep reinforcement learning framework for multivariate occupant-centric control in buildings," Applied Energy, Elsevier, vol. 324(C).
    14. Dong, Zhe & Huang, Xiaojin & Dong, Yujie & Zhang, Zuoyi, 2020. "Multilayer perception based reinforcement learning supervisory control of energy systems with application to a nuclear steam supply system," Applied Energy, Elsevier, vol. 259(C).
    15. Silvestri, Alberto & Coraci, Davide & Brandi, Silvio & Capozzoli, Alfonso & Borkowski, Esther & Köhler, Johannes & Wu, Duan & Zeilinger, Melanie N. & Schlueter, Arno, 2024. "Real building implementation of a deep reinforcement learning controller to enhance energy efficiency and indoor temperature control," Applied Energy, Elsevier, vol. 368(C).
    16. Zheng, Wanfu & Wang, Dan & Wang, Zhe, 2024. "Economic model predictive control for building HVAC system: A comparative analysis of model-based and data-driven approaches using the BOPTEST Framework," Applied Energy, Elsevier, vol. 374(C).
    17. Kathirgamanathan, Anjukan & De Rosa, Mattia & Mangina, Eleni & Finn, Donal P., 2021. "Data-driven predictive control for unlocking building energy flexibility: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    18. Panagiotis Michailidis & Iakovos Michailidis & Dimitrios Vamvakas & Elias Kosmatopoulos, 2023. "Model-Free HVAC Control in Buildings: A Review," Energies, MDPI, vol. 16(20), pages 1-45, October.
    19. Liu, Xiaoqi & Lee, Seungjae & Bilionis, Ilias & Karava, Panagiota & Joe, Jaewan & Sadeghi, Seyed Amir, 2021. "A user-interactive system for smart thermal environment control in office buildings," Applied Energy, Elsevier, vol. 298(C).
    20. Zhao, Jing & Yang, Zilan & Shi, Linyu & Liu, Dehan & Li, Haonan & Mi, Yumiao & Wang, Hongbin & Feng, Meili & Hutagaol, Timothy Joseph, 2024. "Photovoltaic capacity dynamic tracking model predictive control strategy of air-conditioning systems with consideration of flexible loads," Applied Energy, Elsevier, vol. 356(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:371:y:2024:i:c:s0306261924010894. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.