IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i20p7124-d1261659.html
   My bibliography  Save this article

Model-Free HVAC Control in Buildings: A Review

Author

Listed:
  • Panagiotis Michailidis

    (Center for Research and Technology Hellas, 57001 Thessaloniki, Greece
    Department of Electrical and Computer Engineering, Democritus University of Thrace, 67100 Xanthi, Greece
    These authors contributed equally to this work.)

  • Iakovos Michailidis

    (Center for Research and Technology Hellas, 57001 Thessaloniki, Greece
    These authors contributed equally to this work.)

  • Dimitrios Vamvakas

    (Center for Research and Technology Hellas, 57001 Thessaloniki, Greece
    Department of Electrical and Computer Engineering, Democritus University of Thrace, 67100 Xanthi, Greece
    These authors contributed equally to this work.)

  • Elias Kosmatopoulos

    (Center for Research and Technology Hellas, 57001 Thessaloniki, Greece
    Department of Electrical and Computer Engineering, Democritus University of Thrace, 67100 Xanthi, Greece
    These authors contributed equally to this work.)

Abstract

The efficient control of HVAC devices in building structures is mandatory for achieving energy savings and comfort. To balance these objectives efficiently, it is essential to incorporate adequate advanced control strategies to adapt to varying environmental conditions and occupant preferences. Model-free control approaches for building HVAC systems have gained significant interest due to their flexibility and ability to adapt to complex, dynamic systems without relying on explicit mathematical models. The current review presents the recent advancements in HVAC control, with an emphasis on reinforcement learning, artificial neural networks, fuzzy logic control, and their hybrid integration with other model-free algorithms. The main focus of this study is a literature review of the most notable research from 2015 to 2023, highlighting the most highly cited applications and their contributions to the field. After analyzing the concept of each work according to its control strategy, a detailed evaluation across different thematic areas is conducted. To this end, the prevalence of methodologies, utilization of different HVAC equipment, and diverse testbed features, such as building zoning and utilization, are further discussed considering the entire body of work to identify different patterns and trends in the field of model-free HVAC control. Last but not least, based on a detailed evaluation of the research in the field, the current work provides future directions for model-free HVAC control considering different aspects and thematic areas.

Suggested Citation

  • Panagiotis Michailidis & Iakovos Michailidis & Dimitrios Vamvakas & Elias Kosmatopoulos, 2023. "Model-Free HVAC Control in Buildings: A Review," Energies, MDPI, vol. 16(20), pages 1-45, October.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:20:p:7124-:d:1261659
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/20/7124/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/20/7124/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Antonio Paone & Jean-Philippe Bacher, 2018. "The Impact of Building Occupant Behavior on Energy Efficiency and Methods to Influence It: A Review of the State of the Art," Energies, MDPI, vol. 11(4), pages 1-19, April.
    2. Lei, Yue & Zhan, Sicheng & Ono, Eikichi & Peng, Yuzhen & Zhang, Zhiang & Hasama, Takamasa & Chong, Adrian, 2022. "A practical deep reinforcement learning framework for multivariate occupant-centric control in buildings," Applied Energy, Elsevier, vol. 324(C).
    3. Dongsu Kim & Jongman Lee & Sunglok Do & Pedro J. Mago & Kwang Ho Lee & Heejin Cho, 2022. "Energy Modeling and Model Predictive Control for HVAC in Buildings: A Review of Current Research Trends," Energies, MDPI, vol. 15(19), pages 1-30, October.
    4. Naja Aqilah & Hom Bahadur Rijal & Sheikh Ahmad Zaki, 2022. "A Review of Thermal Comfort in Residential Buildings: Comfort Threads and Energy Saving Potential," Energies, MDPI, vol. 15(23), pages 1-23, November.
    5. Lork, Clement & Li, Wen-Tai & Qin, Yan & Zhou, Yuren & Yuen, Chau & Tushar, Wayes & Saha, Tapan K., 2020. "An uncertainty-aware deep reinforcement learning framework for residential air conditioning energy management," Applied Energy, Elsevier, vol. 276(C).
    6. Farinaz Behrooz & Norman Mariun & Mohammad Hamiruce Marhaban & Mohd Amran Mohd Radzi & Abdul Rahman Ramli, 2018. "Review of Control Techniques for HVAC Systems—Nonlinearity Approaches Based on Fuzzy Cognitive Maps," Energies, MDPI, vol. 11(3), pages 1-41, February.
    7. Prativa Lamsal & Sushil Bahadur Bajracharya & Hom Bahadur Rijal, 2023. "A Review on Adaptive Thermal Comfort of Office Building for Energy-Saving Building Design," Energies, MDPI, vol. 16(3), pages 1-23, February.
    8. Abhinandana Boodi & Karim Beddiar & Malek Benamour & Yassine Amirat & Mohamed Benbouzid, 2018. "Intelligent Systems for Building Energy and Occupant Comfort Optimization: A State of the Art Review and Recommendations," Energies, MDPI, vol. 11(10), pages 1-26, September.
    9. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    10. Gianluca Serale & Massimo Fiorentini & Alfonso Capozzoli & Daniele Bernardini & Alberto Bemporad, 2018. "Model Predictive Control (MPC) for Enhancing Building and HVAC System Energy Efficiency: Problem Formulation, Applications and Opportunities," Energies, MDPI, vol. 11(3), pages 1-35, March.
    11. Keshtkar, Azim & Arzanpour, Siamak, 2017. "An adaptive fuzzy logic system for residential energy management in smart grid environments," Applied Energy, Elsevier, vol. 186(P1), pages 68-81.
    12. Wang, Zhe & Hong, Tianzhen & Piette, Mary Ann, 2019. "Data fusion in predicting internal heat gains for office buildings through a deep learning approach," Applied Energy, Elsevier, vol. 240(C), pages 386-398.
    13. Biemann, Marco & Scheller, Fabian & Liu, Xiufeng & Huang, Lizhen, 2021. "Experimental evaluation of model-free reinforcement learning algorithms for continuous HVAC control," Applied Energy, Elsevier, vol. 298(C).
    14. Pedro Macieira & Luis Gomes & Zita Vale, 2021. "Energy Management Model for HVAC Control Supported by Reinforcement Learning," Energies, MDPI, vol. 14(24), pages 1-14, December.
    15. Md. Washim Akram & Muhammad Firdaus Mohd Zublie & Md. Hasanuzzaman & Nasrudin Abd Rahim, 2022. "Global Prospects, Advance Technologies and Policies of Energy-Saving and Sustainable Building Systems: A Review," Sustainability, MDPI, vol. 14(3), pages 1-27, January.
    16. Panagiotis Michailidis & Paschalis Pelitaris & Christos Korkas & Iakovos Michailidis & Simone Baldi & Elias Kosmatopoulos, 2021. "Enabling Optimal Energy Management with Minimal IoT Requirements: A Legacy A/C Case Study," Energies, MDPI, vol. 14(23), pages 1-25, November.
    17. Wang, Wei & Chen, Jiayu & Huang, Gongsheng & Lu, Yujie, 2017. "Energy efficient HVAC control for an IPS-enabled large space in commercial buildings through dynamic spatial occupancy distribution," Applied Energy, Elsevier, vol. 207(C), pages 305-323.
    18. Peng, Yuzhen & Rysanek, Adam & Nagy, Zoltán & Schlüter, Arno, 2018. "Using machine learning techniques for occupancy-prediction-based cooling control in office buildings," Applied Energy, Elsevier, vol. 211(C), pages 1343-1358.
    19. Iakovos T. Michailidis & Roozbeh Sangi & Panagiotis Michailidis & Thomas Schild & Johannes Fuetterer & Dirk Mueller & Elias B. Kosmatopoulos, 2020. "Balancing Energy Efficiency with Indoor Comfort Using Smart Control Agents: A Simulative Case Study," Energies, MDPI, vol. 13(23), pages 1-28, November.
    20. Sholahudin, S. & Han, Hwataik, 2016. "Simplified dynamic neural network model to predict heating load of a building using Taguchi method," Energy, Elsevier, vol. 115(P3), pages 1672-1678.
    21. Sadaqat Ali & Zhixue Zheng & Michel Aillerie & Jean-Paul Sawicki & Marie-Cécile Péra & Daniel Hissel, 2021. "A Review of DC Microgrid Energy Management Systems Dedicated to Residential Applications," Energies, MDPI, vol. 14(14), pages 1-26, July.
    22. Du, Yan & Zandi, Helia & Kotevska, Olivera & Kurte, Kuldeep & Munk, Jeffery & Amasyali, Kadir & Mckee, Evan & Li, Fangxing, 2021. "Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning," Applied Energy, Elsevier, vol. 281(C).
    23. Li, Wenzhuo & Wang, Shengwei, 2020. "A multi-agent based distributed approach for optimal control of multi-zone ventilation systems considering indoor air quality and energy use," Applied Energy, Elsevier, vol. 275(C).
    24. Michailidis, Iakovos T. & Schild, Thomas & Sangi, Roozbeh & Michailidis, Panagiotis & Korkas, Christos & Fütterer, Johannes & Müller, Dirk & Kosmatopoulos, Elias B., 2018. "Energy-efficient HVAC management using cooperative, self-trained, control agents: A real-life German building case study," Applied Energy, Elsevier, vol. 211(C), pages 113-125.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    2. Charalampos Rafail Lazaridis & Iakovos Michailidis & Georgios Karatzinis & Panagiotis Michailidis & Elias Kosmatopoulos, 2024. "Evaluating Reinforcement Learning Algorithms in Residential Energy Saving and Comfort Management," Energies, MDPI, vol. 17(3), pages 1-33, January.
    3. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    4. Zhang, Bin & Hu, Weihao & Ghias, Amer M.Y.M. & Xu, Xiao & Chen, Zhe, 2022. "Multi-agent deep reinforcement learning-based coordination control for grid-aware multi-buildings," Applied Energy, Elsevier, vol. 328(C).
    5. Dongsu Kim & Jongman Lee & Sunglok Do & Pedro J. Mago & Kwang Ho Lee & Heejin Cho, 2022. "Energy Modeling and Model Predictive Control for HVAC in Buildings: A Review of Current Research Trends," Energies, MDPI, vol. 15(19), pages 1-30, October.
    6. Wei, Shuangyu & Tien, Paige Wenbin & Calautit, John Kaiser & Wu, Yupeng & Boukhanouf, Rabah, 2020. "Vision-based detection and prediction of equipment heat gains in commercial office buildings using a deep learning method," Applied Energy, Elsevier, vol. 277(C).
    7. Ayas Shaqour & Aya Hagishima, 2022. "Systematic Review on Deep Reinforcement Learning-Based Energy Management for Different Building Types," Energies, MDPI, vol. 15(22), pages 1-27, November.
    8. Panagiotis Michailidis & Iakovos Michailidis & Socratis Gkelios & Elias Kosmatopoulos, 2024. "Artificial Neural Network Applications for Energy Management in Buildings: Current Trends and Future Directions," Energies, MDPI, vol. 17(3), pages 1-47, January.
    9. Silvestri, Alberto & Coraci, Davide & Brandi, Silvio & Capozzoli, Alfonso & Borkowski, Esther & Köhler, Johannes & Wu, Duan & Zeilinger, Melanie N. & Schlueter, Arno, 2024. "Real building implementation of a deep reinforcement learning controller to enhance energy efficiency and indoor temperature control," Applied Energy, Elsevier, vol. 368(C).
    10. Mpho J. Lencwe & SP Daniel Chowdhury & Sipho Mahlangu & Maxwell Sibanyoni & Louwrance Ngoma, 2021. "An Efficient HVAC Network Control for Safety Enhancement of a Typical Uninterrupted Power Supply Battery Storage Room," Energies, MDPI, vol. 14(16), pages 1-23, August.
    11. Hyo-Jun Kim & Young-Hum Cho, 2021. "Optimal Control Method of Variable Air Volume Terminal Unit System," Energies, MDPI, vol. 14(22), pages 1-15, November.
    12. Keerthana Sivamayil & Elakkiya Rajasekar & Belqasem Aljafari & Srete Nikolovski & Subramaniyaswamy Vairavasundaram & Indragandhi Vairavasundaram, 2023. "A Systematic Study on Reinforcement Learning Based Applications," Energies, MDPI, vol. 16(3), pages 1-23, February.
    13. Anh Tuan Phan & Thi Tuyet Hong Vu & Dinh Quang Nguyen & Eleonora Riva Sanseverino & Hang Thi-Thuy Le & Van Cong Bui, 2022. "Data Compensation with Gaussian Processes Regression: Application in Smart Building’s Sensor Network," Energies, MDPI, vol. 15(23), pages 1-16, December.
    14. Tien, Paige Wenbin & Wei, Shuangyu & Calautit, John Kaiser & Darkwa, Jo & Wood, Christopher, 2022. "Real-time monitoring of occupancy activities and window opening within buildings using an integrated deep learning-based approach for reducing energy demand," Applied Energy, Elsevier, vol. 308(C).
    15. Pinto, Giuseppe & Kathirgamanathan, Anjukan & Mangina, Eleni & Finn, Donal P. & Capozzoli, Alfonso, 2022. "Enhancing energy management in grid-interactive buildings: A comparison among cooperative and coordinated architectures," Applied Energy, Elsevier, vol. 310(C).
    16. Homod, Raad Z. & Togun, Hussein & Kadhim Hussein, Ahmed & Noraldeen Al-Mousawi, Fadhel & Yaseen, Zaher Mundher & Al-Kouz, Wael & Abd, Haider J. & Alawi, Omer A. & Goodarzi, Marjan & Hussein, Omar A., 2022. "Dynamics analysis of a novel hybrid deep clustering for unsupervised learning by reinforcement of multi-agent to energy saving in intelligent buildings," Applied Energy, Elsevier, vol. 313(C).
    17. Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).
    18. Baldi, Simone & Korkas, Christos D. & Lv, Maolong & Kosmatopoulos, Elias B., 2018. "Automating occupant-building interaction via smart zoning of thermostatic loads: A switched self-tuning approach," Applied Energy, Elsevier, vol. 231(C), pages 1246-1258.
    19. Yang, Ting & Zhao, Liyuan & Li, Wei & Wu, Jianzhong & Zomaya, Albert Y., 2021. "Towards healthy and cost-effective indoor environment management in smart homes: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 300(C).
    20. Sinha, Anshuman & Thakkar, Harshul & Rezaei, Fateme & Kawajiri, Yoshiaki & Realff, Matthew J., 2022. "Reduced building energy consumption by combined indoor CO2 and H2O composition control," Applied Energy, Elsevier, vol. 322(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:20:p:7124-:d:1261659. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.