IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v306y2024ics0360544224021170.html
   My bibliography  Save this article

A bi-level real-time optimal control strategy for thermal coupled multi-zone dedicated outside air system-assisted HVAC systems

Author

Listed:
  • Liu, Yuntao
  • Cui, Can

Abstract

This paper proposes a bi-level optimal control strategy for thermally coupled multi-zone dedicated outside air system (DOAS)-assisted HVAC systems, which integrates the deep reinforcement learning (DRL) algorithm with Lyapunov function-based reward shaping (LRS) and an augmented genetic algorithm. The proposed strategy aims to maintain indoor air quality (IAQ) and thermal comfort while reducing the overall energy cost. On the upper level, the LRS method enhances the convergence of the DRL algorithm, ensuring satisfactory IAQ with reduced electricity cost. On the lower level, the embedding of the pre-trained optimal agent achieves a unidirectional decoupling, which mitigates model dependency and accurately control thermal comfort under thermal coupling. The proposed strategy offers the following advantages: a) It can efficiently maintain IAQ in multiple zones and high energy efficiency by optimizing the supply airflow, in response to real-time environmental changes. b) It can achieve satisfactory thermal comfort by regulating the fan coil unit power, while implicitly reducing the overall energy costs via unidirectional decoupling. c) Experimental results demonstrate that the proposed strategy achieves a maximum energy savings of 33.13 % and electricity savings of 34.14 %, compared with the traditional strategy. d) The proposed strategy exhibits good generalization ability under different test climates and occupancy scenarios.

Suggested Citation

  • Liu, Yuntao & Cui, Can, 2024. "A bi-level real-time optimal control strategy for thermal coupled multi-zone dedicated outside air system-assisted HVAC systems," Energy, Elsevier, vol. 306(C).
    • Handle: RePEc:eee:energy:v:306:y:2024:i:c:s0360544224021170
    DOI: 10.1016/j.energy.2024.132343
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224021170
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.132343?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Du, Xiaoxu & Tang, Zhenpeng & Chen, Kaijie, 2023. "A novel crude oil futures trading strategy based on volume-price time-frequency decomposition with ensemble deep reinforcement learning," Energy, Elsevier, vol. 285(C).
    2. Liu, Yonggang & Wu, Yitao & Wang, Xiangyu & Li, Liang & Zhang, Yuanjian & Chen, Zheng, 2023. "Energy management for hybrid electric vehicles based on imitation reinforcement learning," Energy, Elsevier, vol. 263(PC).
    3. Jin, Xiaolong & Mu, Yunfei & Jia, Hongjie & Wu, Jianzhong & Jiang, Tao & Yu, Xiaodan, 2017. "Dynamic economic dispatch of a hybrid energy microgrid considering building based virtual energy storage system," Applied Energy, Elsevier, vol. 194(C), pages 386-398.
    4. Jiang, Yuliang & Zhu, Shanying & Xu, Qimin & Yang, Bo & Guan, Xinping, 2023. "Hybrid modeling-based temperature and humidity adaptive control for a multi-zone HVAC system," Applied Energy, Elsevier, vol. 334(C).
    5. Li, Wenzhuo & Wang, Shengwei, 2020. "A multi-agent based distributed approach for optimal control of multi-zone ventilation systems considering indoor air quality and energy use," Applied Energy, Elsevier, vol. 275(C).
    6. Homod, Raad Z. & Munahi, Basil Sh. & Mohammed, Hayder Ibrahim & Albadr, Musatafa Abbas Abbood & Abderrahmane, AISSA & Mahdi, Jasim M. & Ben Hamida, Mohamed Bechir & Alhasnawi, Bilal Naji & Albahri, A., 2024. "Deep clustering of reinforcement learning based on the bang-bang principle to optimize the energy in multi-boiler for intelligent buildings," Applied Energy, Elsevier, vol. 356(C).
    7. Qin, Haosen & Yu, Zhen & Li, Tailu & Liu, Xueliang & Li, Li, 2023. "Energy-efficient heating control for nearly zero energy residential buildings with deep reinforcement learning," Energy, Elsevier, vol. 264(C).
    8. Yang, Ting & Zhao, Liyuan & Li, Wei & Wu, Jianzhong & Zomaya, Albert Y., 2021. "Towards healthy and cost-effective indoor environment management in smart homes: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 300(C).
    9. Zhang, Tianyi & Chen, Lei & Wang, Jin, 2023. "Multi-objective optimization of elliptical tube fin heat exchangers based on neural networks and genetic algorithm," Energy, Elsevier, vol. 269(C).
    10. Hu, Weicheng & Yang, Qingshan & Chen, Hua-Peng & Guo, Kunpeng & Zhou, Tong & Liu, Min & Zhang, Jian & Yuan, Ziting, 2022. "A novel approach for wind farm micro-siting in complex terrain based on an improved genetic algorithm," Energy, Elsevier, vol. 251(C).
    11. Kim, Wonuk & Jeon, Seung Won & Kim, Yongchan, 2016. "Model-based multi-objective optimal control of a VRF (variable refrigerant flow) combined system with DOAS (dedicated outdoor air system) using genetic algorithm under heating conditions," Energy, Elsevier, vol. 107(C), pages 196-204.
    12. Chatterjee, Arnab & Zhang, Lijun & Xia, Xiaohua, 2015. "Optimization of mine ventilation fan speeds according to ventilation on demand and time of use tariff," Applied Energy, Elsevier, vol. 146(C), pages 65-73.
    13. Kang, Dongju & Kang, Doeun & Hwangbo, Sumin & Niaz, Haider & Lee, Won Bo & Liu, J. Jay & Na, Jonggeol, 2023. "Optimal planning of hybrid energy storage systems using curtailed renewable energy through deep reinforcement learning," Energy, Elsevier, vol. 284(C).
    14. Yang, Shiyu & Wan, Man Pun & Ng, Bing Feng & Dubey, Swapnil & Henze, Gregor P. & Chen, Wanyu & Baskaran, Krishnamoorthy, 2020. "Experimental study of model predictive control for an air-conditioning system with dedicated outdoor air system," Applied Energy, Elsevier, vol. 257(C).
    15. Zhang, Tao & Liu, Xiaohua & Jiang, Yi, 2014. "Development of temperature and humidity independent control (THIC) air-conditioning systems in China—A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 29(C), pages 793-803.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cui, Can & Xue, Jing, 2024. "Energy and comfort aware operation of multi-zone HVAC system through preference-inspired deep reinforcement learning," Energy, Elsevier, vol. 292(C).
    2. Yang, Ting & Zhao, Liyuan & Li, Wei & Wu, Jianzhong & Zomaya, Albert Y., 2021. "Towards healthy and cost-effective indoor environment management in smart homes: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 300(C).
    3. Yang, Shiyu & Wan, Man Pun & Ng, Bing Feng & Dubey, Swapnil & Henze, Gregor P. & Chen, Wanyu & Baskaran, Krishnamoorthy, 2020. "Experimental study of model predictive control for an air-conditioning system with dedicated outdoor air system," Applied Energy, Elsevier, vol. 257(C).
    4. Chen, Wei-Han & You, Fengqi, 2024. "Sustainable energy management and control for Decarbonization of complex multi-zone buildings with renewable solar and geothermal energies using machine learning, robust optimization, and predictive c," Applied Energy, Elsevier, vol. 372(C).
    5. Li, Wenzhuo & Wang, Shengwei, 2020. "A multi-agent based distributed approach for optimal control of multi-zone ventilation systems considering indoor air quality and energy use," Applied Energy, Elsevier, vol. 275(C).
    6. Wang, Zixuan & Xiao, Fu & Ran, Yi & Li, Yanxue & Xu, Yang, 2024. "Scalable energy management approach of residential hybrid energy system using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 367(C).
    7. Li, Wenzhuo & Wang, Shengwei & Koo, Choongwan, 2021. "A real-time optimal control strategy for multi-zone VAV air-conditioning systems adopting a multi-agent based distributed optimization method," Applied Energy, Elsevier, vol. 287(C).
    8. Jiang, Zixin & Deng, Zhipeng & Wang, Xuezheng & Dong, Bing, 2023. "PANDEMIC: Occupancy driven predictive ventilation control to minimize energy consumption and infection risk," Applied Energy, Elsevier, vol. 334(C).
    9. Mpho J. Lencwe & SP Daniel Chowdhury & Sipho Mahlangu & Maxwell Sibanyoni & Louwrance Ngoma, 2021. "An Efficient HVAC Network Control for Safety Enhancement of a Typical Uninterrupted Power Supply Battery Storage Room," Energies, MDPI, vol. 14(16), pages 1-23, August.
    10. Panagiotis Michailidis & Iakovos Michailidis & Dimitrios Vamvakas & Elias Kosmatopoulos, 2023. "Model-Free HVAC Control in Buildings: A Review," Energies, MDPI, vol. 16(20), pages 1-45, October.
    11. Ma, Zhikai & Huo, Qian & Wang, Wei & Zhang, Tao, 2023. "Voltage-temperature aware thermal runaway alarming framework for electric vehicles via deep learning with attention mechanism in time-frequency domain," Energy, Elsevier, vol. 278(C).
    12. Ghoreishi-Madiseh, Seyed Ali & Kalantari, Hosein & Kuyuk, Ali Fahrettin & Sasmito, Agus P., 2019. "A new model to analyze performance of mine exhaust heat recovery systems with coupled heat exchangers," Applied Energy, Elsevier, vol. 256(C).
    13. Jangsten, Maria & Filipsson, Peter & Lindholm, Torbjörn & Dalenbäck, Jan-Olof, 2020. "High Temperature District Cooling: Challenges and Possibilities Based on an Existing District Cooling System and its Connected Buildings," Energy, Elsevier, vol. 199(C).
    14. Zu, Kan & Qin, Menghao & Cui, Shuqing, 2020. "Progress and potential of metal-organic frameworks (MOFs) as novel desiccants for built environment control: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    15. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    16. Liang, Chenjiyu & Li, Xianting & Zheng, Gonghang, 2022. "Optimizing air conditioning systems by considering the grades of sensible and latent heat loads," Applied Energy, Elsevier, vol. 322(C).
    17. Víctor Sanz i López & Ramon Costa-Castelló & Carles Batlle, 2022. "Literature Review of Energy Management in Combined Heat and Power Systems Based on High-Temperature Proton Exchange Membrane Fuel Cells for Residential Comfort Applications," Energies, MDPI, vol. 15(17), pages 1-22, September.
    18. Wang, Zibo & Yu, Xiaodan & Mu, Yunfei & Jia, Hongjie, 2020. "A distributed Peer-to-Peer energy transaction method for diversified prosumers in Urban Community Microgrid System," Applied Energy, Elsevier, vol. 260(C).
    19. Han, Lijin & You, Congwen & Yang, Ningkang & Liu, Hui & Chen, Ke & Xiang, Changle, 2024. "Adaptive real-time energy management strategy using heuristic search for off-road hybrid electric vehicles," Energy, Elsevier, vol. 304(C).
    20. Zhuang, Chaoqun & Wang, Shengwei & Shan, Kui, 2019. "Adaptive full-range decoupled ventilation strategy and air-conditioning systems for cleanrooms and buildings requiring strict humidity control and their performance evaluation," Energy, Elsevier, vol. 168(C), pages 883-896.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:306:y:2024:i:c:s0360544224021170. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.