IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i20p7137-d1262399.html
   My bibliography  Save this article

Transfer Learning in the Transformer Model for Thermal Comfort Prediction: A Case of Limited Data

Author

Listed:
  • Xin Zhang

    (College of Information Science and Engineering, Henan University of Technology, Zhengzhou 450001, China)

  • Peng Li

    (Beijing Institute of Technology, Beijing 100081, China)

Abstract

The HVAC (Heating, Ventilation, and Air Conditioning) system is an important component of a building’s energy consumption, and its primary function is to provide a comfortable thermal environment for occupants. Accurate prediction of occupant thermal comfort is essential for improving building energy utilization as well as health and work efficiency. Therefore, the development of accurate thermal comfort prediction models is of great value. Deep learning based on data-driven techniques has excellent potential for predicting thermal comfort due to the development of artificial intelligence. However, the inability to obtain large quantities of detailed thermal comfort labeling data from residents presents a substantial challenge to the modeling endeavor. This paper proposes a building-to-building transfer learning framework to make deep learning models applicable in data-limited interior building environments, thereby resolving the issue and enhancing model predictive performance. The transfer learning method (TL) is applied to a novel technology dubbed the Transformer model, which has demonstrated outstanding performance in data trend prediction. The model exploits the spatiotemporal relationship of data regarding thermal comfort. Experiments are conducted using the source dataset (Scales project dataset and ASHRAE RP-884 dataset) and the target dataset (Medium US office dataset), and the results show that the proposed TL-Transformer achieves 62.6% accuracy, 57% precision, and a 59% F1 score, and the prediction performance is better than other existing methods. The model is useful for predicting indoor thermal comfort in buildings with limited data, and its validity is verified by experimental results.

Suggested Citation

  • Xin Zhang & Peng Li, 2023. "Transfer Learning in the Transformer Model for Thermal Comfort Prediction: A Case of Limited Data," Energies, MDPI, vol. 16(20), pages 1-19, October.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:20:p:7137-:d:1262399
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/20/7137/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/20/7137/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Michał Musiał & Lech Lichołai & Dušan Katunský, 2023. "Modern Thermal Energy Storage Systems Dedicated to Autonomous Buildings," Energies, MDPI, vol. 16(11), pages 1-28, May.
    2. Fang, Xi & Gong, Guangcai & Li, Guannan & Chun, Liang & Li, Wenqiang & Peng, Pei, 2021. "A hybrid deep transfer learning strategy for short term cross-building energy prediction," Energy, Elsevier, vol. 215(PB).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sergiu-Mihai Hategan & Nicoleta Stefu & Marius Paulescu, 2023. "An Ensemble Approach for Intra-Hour Forecasting of Solar Resource," Energies, MDPI, vol. 16(18), pages 1-12, September.
    2. Li, Guannan & Wu, Yubei & Yoon, Sungmin & Fang, Xi, 2024. "Comprehensive transferability assessment of short-term cross-building-energy prediction using deep adversarial network transfer learning," Energy, Elsevier, vol. 299(C).
    3. Tian, Chenlu & Liu, Yechun & Zhang, Guiqing & Yang, Yalong & Yan, Yi & Li, Chengdong, 2024. "Transfer learning based hybrid model for power demand prediction of large-scale electric vehicles," Energy, Elsevier, vol. 300(C).
    4. Tang, Lingfeng & Xie, Haipeng & Wang, Xiaoyang & Bie, Zhaohong, 2023. "Privacy-preserving knowledge sharing for few-shot building energy prediction: A federated learning approach," Applied Energy, Elsevier, vol. 337(C).
    5. Dongsu Kim & Yongjun Lee & Kyungil Chin & Pedro J. Mago & Heejin Cho & Jian Zhang, 2023. "Implementation of a Long Short-Term Memory Transfer Learning (LSTM-TL)-Based Data-Driven Model for Building Energy Demand Forecasting," Sustainability, MDPI, vol. 15(3), pages 1-23, January.
    6. Fang, Xi & Gong, Guangcai & Li, Guannan & Chun, Liang & Peng, Pei & Li, Wenqiang & Shi, Xing, 2023. "Cross temporal-spatial transferability investigation of deep reinforcement learning control strategy in the building HVAC system level," Energy, Elsevier, vol. 263(PB).
    7. Niu, Wente & Sun, Yuping & Zhang, Xiaowei & Lu, Jialiang & Liu, Hualin & Li, Qiaojing & Mu, Ying, 2023. "An ensemble transfer learning strategy for production prediction of shale gas wells," Energy, Elsevier, vol. 275(C).
    8. Wang, Lijin & Fan, Weipeng & Jiang, Guoqian & Xie, Ping, 2023. "An efficient federated transfer learning framework for collaborative monitoring of wind turbines in IoE-enabled wind farms," Energy, Elsevier, vol. 284(C).
    9. Fanyue Qian & Weijun Gao & Dan Yu & Yongwen Yang & Yingjun Ruan, 2022. "An Analysis of the Potential of Hydrogen Energy Technology on Demand Side Based on a Carbon Tax: A Case Study in Japan," Energies, MDPI, vol. 16(1), pages 1-23, December.
    10. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    11. Chen, Siliang & Ge, Wei & Liang, Xinbin & Jin, Xinqiao & Du, Zhimin, 2024. "Lifelong learning with deep conditional generative replay for dynamic and adaptive modeling towards net zero emissions target in building energy system," Applied Energy, Elsevier, vol. 353(PB).
    12. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    13. Zhang, Yunfei & Zhou, Zhihua & Du, Yahui & Shen, Jun & Li, Zhenxing & Yuan, Jianjuan, 2023. "A data transfer method based on one dimensional convolutional neural network for cross-building load prediction," Energy, Elsevier, vol. 277(C).
    14. Antonella Yaacoub & Moez Esseghir & Leila Merghem-Boulahia, 2023. "A Review of Different Methodologies to Study Occupant Comfort and Energy Consumption," Energies, MDPI, vol. 16(4), pages 1-18, February.
    15. Li, Tao & Liu, Xiangyu & Li, Guannan & Wang, Xing & Ma, Jiangqiaoyu & Xu, Chengliang & Mao, Qianjun, 2024. "A systematic review and comprehensive analysis of building occupancy prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 193(C).
    16. Shangfu Wei & Xiaoqing Bai, 2022. "Multi-Step Short-Term Building Energy Consumption Forecasting Based on Singular Spectrum Analysis and Hybrid Neural Network," Energies, MDPI, vol. 15(5), pages 1-21, February.
    17. Coraci, Davide & Brandi, Silvio & Hong, Tianzhen & Capozzoli, Alfonso, 2023. "Online transfer learning strategy for enhancing the scalability and deployment of deep reinforcement learning control in smart buildings," Applied Energy, Elsevier, vol. 333(C).
    18. Fan, Cheng & Lei, Yutian & Sun, Yongjun & Piscitelli, Marco Savino & Chiosa, Roberto & Capozzoli, Alfonso, 2022. "Data-centric or algorithm-centric: Exploiting the performance of transfer learning for improving building energy predictions in data-scarce context," Energy, Elsevier, vol. 240(C).
    19. Yuan, Yue & Chen, Zhihua & Wang, Zhe & Sun, Yifu & Chen, Yixing, 2023. "Attention mechanism-based transfer learning model for day-ahead energy demand forecasting of shopping mall buildings," Energy, Elsevier, vol. 270(C).
    20. Yong Zhou & Lingyu Wang & Junhao Qian, 2022. "Application of Combined Models Based on Empirical Mode Decomposition, Deep Learning, and Autoregressive Integrated Moving Average Model for Short-Term Heating Load Predictions," Sustainability, MDPI, vol. 14(12), pages 1-20, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:20:p:7137-:d:1262399. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.