IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v353y2024ipbs0306261923015532.html
   My bibliography  Save this article

Lifelong learning with deep conditional generative replay for dynamic and adaptive modeling towards net zero emissions target in building energy system

Author

Listed:
  • Chen, Siliang
  • Ge, Wei
  • Liang, Xinbin
  • Jin, Xinqiao
  • Du, Zhimin

Abstract

Deep learning has been advocated as the predominant modeling method in the next-generation green building energy systems for energy prediction, predictive maintenance and control optimization. However, in response to external changes, the limited adaptability to new contents and catastrophic forgetting of previously learnt knowledge result in diminished accuracy and robustness, significantly blocking its practical application. To this end, a novel lifelong learning method with deep generative replay was proposed for dynamic and adaptive modeling to conserve energy and mitigate emissions in building energy systems. The presented lifelong learning method was characterized by the alternate training of the task solver and the replay generator in sequential energy task learning to alleviate the catastrophic forgetting. The replay generator provided the past data for the task solver to retain previous energy knowledge while learn new information, which was a conditional generative model instead of explicitly storing data to save resources and protect privacy. In order to validate its technical feasibility, a field experiment was conducted in a specially constructed net zero energy building for the case study on solar power generation prediction. The overall accuracy of proposed method was 53.4% higher than the standard method through fine-tuning and reached 0.89, which closely approaches the theoretical upper bound of 0.91 obtained by the joint training. Moreover, the proposed method effectively retained previously learnt knowledge in sequential energy task learning, evidenced by an average forgetting rate lower than 0.10. Furthermore, extensive comparative experiments have demonstrated the superiority of the proposed method over other machine learning models based on retraining or incremental training. Our study is expected to develop more flexible and robust deep learning models for improving energy efficiency and promoting the carbon neutrality in building energy systems.

Suggested Citation

  • Chen, Siliang & Ge, Wei & Liang, Xinbin & Jin, Xinqiao & Du, Zhimin, 2024. "Lifelong learning with deep conditional generative replay for dynamic and adaptive modeling towards net zero emissions target in building energy system," Applied Energy, Elsevier, vol. 353(PB).
  • Handle: RePEc:eee:appene:v:353:y:2024:i:pb:s0306261923015532
    DOI: 10.1016/j.apenergy.2023.122189
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923015532
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2023.122189?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    2. Li, Guannan & Chen, Liang & Liu, Jiangyan & Fang, Xi, 2023. "Comparative study on deep transfer learning strategies for cross-system and cross-operation-condition building energy systems fault diagnosis," Energy, Elsevier, vol. 263(PD).
    3. Liu, Jia & Zhou, Yuekuan & Yang, Hongxing & Wu, Huijun, 2022. "Uncertainty energy planning of net-zero energy communities with peer-to-peer energy trading and green vehicle storage considering climate changes by 2050 with machine learning methods," Applied Energy, Elsevier, vol. 321(C).
    4. Chen, Kang & Zhu, Xu & Anduv, Burkay & Jin, Xinqiao & Du, Zhimin, 2022. "Digital twins model and its updating method for heating, ventilation and air conditioning system using broad learning system algorithm," Energy, Elsevier, vol. 251(C).
    5. Liguori, Antonio & Markovic, Romana & Ferrando, Martina & Frisch, Jérôme & Causone, Francesco & van Treeck, Christoph, 2023. "Augmenting energy time-series for data-efficient imputation of missing values," Applied Energy, Elsevier, vol. 334(C).
    6. Liang, Xinbin & Liu, Zhuoxuan & Wang, Jie & Jin, Xinqiao & Du, Zhimin, 2023. "Uncertainty quantification-based robust deep learning for building energy systems considering distribution shift problem," Applied Energy, Elsevier, vol. 337(C).
    7. Chen, Siliang & Chen, Kang & Zhu, Xu & Jin, Xinqiao & Du, Zhimin, 2022. "Deep learning-based image recognition method for on-demand defrosting control to save energy in commercial energy systems," Applied Energy, Elsevier, vol. 324(C).
    8. Du, Zhimin & Liang, Xinbin & Chen, Siliang & Zhu, Xu & Chen, Kang & Jin, Xinqiao, 2023. "Knowledge-infused deep learning diagnosis model with self-assessment for smart management in HVAC systems," Energy, Elsevier, vol. 263(PD).
    9. Asaee, S. Rasoul & Sharafian, Amir & Herrera, Omar E. & Blomerus, Paul & Mérida, Walter, 2018. "Housing stock in cold-climate countries: Conversion challenges for net zero emission buildings," Applied Energy, Elsevier, vol. 217(C), pages 88-100.
    10. Lu, Hongfang & Cheng, Feifei & Ma, Xin & Hu, Gang, 2020. "Short-term prediction of building energy consumption employing an improved extreme gradient boosting model: A case study of an intake tower," Energy, Elsevier, vol. 203(C).
    11. Fang, Xi & Gong, Guangcai & Li, Guannan & Chun, Liang & Li, Wenqiang & Peng, Pei, 2021. "A hybrid deep transfer learning strategy for short term cross-building energy prediction," Energy, Elsevier, vol. 215(PB).
    12. Fekri, Mohammad Navid & Patel, Harsh & Grolinger, Katarina & Sharma, Vinay, 2021. "Deep learning for load forecasting with smart meter data: Online Adaptive Recurrent Neural Network," Applied Energy, Elsevier, vol. 282(PA).
    13. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).
    14. Gido M. Ven & Hava T. Siegelmann & Andreas S. Tolias, 2020. "Brain-inspired replay for continual learning with artificial neural networks," Nature Communications, Nature, vol. 11(1), pages 1-14, December.
    15. Amasyali, Kadir & El-Gohary, Nora M., 2018. "A review of data-driven building energy consumption prediction studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1192-1205.
    16. Fan, Cheng & Wang, Jiayuan & Gang, Wenjie & Li, Shenghan, 2019. "Assessment of deep recurrent neural network-based strategies for short-term building energy predictions," Applied Energy, Elsevier, vol. 236(C), pages 700-710.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Guannan & Wu, Yubei & Yoon, Sungmin & Fang, Xi, 2024. "Comprehensive transferability assessment of short-term cross-building-energy prediction using deep adversarial network transfer learning," Energy, Elsevier, vol. 299(C).
    2. Tang, Lingfeng & Xie, Haipeng & Wang, Xiaoyang & Bie, Zhaohong, 2023. "Privacy-preserving knowledge sharing for few-shot building energy prediction: A federated learning approach," Applied Energy, Elsevier, vol. 337(C).
    3. Fan, Cheng & Lei, Yutian & Sun, Yongjun & Piscitelli, Marco Savino & Chiosa, Roberto & Capozzoli, Alfonso, 2022. "Data-centric or algorithm-centric: Exploiting the performance of transfer learning for improving building energy predictions in data-scarce context," Energy, Elsevier, vol. 240(C).
    4. Luo, X.J. & Oyedele, Lukumon O. & Ajayi, Anuoluwapo O. & Akinade, Olugbenga O. & Owolabi, Hakeem A. & Ahmed, Ashraf, 2020. "Feature extraction and genetic algorithm enhanced adaptive deep neural network for energy consumption prediction in buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 131(C).
    5. Jiang, Ben & Li, Yu & Rezgui, Yacine & Zhang, Chengyu & Wang, Peng & Zhao, Tianyi, 2024. "Multi-source domain generalization deep neural network model for predicting energy consumption in multiple office buildings," Energy, Elsevier, vol. 299(C).
    6. Yue, Naihua & Caini, Mauro & Li, Lingling & Zhao, Yang & Li, Yu, 2023. "A comparison of six metamodeling techniques applied to multi building performance vectors prediction on gymnasiums under multiple climate conditions," Applied Energy, Elsevier, vol. 332(C).
    7. Somu, Nivethitha & M R, Gauthama Raman & Ramamritham, Krithi, 2020. "A hybrid model for building energy consumption forecasting using long short term memory networks," Applied Energy, Elsevier, vol. 261(C).
    8. Gao, Lei & Liu, Tianyuan & Cao, Tao & Hwang, Yunho & Radermacher, Reinhard, 2021. "Comparing deep learning models for multi energy vectors prediction on multiple types of building," Applied Energy, Elsevier, vol. 301(C).
    9. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    10. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    11. Xu, Yuanjin & Li, Fei & Asgari, Armin, 2022. "Prediction and optimization of heating and cooling loads in a residential building based on multi-layer perceptron neural network and different optimization algorithms," Energy, Elsevier, vol. 240(C).
    12. Zhang, Yunfei & Zhou, Zhihua & Du, Yahui & Shen, Jun & Li, Zhenxing & Yuan, Jianjuan, 2023. "A data transfer method based on one dimensional convolutional neural network for cross-building load prediction," Energy, Elsevier, vol. 277(C).
    13. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    14. Mohammad Mahdi Forootan & Iman Larki & Rahim Zahedi & Abolfazl Ahmadi, 2022. "Machine Learning and Deep Learning in Energy Systems: A Review," Sustainability, MDPI, vol. 14(8), pages 1-49, April.
    15. Liu, Jiangyan & Zhang, Qing & Dong, Zhenxiang & Li, Xin & Li, Guannan & Xie, Yi & Li, Kuining, 2021. "Quantitative evaluation of the building energy performance based on short-term energy predictions," Energy, Elsevier, vol. 223(C).
    16. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    17. Ijaz Ul Haq & Amin Ullah & Samee Ullah Khan & Noman Khan & Mi Young Lee & Seungmin Rho & Sung Wook Baik, 2021. "Sequential Learning-Based Energy Consumption Prediction Model for Residential and Commercial Sectors," Mathematics, MDPI, vol. 9(6), pages 1-17, March.
    18. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    19. Sun, Hongchang & Niu, Yanlei & Li, Chengdong & Zhou, Changgeng & Zhai, Wenwen & Chen, Zhe & Wu, Hao & Niu, Lanqiang, 2022. "Energy consumption optimization of building air conditioning system via combining the parallel temporal convolutional neural network and adaptive opposition-learning chimp algorithm," Energy, Elsevier, vol. 259(C).
    20. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:353:y:2024:i:pb:s0306261923015532. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.