IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v373y2024ics0306261924011711.html
   My bibliography  Save this article

Multi-energy load forecasting via hierarchical multi-task learning and spatiotemporal attention

Author

Listed:
  • Song, Cairong
  • Yang, Haidong
  • Cai, Jianyang
  • Yang, Pan
  • Bao, Hao
  • Xu, Kangkang
  • Meng, Xian-Bing

Abstract

Accurate multi-load forecasting is a crucial prerequisite for the steady and effective on-demand operation of integrated energy systems. Due to the intricate interdependencies between different energy sources and spatial and temporal dynamic variations, however, existing methodologies often struggle with data integration, model complexity, and capturing cross-energy correlations. To address these issues, the multi-energy load forecasting problem is transformed into a hierarchical multi-task learning task, resolved by using a spatiotemporal attention mechanism and a gated temporal convolutional network. Initially, the coupling relationships between different energy sources are analyzed both qualitatively and quantitatively to identify the coupling relationships between different energy loads. Subsequently, the identified couplings serve as guidance for designing a hierarchical multi-task learning network by distinguishing between relevant and less relevant loads. Moreover, by incorporating spatiotemporal attention, a gated temporal convolutional network with hierarchical structure is devised to achieve multi-task learning. Finally, the effectiveness of the proposed method is validated through multi-energy consumption data spanning 14 months from an energy management system. Compared to the several baseline methods, the proposed method reduces the mean absolute percentage error by up to 25.09%, 25.96%, and 17.46% on cooling, heating, and electrical load forecasting tasks. The positive experimental results and interpretable analysis demonstrate the promising application prospects of the proposed method in multi-energy load forecasting and demand-side management.

Suggested Citation

  • Song, Cairong & Yang, Haidong & Cai, Jianyang & Yang, Pan & Bao, Hao & Xu, Kangkang & Meng, Xian-Bing, 2024. "Multi-energy load forecasting via hierarchical multi-task learning and spatiotemporal attention," Applied Energy, Elsevier, vol. 373(C).
  • Handle: RePEc:eee:appene:v:373:y:2024:i:c:s0306261924011711
    DOI: 10.1016/j.apenergy.2024.123788
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924011711
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.123788?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Yongli & Wang, Yudong & Huang, Yujing & Li, Fang & Zeng, Ming & Li, Jiapu & Wang, Xiaohai & Zhang, Fuwei, 2019. "Planning and operation method of the regional integrated energy system considering economy and environment," Energy, Elsevier, vol. 171(C), pages 731-750.
    2. Yu, Min & Niu, Dongxiao & Zhao, Jinqiu & Li, Mingyu & Sun, Lijie & Yu, Xiaoyu, 2023. "Building cooling load forecasting of IES considering spatiotemporal coupling based on hybrid deep learning model," Applied Energy, Elsevier, vol. 349(C).
    3. Abedi, Mahyar & Tan, Xu & Klausner, James F. & Bénard, Andre, 2023. "Solar desalination chimneys: Investigation on the feasibility of integrating solar chimneys with humidification–dehumidification systems," Renewable Energy, Elsevier, vol. 202(C), pages 88-102.
    4. Wang, Shaomin & Wang, Shouxiang & Chen, Haiwen & Gu, Qiang, 2020. "Multi-energy load forecasting for regional integrated energy systems considering temporal dynamic and coupling characteristics," Energy, Elsevier, vol. 195(C).
    5. Zhang, Xiaofeng & Kong, Xiaoying & Yan, Renshi & Liu, Yuting & Xia, Peng & Sun, Xiaoqin & Zeng, Rong & Li, Hongqiang, 2023. "Data-driven cooling, heating and electrical load prediction for building integrated with electric vehicles considering occupant travel behavior," Energy, Elsevier, vol. 264(C).
    6. Wang, Tao & Seo, Seongwon & Liao, Pin-Chao & Fang, Dongping, 2016. "GHG emission reduction performance of state-of-the-art green buildings: Review of two case studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 56(C), pages 484-493.
    7. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    8. Cai, Mengmeng & Pipattanasomporn, Manisa & Rahman, Saifur, 2019. "Day-ahead building-level load forecasts using deep learning vs. traditional time-series techniques," Applied Energy, Elsevier, vol. 236(C), pages 1078-1088.
    9. Liu, Junqiang & Pan, Chunlu & Lei, Fan & Hu, Dongbin & Zuo, Hongfu, 2021. "Fault prediction of bearings based on LSTM and statistical process analysis," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    10. Zhang, Tianren & Huang, Yuping & Liao, Hui & Liang, Yu, 2023. "A hybrid electric vehicle load classification and forecasting approach based on GBDT algorithm and temporal convolutional network," Applied Energy, Elsevier, vol. 351(C).
    11. Li, Yang & Wang, Bin & Yang, Zhen & Li, Jiazheng & Chen, Chen, 2022. "Hierarchical stochastic scheduling of multi-community integrated energy systems in uncertain environments via Stackelberg game," Applied Energy, Elsevier, vol. 308(C).
    12. Yin, Linfei & Xie, Jiaxing, 2021. "Multi-temporal-spatial-scale temporal convolution network for short-term load forecasting of power systems," Applied Energy, Elsevier, vol. 283(C).
    13. Fekri, Mohammad Navid & Patel, Harsh & Grolinger, Katarina & Sharma, Vinay, 2021. "Deep learning for load forecasting with smart meter data: Online Adaptive Recurrent Neural Network," Applied Energy, Elsevier, vol. 282(PA).
    14. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yan, Qin & Lu, Zhiying & Liu, Hong & He, Xingtang & Zhang, Xihai & Guo, Jianlin, 2024. "Short-term prediction of integrated energy load aggregation using a bi-directional simple recurrent unit network with feature-temporal attention mechanism ensemble learning model," Applied Energy, Elsevier, vol. 355(C).
    2. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    3. Alexandra L’Heureux & Katarina Grolinger & Miriam A. M. Capretz, 2022. "Transformer-Based Model for Electrical Load Forecasting," Energies, MDPI, vol. 15(14), pages 1-23, July.
    4. Zheng, Ling & Zhou, Bin & Cao, Yijia & Wing Or, Siu & Li, Yong & Wing Chan, Ka, 2022. "Hierarchical distributed multi-energy demand response for coordinated operation of building clusters," Applied Energy, Elsevier, vol. 308(C).
    5. Lu, Zhiming & Gao, Yan & Xu, Chuanbo, 2021. "Evaluation of energy management system for regional integrated energy system under interval type-2 hesitant fuzzy environment," Energy, Elsevier, vol. 222(C).
    6. Zhu, Jizhong & Dong, Hanjiang & Zheng, Weiye & Li, Shenglin & Huang, Yanting & Xi, Lei, 2022. "Review and prospect of data-driven techniques for load forecasting in integrated energy systems," Applied Energy, Elsevier, vol. 321(C).
    7. Ge Zhang & Songyang Zhu & Xiaoqing Bai, 2022. "Federated Learning-Based Multi-Energy Load Forecasting Method Using CNN-Attention-LSTM Model," Sustainability, MDPI, vol. 14(19), pages 1-14, October.
    8. Wang, Yongli & Wang, Huan & Meng, Xiao & Dong, Huanran & Chen, Xin & Xiang, Hao & Xing, Juntai, 2023. "Considering the dual endogenous-exogenous uncertainty integrated energy multiple load short-term forecast," Energy, Elsevier, vol. 285(C).
    9. Ma, Xin & Peng, Bo & Ma, Xiangxue & Tian, Changbin & Yan, Yi, 2023. "Multi-timescale optimization scheduling of regional integrated energy system based on source-load joint forecasting," Energy, Elsevier, vol. 283(C).
    10. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2023. "A novel short-term multi-energy load forecasting method for integrated energy system based on feature separation-fusion technology and improved CNN," Applied Energy, Elsevier, vol. 351(C).
    11. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    12. Xie, Xiangmin & Ding, Yuhao & Sun, Yuanyuan & Zhang, Zhisheng & Fan, Jianhua, 2024. "A novel time-series probabilistic forecasting method for multi-energy loads," Energy, Elsevier, vol. 306(C).
    13. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    14. Islam, Md. Zahidul & Lin, Yuzhang & Vokkarane, Vinod M. & Yu, Nanpeng, 2023. "Robust learning-based real-time load estimation using sparsely deployed smart meters with high reporting rates," Applied Energy, Elsevier, vol. 352(C).
    15. Shi, Jian & Teh, Jiashen & Alharbi, Bader & Lai, Ching-Ming, 2024. "Load forecasting for regional integrated energy system based on two-phase decomposition and mixture prediction model," Energy, Elsevier, vol. 297(C).
    16. Guo, Yanhua & Wang, Ningbo & Shao, Shuangquan & Huang, Congqi & Zhang, Zhentao & Li, Xiaoqiong & Wang, Youdong, 2024. "A review on hybrid physics and data-driven modeling methods applied in air source heat pump systems for energy efficiency improvement," Renewable and Sustainable Energy Reviews, Elsevier, vol. 204(C).
    17. Wang, Yongli & Ma, Yuze & Song, Fuhao & Ma, Yang & Qi, Chengyuan & Huang, Feifei & Xing, Juntai & Zhang, Fuwei, 2020. "Economic and efficient multi-objective operation optimization of integrated energy system considering electro-thermal demand response," Energy, Elsevier, vol. 205(C).
    18. Stefan Ungureanu & Vasile Topa & Andrei Cristinel Cziker, 2021. "Analysis for Non-Residential Short-Term Load Forecasting Using Machine Learning and Statistical Methods with Financial Impact on the Power Market," Energies, MDPI, vol. 14(21), pages 1-26, October.
    19. Liu, Jiefeng & Zhang, Zhenhao & Fan, Xianhao & Zhang, Yiyi & Wang, Jiaqi & Zhou, Ke & Liang, Shuo & Yu, Xiaoyong & Zhang, Wei, 2022. "Power system load forecasting using mobility optimization and multi-task learning in COVID-19," Applied Energy, Elsevier, vol. 310(C).
    20. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:373:y:2024:i:c:s0306261924011711. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.