IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v313y2022ics0306261922002483.html
   My bibliography  Save this article

Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism

Author

Listed:
  • Niu, Dongxiao
  • Yu, Min
  • Sun, Lijie
  • Gao, Tian
  • Wang, Keke

Abstract

Accurate short-term multi-energy load forecasting is an essential prerequisite for ensuring the reliable and economic operation of integrated energy systems (IES). Considering the large fluctuations, strong randomness, and the multi-energy coupling relationship of regional IES, this paper proposes a novel short-term multi-energy load forecasting method based on a CNN-BiGRU model that is optimized by attention mechanism. First, the dynamic coupling relationship between multi-energy loads is qualitatively analyzed, and the influencing factors of multi-energ loads are screened based on data-driven analysis. Second, a one-dimensional CNN layer is formulated to extract complex high-dimensional features, and BiGRU is constructed to extract the time dependence from historical sequences. In particular, three attention mechanism modules are introduced to the BiGRU hidden state through the mapping weight and learning parameter matrix to enhance the impact of key information. Then, hard weight sharing is adopted to extract the inherent multi-energy coupling relationship. Finally, a novel multi-task loss function weight optimization method is applied to search for the optimal multi-task weight, which is used to balance multi-task learning (MTL) to achieve the optimization of the overall forecasting model. To validate the effectiveness of the CNN-BiGRU-Attention MTL model with loss function optimization, this paper compares the proposed model with five benchmark models by MAPE, RMSE, MAE, R2, and computational time. Compared with the traditional LSTM model, the cooling, heat, and electrical load forecasting accuracy (measured by MAPE) of the proposed hybrid model increased by 61.86%, 73.03%, and 63.39%, respectively, which demonstrates that the proposed model exhibits superior performance.

Suggested Citation

  • Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
  • Handle: RePEc:eee:appene:v:313:y:2022:i:c:s0306261922002483
    DOI: 10.1016/j.apenergy.2022.118801
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261922002483
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2022.118801?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Yongli & Wang, Yudong & Huang, Yujing & Li, Fang & Zeng, Ming & Li, Jiapu & Wang, Xiaohai & Zhang, Fuwei, 2019. "Planning and operation method of the regional integrated energy system considering economy and environment," Energy, Elsevier, vol. 171(C), pages 731-750.
    2. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    3. Qadrdan, Meysam & Chaudry, Modassar & Wu, Jianzhong & Jenkins, Nick & Ekanayake, Janaka, 2010. "Impact of a large penetration of wind generation on the GB gas network," Energy Policy, Elsevier, vol. 38(10), pages 5684-5695, October.
    4. Guo, Zhifeng & Zhou, Kaile & Zhang, Xiaoling & Yang, Shanlin, 2018. "A deep learning model for short-term power load and probability density forecasting," Energy, Elsevier, vol. 160(C), pages 1186-1200.
    5. Jebli, Imane & Belouadha, Fatima-Zahra & Kabbaj, Mohammed Issam & Tilioua, Amine, 2021. "Prediction of solar energy guided by pearson correlation using machine learning," Energy, Elsevier, vol. 224(C).
    6. Huang, Qian & Li, Jinghua & Zhu, Mengshu, 2020. "An improved convolutional neural network with load range discretization for probabilistic load forecasting," Energy, Elsevier, vol. 203(C).
    7. Wang, Shaomin & Wang, Shouxiang & Chen, Haiwen & Gu, Qiang, 2020. "Multi-energy load forecasting for regional integrated energy systems considering temporal dynamic and coupling characteristics," Energy, Elsevier, vol. 195(C).
    8. Aqdas Naz & Nadeem Javaid & Muhammad Babar Rasheed & Abdul Haseeb & Musaed Alhussein & Khursheed Aurangzeb, 2019. "Game Theoretical Energy Management with Storage Capacity Optimization and Photo-Voltaic Cell Generated Power Forecasting in Micro Grid," Sustainability, MDPI, vol. 11(10), pages 1-22, May.
    9. Ömer Özgür Bozkurt & Göksel Biricik & Ziya Cihan Tayşi, 2017. "Artificial neural network and SARIMA based models for power load forecasting in Turkish electricity market," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-24, April.
    10. Spoladore, Alessandro & Borelli, Davide & Devia, Francesco & Mora, Flavio & Schenone, Corrado, 2016. "Model for forecasting residential heat demand based on natural gas consumption and energy performance indicators," Applied Energy, Elsevier, vol. 182(C), pages 488-499.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    2. Zheng, Ling & Zhou, Bin & Cao, Yijia & Wing Or, Siu & Li, Yong & Wing Chan, Ka, 2022. "Hierarchical distributed multi-energy demand response for coordinated operation of building clusters," Applied Energy, Elsevier, vol. 308(C).
    3. Lu, Shixiang & Xu, Qifa & Jiang, Cuixia & Liu, Yezheng & Kusiak, Andrew, 2022. "Probabilistic load forecasting with a non-crossing sparse-group Lasso-quantile regression deep neural network," Energy, Elsevier, vol. 242(C).
    4. Zhou, Guangzhao & Guo, Zanquan & Sun, Simin & Jin, Qingsheng, 2023. "A CNN-BiGRU-AM neural network for AI applications in shale oil production prediction," Applied Energy, Elsevier, vol. 344(C).
    5. Mayer, Martin János & Biró, Bence & Szücs, Botond & Aszódi, Attila, 2023. "Probabilistic modeling of future electricity systems with high renewable energy penetration using machine learning," Applied Energy, Elsevier, vol. 336(C).
    6. Eren, Yavuz & Küçükdemiral, İbrahim, 2024. "A comprehensive review on deep learning approaches for short-term load forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    7. Qian, Fanyue & Gao, Weijun & Yang, Yongwen & Yu, Dan, 2020. "Potential analysis of the transfer learning model in short and medium-term forecasting of building HVAC energy consumption," Energy, Elsevier, vol. 193(C).
    8. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    9. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    10. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    11. Hafeez, Ghulam & Alimgeer, Khurram Saleem & Khan, Imran, 2020. "Electric load forecasting based on deep learning and optimized by heuristic algorithm in smart grid," Applied Energy, Elsevier, vol. 269(C).
    12. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    13. Lu, Zhiming & Gao, Yan & Xu, Chuanbo, 2021. "Evaluation of energy management system for regional integrated energy system under interval type-2 hesitant fuzzy environment," Energy, Elsevier, vol. 222(C).
    14. Wang, Jingfan & Tchapmi, Lyne P. & Ravikumar, Arvind P. & McGuire, Mike & Bell, Clay S. & Zimmerle, Daniel & Savarese, Silvio & Brandt, Adam R., 2020. "Machine vision for natural gas methane emissions detection using an infrared camera," Applied Energy, Elsevier, vol. 257(C).
    15. Hwang, Jun Kwon & Yun, Geun Young & Lee, Sukho & Seo, Hyeongjoon & Santamouris, Mat, 2020. "Using deep learning approaches with variable selection process to predict the energy performance of a heating and cooling system," Renewable Energy, Elsevier, vol. 149(C), pages 1227-1245.
    16. Deb, Chirag & Dai, Zhonghao & Schlueter, Arno, 2021. "A machine learning-based framework for cost-optimal building retrofit," Applied Energy, Elsevier, vol. 294(C).
    17. Seok-Jun Bu & Sung-Bae Cho, 2020. "Time Series Forecasting with Multi-Headed Attention-Based Deep Learning for Residential Energy Consumption," Energies, MDPI, vol. 13(18), pages 1-16, September.
    18. Wang, Yongli & Ma, Yuze & Song, Fuhao & Ma, Yang & Qi, Chengyuan & Huang, Feifei & Xing, Juntai & Zhang, Fuwei, 2020. "Economic and efficient multi-objective operation optimization of integrated energy system considering electro-thermal demand response," Energy, Elsevier, vol. 205(C).
    19. Haoran Zhao & Sen Guo, 2021. "Uncertain Interval Forecasting for Combined Electricity-Heat-Cooling-Gas Loads in the Integrated Energy System Based on Multi-Task Learning and Multi-Kernel Extreme Learning Machine," Mathematics, MDPI, vol. 9(14), pages 1-32, July.
    20. Wang, Yongli & Wang, Yudong & Huang, Yujing & Yang, Jiale & Ma, Yuze & Yu, Haiyang & Zeng, Ming & Zhang, Fuwei & Zhang, Yanfu, 2019. "Operation optimization of regional integrated energy system based on the modeling of electricity-thermal-natural gas network," Applied Energy, Elsevier, vol. 251(C), pages 1-1.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:313:y:2022:i:c:s0306261922002483. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.