IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i8p3446-d1123574.html
   My bibliography  Save this article

Pre-Attention Mechanism and Convolutional Neural Network Based Multivariate Load Prediction for Demand Response

Author

Listed:
  • Zheyu He

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Rongheng Lin

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Budan Wu

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Xin Zhao

    (Economic & Research Institute, State Grid Shandong Electric Power Company, Jinan 250021, China)

  • Hua Zou

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

Abstract

The construction of smart grids has greatly changed the power grid pattern and power supply structure. For the power system, reasonable power planning and demand response is necessary to ensure the stable operation of a society. Accurate load prediction is the basis for realizing demand response for the power system. This paper proposes a Pre-Attention-CNN-GRU model (PreAttCG) which combines a convolutional neural network (CNN) and gate recurrent unit (GRU) and applies the attention mechanism in front of the whole model. The PreAttCG model accepts historical load data and more than nine other factors (including temperature, wind speed, humidity, etc.) as input. The attention layer and CNN layer effectively extract the features and weights of each factor. Load forecasting is then performed by the prediction layer, which consists of a stacked GRU. The model is verified by industrial load data from a German dataset and a Chinese dataset from the real world. The results show that the PreAttCG model has better performance (3~5% improvement in MAPE) than both LSTM with only load input and LSTM with all factors. Additionally, the experiments also show that the attention mechanism can effectively extract the weights of relevant factors affecting the load data.

Suggested Citation

  • Zheyu He & Rongheng Lin & Budan Wu & Xin Zhao & Hua Zou, 2023. "Pre-Attention Mechanism and Convolutional Neural Network Based Multivariate Load Prediction for Demand Response," Energies, MDPI, vol. 16(8), pages 1-13, April.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:8:p:3446-:d:1123574
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/8/3446/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/8/3446/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fan, Cheng & Xiao, Fu & Zhao, Yang, 2017. "A short-term building cooling load prediction method using deep learning algorithms," Applied Energy, Elsevier, vol. 195(C), pages 222-233.
    2. Hany Habbak & Mohamed Mahmoud & Khaled Metwally & Mostafa M. Fouda & Mohamed I. Ibrahem, 2023. "Load Forecasting Techniques and Their Applications in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    3. Huang, Yanmei & Hasan, Najmul & Deng, Changrui & Bao, Yukun, 2022. "Multivariate empirical mode decomposition based hybrid model for day-ahead peak load forecasting," Energy, Elsevier, vol. 239(PC).
    4. Zhang, Wenyu & Chen, Qian & Yan, Jianyong & Zhang, Shuai & Xu, Jiyuan, 2021. "A novel asynchronous deep reinforcement learning model with adaptive early forecasting method and reward incentive mechanism for short-term load forecasting," Energy, Elsevier, vol. 236(C).
    5. Xing, Yazhou & Zhang, Su & Wen, Peng & Shao, Limin & Rouyendegh, Babak Daneshvar, 2020. "Load prediction in short-term implementing the multivariate quantile regression," Energy, Elsevier, vol. 196(C).
    6. Zhang, Guoqiang & Guo, Jifeng, 2020. "A novel ensemble method for residential electricity demand forecasting based on a novel sample simulation strategy," Energy, Elsevier, vol. 207(C).
    7. Imani, Maryam, 2021. "Electrical load-temperature CNN for residential load forecasting," Energy, Elsevier, vol. 227(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hesen Zuo & Wengang Zheng & Mingfei Wang & Xin Zhang, 2023. "Prediction of Heat and Cold Loads of Factory Mushroom Houses Based on EWT Decomposition," Sustainability, MDPI, vol. 15(21), pages 1-19, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiakang Wang & Hui Liu & Guangji Zheng & Ye Li & Shi Yin, 2023. "Short-Term Load Forecasting Based on Outlier Correction, Decomposition, and Ensemble Reinforcement Learning," Energies, MDPI, vol. 16(11), pages 1-16, May.
    2. Eren, Yavuz & Küçükdemiral, İbrahim, 2024. "A comprehensive review on deep learning approaches for short-term load forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    3. Huang, Yanmei & Hasan, Najmul & Deng, Changrui & Bao, Yukun, 2022. "Multivariate empirical mode decomposition based hybrid model for day-ahead peak load forecasting," Energy, Elsevier, vol. 239(PC).
    4. Mingping Liu & Xihao Sun & Qingnian Wang & Suhui Deng, 2022. "Short-Term Load Forecasting Using EMD with Feature Selection and TCN-Based Deep Learning Model," Energies, MDPI, vol. 15(19), pages 1-22, September.
    5. Shi, Jiaqi & Li, Chenxi & Yan, Xiaohe, 2023. "Artificial intelligence for load forecasting: A stacking learning approach based on ensemble diversity regularization," Energy, Elsevier, vol. 262(PB).
    6. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    7. Amir Shahcheraghian & Adrian Ilinca, 2024. "Advanced Machine Learning Techniques for Energy Consumption Analysis and Optimization at UBC Campus: Correlations with Meteorological Variables," Energies, MDPI, vol. 17(18), pages 1-22, September.
    8. Zhang, Yagang & Wang, Hui & Wang, Jingchao & Cheng, Xiaodan & Wang, Tong & Zhao, Zheng, 2024. "Ensemble optimization approach based on hybrid mode decomposition and intelligent technology for wind power prediction system," Energy, Elsevier, vol. 292(C).
    9. Sun, Alexander Y., 2020. "Optimal carbon storage reservoir management through deep reinforcement learning," Applied Energy, Elsevier, vol. 278(C).
    10. Moaaz Elkabalawy & Abobakr Al-Sakkaf & Eslam Mohammed Abdelkader & Ghasan Alfalah, 2024. "CRISP-DM-Based Data-Driven Approach for Building Energy Prediction Utilizing Indoor and Environmental Factors," Sustainability, MDPI, vol. 16(17), pages 1-21, August.
    11. Liu, Che & Sun, Bo & Zhang, Chenghui & Li, Fan, 2020. "A hybrid prediction model for residential electricity consumption using holt-winters and extreme learning machine," Applied Energy, Elsevier, vol. 275(C).
    12. Fu, Chun & Miller, Clayton, 2022. "Using Google Trends as a proxy for occupant behavior to predict building energy consumption," Applied Energy, Elsevier, vol. 310(C).
    13. Rongjiang Ma & Shen Yang & Xianlin Wang & Xi-Cheng Wang & Ming Shan & Nanyang Yu & Xudong Yang, 2020. "Systematic Method for the Energy-Saving Potential Calculation of Air-Conditioning Systems via Data Mining. Part I: Methodology," Energies, MDPI, vol. 14(1), pages 1-15, December.
    14. Türkoğlu, A. Selim & Erkmen, Burcu & Eren, Yavuz & Erdinç, Ozan & Küçükdemiral, İbrahim, 2024. "Integrated Approaches in Resilient Hierarchical Load Forecasting via TCN and Optimal Valley Filling Based Demand Response Application," Applied Energy, Elsevier, vol. 360(C).
    15. Alfredo Candela Esclapez & Miguel López García & Sergio Valero Verdú & Carolina Senabre Blanes, 2022. "Automatic Selection of Temperature Variables for Short-Term Load Forecasting," Sustainability, MDPI, vol. 14(20), pages 1-22, October.
    16. Fan, Cheng & Sun, Yongjun & Xiao, Fu & Ma, Jie & Lee, Dasheng & Wang, Jiayuan & Tseng, Yen Chieh, 2020. "Statistical investigations of transfer learning-based methodology for short-term building energy predictions," Applied Energy, Elsevier, vol. 262(C).
    17. Gautham Krishnadas & Aristides Kiprakis, 2020. "A Machine Learning Pipeline for Demand Response Capacity Scheduling," Energies, MDPI, vol. 13(7), pages 1-25, April.
    18. Jessica Walther & Matthias Weigold, 2021. "A Systematic Review on Predicting and Forecasting the Electrical Energy Consumption in the Manufacturing Industry," Energies, MDPI, vol. 14(4), pages 1-24, February.
    19. Wei, Ziqing & Zhang, Tingwei & Yue, Bao & Ding, Yunxiao & Xiao, Ran & Wang, Ruzhu & Zhai, Xiaoqiang, 2021. "Prediction of residential district heating load based on machine learning: A case study," Energy, Elsevier, vol. 231(C).
    20. Stefano Villa & Claudio Sassanelli, 2020. "The Data-Driven Multi-Step Approach for Dynamic Estimation of Buildings’ Interior Temperature," Energies, MDPI, vol. 13(24), pages 1-23, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:8:p:3446-:d:1123574. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.