IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v229y2021ics0360544221009312.html
   My bibliography  Save this article

Residential load forecasting based on LSTM fusing self-attention mechanism with pooling

Author

Listed:
  • Zang, Haixiang
  • Xu, Ruiqi
  • Cheng, Lilin
  • Ding, Tao
  • Liu, Ling
  • Wei, Zhinong
  • Sun, Guoqiang

Abstract

Day-ahead residential load forecasting is crucial for electricity dispatch and demand response in power systems. Electrical loads are characterized by volatility and uncertainty caused by external factors, especially for individual residential loads. With the deployment of advanced metering infrastructure, the acquisition of electricity consumptions of multiple residential customers is available. This paper proposes a novel day-ahead residential load forecasting method based on feature engineering, pooling, and a hybrid deep learning model. Feature engineering is performed using two-stage preprocessing on data from each user, i.e., decomposition and multi-source input dimension reconstruction. Pooling is then adopted to merge data from both the target user and its interconnected users, in a descending order based on mutual information. Finally, a hybrid model with two input channels is developed by combining long short-term memory (LSTM) with self-attention mechanism (SAM). The case studies are conducted on a practical dataset containing multiple residential users. Performance of the proposed load forecasting method using data pools of different groups of users as well as different input forms is compared. The effectiveness of input dimension reconstruction and hybrid model is also validated. The overall results demonstrate the superiority of the proposed load forecasting method through comparison with other benchmark methods.

Suggested Citation

  • Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    • Handle: RePEc:eee:energy:v:229:y:2021:i:c:s0360544221009312
    DOI: 10.1016/j.energy.2021.120682
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221009312
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2021.120682?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    2. Wang, Yi & Gan, Dahua & Sun, Mingyang & Zhang, Ning & Lu, Zongxiang & Kang, Chongqing, 2019. "Probabilistic individual load forecasting using pinball loss guided LSTM," Applied Energy, Elsevier, vol. 235(C), pages 10-20.
    3. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    4. Xue, Guixiang & Qi, Chengying & Li, Han & Kong, Xiangfei & Song, Jiancai, 2020. "Heating load prediction based on attention long short term memory: A case study of Xingtai," Energy, Elsevier, vol. 203(C).
    5. Monfared, Houman Jamshidi & Ghasemi, Ahmad & Loni, Abdolah & Marzband, Mousa, 2019. "A hybrid price-based demand response program for the residential micro-grid," Energy, Elsevier, vol. 185(C), pages 274-285.
    6. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    7. Imani, Maryam & Ghassemian, Hassan, 2019. "Residential load forecasting using wavelet and collaborative representation transforms," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    8. Liang, Yi & Niu, Dongxiao & Hong, Wei-Chiang, 2019. "Short term load forecasting based on feature extraction and improved general regression neural network model," Energy, Elsevier, vol. 166(C), pages 653-663.
    9. Hernández, Luis & Baladrón, Carlos & Aguiar, Javier M. & Carro, Belén & Sánchez-Esguevillas, Antonio & Lloret, Jaime, 2014. "Artificial neural networks for short-term load forecasting in microgrids environment," Energy, Elsevier, vol. 75(C), pages 252-264.
    10. Gangqiang Li & Huaizhi Wang & Shengli Zhang & Jiantao Xin & Huichuan Liu, 2019. "Recurrent Neural Networks Based Photovoltaic Power Forecasting Approach," Energies, MDPI, vol. 12(13), pages 1-17, July.
    11. Pappas, S.Sp. & Ekonomou, L. & Karamousantas, D.Ch. & Chatzarakis, G.E. & Katsikas, S.K. & Liatsis, P., 2008. "Electricity demand loads modeling using AutoRegressive Moving Average (ARMA) models," Energy, Elsevier, vol. 33(9), pages 1353-1360.
    12. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda, 2019. "Photovoltaic power forecasting based LSTM-Convolutional Network," Energy, Elsevier, vol. 189(C).
    13. Wang, Jian Qi & Du, Yu & Wang, Jing, 2020. "LSTM based long-term energy consumption prediction with periodicity," Energy, Elsevier, vol. 197(C).
    14. Rafati, Amir & Joorabian, Mahmood & Mashhour, Elaheh, 2020. "An efficient hour-ahead electrical load forecasting method based on innovative features," Energy, Elsevier, vol. 201(C).
    15. Chou, Jui-Sheng & Tran, Duc-Son, 2018. "Forecasting energy consumption time series using machine learning techniques based on usage patterns of residential householders," Energy, Elsevier, vol. 165(PB), pages 709-726.
    16. Zhang, Guoqiang & Guo, Jifeng, 2020. "A novel ensemble method for hourly residential electricity consumption forecasting by imaging time series," Energy, Elsevier, vol. 203(C).
    17. Zheng, Zhuang & Chen, Hainan & Luo, Xiaowei, 2019. "A Kalman filter-based bottom-up approach for household short-term load forecast," Applied Energy, Elsevier, vol. 250(C), pages 882-894.
    18. He, Feifei & Zhou, Jianzhong & Feng, Zhong-kai & Liu, Guangbiao & Yang, Yuqi, 2019. "A hybrid short-term load forecasting model based on variational mode decomposition and long short-term memory networks considering relevant factors with Bayesian optimization algorithm," Applied Energy, Elsevier, vol. 237(C), pages 103-116.
    19. Che, JinXing & Wang, JianZhou, 2014. "Short-term load forecasting using a kernel-based support vector regression combination model," Applied Energy, Elsevier, vol. 132(C), pages 602-609.
    20. Kaytez, Fazil, 2020. "A hybrid approach based on autoregressive integrated moving average and least-square support vector machine for long-term forecasting of net electricity consumption," Energy, Elsevier, vol. 197(C).
    21. Xiao, Liye & Wang, Jianzhou & Hou, Ru & Wu, Jie, 2015. "A combined model based on data pre-analysis and weight coefficients optimization for electrical load forecasting," Energy, Elsevier, vol. 82(C), pages 524-549.
    22. Huang, Qian & Li, Jinghua & Zhu, Mengshu, 2020. "An improved convolutional neural network with load range discretization for probabilistic load forecasting," Energy, Elsevier, vol. 203(C).
    23. Sadaei, Hossein Javedani & de Lima e Silva, Petrônio Cândido & Guimarães, Frederico Gadelha & Lee, Muhammad Hisyam, 2019. "Short-term load forecasting by using a combined method of convolutional neural networks and fuzzy time series," Energy, Elsevier, vol. 175(C), pages 365-377.
    24. Liu, Xin & Zhang, Zijun & Song, Zhe, 2020. "A comparative study of the data-driven day-ahead hourly provincial load forecasting methods: From classical data mining to deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 119(C).
    25. Zang, Haixiang & Liu, Ling & Sun, Li & Cheng, Lilin & Wei, Zhinong & Sun, Guoqiang, 2020. "Short-term global horizontal irradiance forecasting based on a hybrid CNN-LSTM model with spatiotemporal correlations," Renewable Energy, Elsevier, vol. 160(C), pages 26-41.
    26. Vu, D.H. & Muttaqi, K.M. & Agalgaonkar, A.P. & Bouzerdoum, A., 2017. "Short-term electricity demand forecasting using autoregressive based time varying model incorporating representative data adjustment," Applied Energy, Elsevier, vol. 205(C), pages 790-801.
    27. Han, Li & Jing, Huitian & Zhang, Rongchang & Gao, Zhiyu, 2019. "Wind power forecast based on improved Long Short Term Memory network," Energy, Elsevier, vol. 189(C).
    28. Lusis, Peter & Khalilpour, Kaveh Rajab & Andrew, Lachlan & Liebman, Ariel, 2017. "Short-term residential load forecasting: Impact of calendar effects and forecast granularity," Applied Energy, Elsevier, vol. 205(C), pages 654-669.
    29. Cai, Mengmeng & Pipattanasomporn, Manisa & Rahman, Saifur, 2019. "Day-ahead building-level load forecasts using deep learning vs. traditional time-series techniques," Applied Energy, Elsevier, vol. 236(C), pages 1078-1088.
    30. Dedinec, Aleksandra & Filiposka, Sonja & Dedinec, Aleksandar & Kocarev, Ljupco, 2016. "Deep belief network based electricity load forecasting: An analysis of Macedonian case," Energy, Elsevier, vol. 115(P3), pages 1688-1700.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    2. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    3. Mingping Liu & Xihao Sun & Qingnian Wang & Suhui Deng, 2022. "Short-Term Load Forecasting Using EMD with Feature Selection and TCN-Based Deep Learning Model," Energies, MDPI, vol. 15(19), pages 1-22, September.
    4. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    5. Kumari, Pratima & Toshniwal, Durga, 2021. "Long short term memory–convolutional neural network based deep hybrid approach for solar irradiance forecasting," Applied Energy, Elsevier, vol. 295(C).
    6. Fazlipour, Zahra & Mashhour, Elaheh & Joorabian, Mahmood, 2022. "A deep model for short-term load forecasting applying a stacked autoencoder based on LSTM supported by a multi-stage attention mechanism," Applied Energy, Elsevier, vol. 327(C).
    7. Somu, Nivethitha & M R, Gauthama Raman & Ramamritham, Krithi, 2020. "A hybrid model for building energy consumption forecasting using long short term memory networks," Applied Energy, Elsevier, vol. 261(C).
    8. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    9. Zhang, Guoqiang & Guo, Jifeng, 2020. "A novel ensemble method for hourly residential electricity consumption forecasting by imaging time series," Energy, Elsevier, vol. 203(C).
    10. Lee, Juyong & Cho, Youngsang, 2022. "National-scale electricity peak load forecasting: Traditional, machine learning, or hybrid model?," Energy, Elsevier, vol. 239(PD).
    11. Spiliotis, Evangelos & Petropoulos, Fotios & Kourentzes, Nikolaos & Assimakopoulos, Vassilios, 2020. "Cross-temporal aggregation: Improving the forecast accuracy of hierarchical electricity consumption," Applied Energy, Elsevier, vol. 261(C).
    12. Seok-Jun Bu & Sung-Bae Cho, 2020. "Time Series Forecasting with Multi-Headed Attention-Based Deep Learning for Residential Energy Consumption," Energies, MDPI, vol. 13(18), pages 1-16, September.
    13. Fan, Guo-Feng & Peng, Li-Ling & Hong, Wei-Chiang, 2018. "Short term load forecasting based on phase space reconstruction algorithm and bi-square kernel regression model," Applied Energy, Elsevier, vol. 224(C), pages 13-33.
    14. Jonathan Berrisch & Micha{l} Narajewski & Florian Ziel, 2022. "High-Resolution Peak Demand Estimation Using Generalized Additive Models and Deep Neural Networks," Papers 2203.03342, arXiv.org, revised Nov 2022.
    15. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).
    16. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    17. Khan, Zulfiqar Ahmad & Khan, Shabbir Ahmad & Hussain, Tanveer & Baik, Sung Wook, 2024. "DSPM: Dual sequence prediction model for efficient energy management in micro-grid," Applied Energy, Elsevier, vol. 356(C).
    18. Arash Moradzadeh & Sahar Zakeri & Maryam Shoaran & Behnam Mohammadi-Ivatloo & Fazel Mohammadi, 2020. "Short-Term Load Forecasting of Microgrid via Hybrid Support Vector Regression and Long Short-Term Memory Algorithms," Sustainability, MDPI, vol. 12(17), pages 1-17, August.
    19. Mario Tovar & Miguel Robles & Felipe Rashid, 2020. "PV Power Prediction, Using CNN-LSTM Hybrid Neural Network Model. Case of Study: Temixco-Morelos, México," Energies, MDPI, vol. 13(24), pages 1-15, December.
    20. Duan, Jikai & Zuo, Hongchao & Bai, Yulong & Chang, Mingheng & Chen, Xiangyue & Wang, Wenpeng & Ma, Lei & Chen, Bolong, 2023. "A multistep short-term solar radiation forecasting model using fully convolutional neural networks and chaotic aquila optimization combining WRF-Solar model results," Energy, Elsevier, vol. 271(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:229:y:2021:i:c:s0360544221009312. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.