IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v274y2023ics0360544223007156.html
   My bibliography  Save this article

Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption

Author

Listed:
  • Gonçalves, Rui
  • Ribeiro, Vitor Miguel
  • Pereira, Fernando Lobo

Abstract

The accurate prediction of electric power consumption in the residential sector is a desirable action to minimize potential energy losses and maximize social welfare. The goal of this study is to propose a new Deep Learning Neural Network architecture for multivariate time series problems, which includes a novel attention mechanism applied to the Convolutional Long Short-Term Memory Network model. The new attention mechanism is implemented with convolutional layers, splits the data by explanatory variable, incorporates the cyclical segmentation of data by day, and uses causal and roll padding to ensure proper information augmentation before convolutional operations. The output of the attention block is a bi-dimensional context map for each explanatory variable. Considering the Household Electric Power Consumption data set provided by the repository of the University of California at Irvine, the proposed Variable Split Convolutional Attention model is trained, tested, and compared with several alternatives. The main result of this study reveals that the innovative model exhibits the lowest forecasting error.

Suggested Citation

  • Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).
    • Handle: RePEc:eee:energy:v:274:y:2023:i:c:s0360544223007156
    DOI: 10.1016/j.energy.2023.127321
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223007156
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.127321?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Brown, Marilyn A., 2001. "Market failures and barriers as a basis for clean energy policies," Energy Policy, Elsevier, vol. 29(14), pages 1197-1207, November.
    2. Arghira, Nicoleta & Hawarah, Lamis & Ploix, Stéphane & Jacomino, Mireille, 2012. "Prediction of appliances energy use in smart homes," Energy, Elsevier, vol. 48(1), pages 128-134.
    3. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    4. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    5. Li, Wei & Becker, Denis Mike, 2021. "Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling," Energy, Elsevier, vol. 237(C).
    6. Gebhard Kirchgässner & Jürgen Wolters & Uwe Hassler, 2013. "Introduction to Modern Time Series Analysis," Springer Texts in Business and Economics, Springer, edition 2, number 978-3-642-33436-8, December.
    7. James D. Hamilton & Daniel F. Waggoner & Tao Zha, 2007. "Normalization in Econometrics," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 221-252.
    8. Bell, Andrew & Jones, Kelvyn, 2015. "Explaining Fixed Effects: Random Effects Modeling of Time-Series Cross-Sectional and Panel Data," Political Science Research and Methods, Cambridge University Press, vol. 3(1), pages 133-153, January.
    9. Deb, Chirag & Zhang, Fan & Yang, Junjing & Lee, Siew Eang & Shah, Kwok Wei, 2017. "A review on time series forecasting techniques for building energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 902-924.
    10. Chen, Yongbao & Xu, Peng & Chu, Yiyi & Li, Weilin & Wu, Yuntao & Ni, Lizhou & Bao, Yi & Wang, Kun, 2017. "Short-term electrical load forecasting using the Support Vector Regression (SVR) model to calculate the demand response baseline for office buildings," Applied Energy, Elsevier, vol. 195(C), pages 659-670.
    11. Zhang, Wenyu & Chen, Qian & Yan, Jianyong & Zhang, Shuai & Xu, Jiyuan, 2021. "A novel asynchronous deep reinforcement learning model with adaptive early forecasting method and reward incentive mechanism for short-term load forecasting," Energy, Elsevier, vol. 236(C).
    12. Chung, Won Hee & Gu, Yeong Hyeon & Yoo, Seong Joon, 2022. "District heater load forecasting based on machine learning and parallel CNN-LSTM attention," Energy, Elsevier, vol. 246(C).
    13. Koschwitz, D. & Frisch, J. & van Treeck, C., 2018. "Data-driven heating and cooling load predictions for non-residential buildings based on support vector machine regression and NARX Recurrent Neural Network: A comparative study on district scale," Energy, Elsevier, vol. 165(PA), pages 134-142.
    14. Hadjout, D. & Torres, J.F. & Troncoso, A. & Sebaa, A. & Martínez-Álvarez, F., 2022. "Electricity consumption forecasting based on ensemble deep learning with application to the Algerian market," Energy, Elsevier, vol. 243(C).
    15. Qu, Jiaqi & Qian, Zheng & Pei, Yan, 2021. "Day-ahead hourly photovoltaic power forecasting using attention-based CNN-LSTM neural network embedded with multiple relevant and target variables prediction pattern," Energy, Elsevier, vol. 232(C).
    16. Ibrahim, H. & Ilinca, A. & Perron, J., 2008. "Energy storage systems--Characteristics and comparisons," Renewable and Sustainable Energy Reviews, Elsevier, vol. 12(5), pages 1221-1250, June.
    17. Ma, Tai-Yu & Faye, Sébastien, 2022. "Multistep electric vehicle charging station occupancy prediction using hybrid LSTM neural networks," Energy, Elsevier, vol. 244(PB).
    18. Chengdong Li & Zixiang Ding & Dongbin Zhao & Jianqiang Yi & Guiqing Zhang, 2017. "Building Energy Consumption Prediction: An Extreme Deep Learning Approach," Energies, MDPI, vol. 10(10), pages 1-20, October.
    19. Jin-Young Kim & Sung-Bae Cho, 2019. "Electric Energy Consumption Prediction by Deep Learning with State Explainable Autoencoder," Energies, MDPI, vol. 12(4), pages 1-14, February.
    20. Peng, Lu & Wang, Lin & Xia, De & Gao, Qinglu, 2022. "Effective energy consumption forecasting using empirical wavelet transform and long short-term memory," Energy, Elsevier, vol. 238(PB).
    21. Niu, Zhibin & Wu, Junqi & Liu, Xiufeng & Huang, Lizhen & Nielsen, Per Sieverts, 2021. "Understanding energy demand behaviors through spatio-temporal smart meter data analysis," Energy, Elsevier, vol. 226(C).
    22. Beckel, Christian & Sadamori, Leyna & Staake, Thorsten & Santini, Silvia, 2014. "Revealing household characteristics from smart meter data," Energy, Elsevier, vol. 78(C), pages 397-410.
    23. Wei Li & Denis Mike Becker, 2021. "Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling," Papers 2101.05249, arXiv.org, revised Jul 2021.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dalia Mohammed Talat Ebrahim Ali & Violeta Motuzienė & Rasa Džiugaitė-Tumėnienė, 2024. "AI-Driven Innovations in Building Energy Management Systems: A Review of Potential Applications and Energy Savings," Energies, MDPI, vol. 17(17), pages 1-35, August.
    2. Gonçalves, Rui & Ribeiro, Vitor Miguel, 2024. "Convolutional attention with roll padding: Classifying PM2.5 concentration levels in the city of Beijing," Energy, Elsevier, vol. 289(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Seok-Jun Bu & Sung-Bae Cho, 2020. "Time Series Forecasting with Multi-Headed Attention-Based Deep Learning for Residential Energy Consumption," Energies, MDPI, vol. 13(18), pages 1-16, September.
    2. Liu, Gang & Wang, Kun & Hao, Xiaochen & Zhang, Zhipeng & Zhao, Yantao & Xu, Qingquan, 2022. "SA-LSTMs: A new advance prediction method of energy consumption in cement raw materials grinding system," Energy, Elsevier, vol. 241(C).
    3. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    4. Ling, Jihong & Zhang, Bingyang & Dai, Na & Xing, Jincheng, 2023. "Coupling input feature construction methods and machine learning algorithms for hourly secondary supply temperature prediction," Energy, Elsevier, vol. 278(C).
    5. Khan, Zulfiqar Ahmad & Khan, Shabbir Ahmad & Hussain, Tanveer & Baik, Sung Wook, 2024. "DSPM: Dual sequence prediction model for efficient energy management in micro-grid," Applied Energy, Elsevier, vol. 356(C).
    6. Tovar Rosas, Mario A. & Pérez, Miguel Robles & Martínez Pérez, E. Rafael, 2022. "Itineraries for charging and discharging a BESS using energy predictions based on a CNN-LSTM neural network model in BCS, Mexico," Renewable Energy, Elsevier, vol. 188(C), pages 1141-1165.
    7. Sharma, Abhishek & Jain, Sachin Kumar, 2022. "A novel seasonal segmentation approach for day-ahead load forecasting," Energy, Elsevier, vol. 257(C).
    8. Khan, Zulfiqar Ahmad & Hussain, Tanveer & Baik, Sung Wook, 2023. "Dual stream network with attention mechanism for photovoltaic power forecasting," Applied Energy, Elsevier, vol. 338(C).
    9. Sergio Cantillo-Luna & Ricardo Moreno-Chuquen & Jesus Lopez-Sotelo & David Celeita, 2023. "An Intra-Day Electricity Price Forecasting Based on a Probabilistic Transformer Neural Network Architecture," Energies, MDPI, vol. 16(19), pages 1-24, September.
    10. Peng, Jieyang & Kimmig, Andreas & Niu, Zhibin & Wang, Jiahai & Liu, Xiufeng & Ovtcharova, Jivka, 2021. "A flexible potential-flow model based high resolution spatiotemporal energy demand forecasting framework," Applied Energy, Elsevier, vol. 299(C).
    11. Fernández, Joaquín Delgado & Menci, Sergio Potenciano & Lee, Chul Min & Rieger, Alexander & Fridgen, Gilbert, 2022. "Privacy-preserving federated learning for residential short-term load forecasting," Applied Energy, Elsevier, vol. 326(C).
    12. van Zyl, Corne & Ye, Xianming & Naidoo, Raj, 2024. "Harnessing eXplainable artificial intelligence for feature selection in time series energy forecasting: A comparative analysis of Grad-CAM and SHAP," Applied Energy, Elsevier, vol. 353(PA).
    13. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).
    14. Ijaz Ul Haq & Amin Ullah & Samee Ullah Khan & Noman Khan & Mi Young Lee & Seungmin Rho & Sung Wook Baik, 2021. "Sequential Learning-Based Energy Consumption Prediction Model for Residential and Commercial Sectors," Mathematics, MDPI, vol. 9(6), pages 1-17, March.
    15. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    16. Sun, Hongchang & Niu, Yanlei & Li, Chengdong & Zhou, Changgeng & Zhai, Wenwen & Chen, Zhe & Wu, Hao & Niu, Lanqiang, 2022. "Energy consumption optimization of building air conditioning system via combining the parallel temporal convolutional neural network and adaptive opposition-learning chimp algorithm," Energy, Elsevier, vol. 259(C).
    17. Wu, Han & Liang, Yan & Heng, Jiani, 2023. "Pulse-diagnosis-inspired multi-feature extraction deep network for short-term electricity load forecasting," Applied Energy, Elsevier, vol. 339(C).
    18. Chou, Jui-Sheng & Tran, Duc-Son, 2018. "Forecasting energy consumption time series using machine learning techniques based on usage patterns of residential householders," Energy, Elsevier, vol. 165(PB), pages 709-726.
    19. Liu, Xiufeng & Nielsen, Per Sieverts, 2016. "A hybrid ICT-solution for smart meter data analytics," Energy, Elsevier, vol. 115(P3), pages 1710-1722.
    20. Peng, Shiliang & Fan, Lin & Zhang, Li & Su, Huai & He, Yuxuan & He, Qian & Wang, Xiao & Yu, Dejun & Zhang, Jinjun, 2024. "Spatio-temporal prediction of total energy consumption in multiple regions using explainable deep neural network," Energy, Elsevier, vol. 301(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:274:y:2023:i:c:s0360544223007156. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.