IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v299y2024ics0360544224010314.html
   My bibliography  Save this article

A framework for electricity load forecasting based on attention mechanism time series depthwise separable convolutional neural network

Author

Listed:
  • Xu, Huifeng
  • Hu, Feihu
  • Liang, Xinhao
  • Zhao, Guoqing
  • Abugunmi, Mohammad

Abstract

Electricity load exhibits daily and weekly cyclical patterns as well as random characteristics. At present, prevailing deep learning models cannot learn electricity load cyclical and stochastic features adequately. This results in insufficient prediction accuracy and the scalability of current methods. To tackle these difficulties, this paper proposes a framework for electrical load prediction based on an Attention Mechanism Time Series Depthwise Separable Convolutional Neural Network (ELPF-ATDSCN). The framework starts by using the Maximum Information Coefficient for exogenous variable selection. It then incorporates a seasonal decomposition algorithm with manual feature engineering to extract the cyclical and stochastic features of the electrical load. Subsequently, the framework employs the ATDSCN to learn the cyclical and stochastic features of the electrical load. In addition, the Bayesian algorithm optimizes model hyperparameters for optimal model performance. Experimental results of point and interval load prediction on datasets from the US and Nordic power markets reveal that the ATDSCN model proposed in this paper enhances load prediction accuracy compared with other models. It can provide more reliable predictions for power system operation and dispatch.

Suggested Citation

  • Xu, Huifeng & Hu, Feihu & Liang, Xinhao & Zhao, Guoqing & Abugunmi, Mohammad, 2024. "A framework for electricity load forecasting based on attention mechanism time series depthwise separable convolutional neural network," Energy, Elsevier, vol. 299(C).
    • Handle: RePEc:eee:energy:v:299:y:2024:i:c:s0360544224010314
    DOI: 10.1016/j.energy.2024.131258
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224010314
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.131258?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).
    2. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    3. Tian, Zhirui & Liu, Weican & Jiang, Wenqian & Wu, Chenye, 2024. "CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability," Energy, Elsevier, vol. 293(C).
    4. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    5. Bu, Xiangya & Wu, Qiuwei & Zhou, Bin & Li, Canbing, 2023. "Hybrid short-term load forecasting using CGAN with CNN and semi-supervised regression," Applied Energy, Elsevier, vol. 338(C).
    6. He, Yaoyao & Cao, Chaojin & Wang, Shuo & Fu, Hong, 2022. "Nonparametric probabilistic load forecasting based on quantile combination in electrical power systems," Applied Energy, Elsevier, vol. 322(C).
    7. Shi, Jiaqi & Li, Chenxi & Yan, Xiaohe, 2023. "Artificial intelligence for load forecasting: A stacking learning approach based on ensemble diversity regularization," Energy, Elsevier, vol. 262(PB).
    8. Yin, Linfei & Xie, Jiaxing, 2021. "Multi-temporal-spatial-scale temporal convolution network for short-term load forecasting of power systems," Applied Energy, Elsevier, vol. 283(C).
    9. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).
    10. Wu, Han & Liang, Yan & Heng, Jiani, 2023. "Pulse-diagnosis-inspired multi-feature extraction deep network for short-term electricity load forecasting," Applied Energy, Elsevier, vol. 339(C).
    11. Wang, Kang & Wang, Jianzhou & Zeng, Bo & Lu, Haiyan, 2022. "An integrated power load point-interval forecasting system based on information entropy and multi-objective optimization," Applied Energy, Elsevier, vol. 314(C).
    12. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    13. Kong, Xiangyu & Li, Chuang & Wang, Chengshan & Zhang, Yusen & Zhang, Jian, 2020. "Short-term electrical load forecasting based on error correction using dynamic mode decomposition," Applied Energy, Elsevier, vol. 261(C).
    14. Zhang, Shu & Wang, Yi & Zhang, Yutian & Wang, Dan & Zhang, Ning, 2020. "Load probability density forecasting by transforming and combining quantile forecasts," Applied Energy, Elsevier, vol. 277(C).
    15. Wang, Jianzhou & Gao, Jialu & Wei, Danxiang, 2022. "Electric load prediction based on a novel combined interval forecasting system," Applied Energy, Elsevier, vol. 322(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tian, Zhirui & Liu, Weican & Jiang, Wenqian & Wu, Chenye, 2024. "CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability," Energy, Elsevier, vol. 293(C).
    2. Yang, Yi & Xing, Qianyi & Wang, Kang & Li, Caihong & Wang, Jianzhou & Huang, Xiaojia, 2024. "A novel combined probabilistic load forecasting system integrating hybrid quantile regression and knee improved multi-objective optimization strategy," Applied Energy, Elsevier, vol. 356(C).
    3. Fan, Jingmin & Zhong, Mingwei & Guan, Yuanpeng & Yi, Siqi & Xu, Cancheng & Zhai, Yanpeng & Zhou, Yongwang, 2024. "An online long-term load forecasting method: Hierarchical highway network based on crisscross feature collaboration," Energy, Elsevier, vol. 299(C).
    4. Gomez, William & Wang, Fu-Kwun & Lo, Shih-Che, 2024. "A hybrid approach based machine learning models in electricity markets," Energy, Elsevier, vol. 289(C).
    5. Yu, Binbin & Li, Jianjing & Liu, Che & Sun, Bo, 2022. "A novel short-term electrical load forecasting framework with intelligent feature engineering," Applied Energy, Elsevier, vol. 327(C).
    6. Giancarlo Aquila & Lucas Barros Scianni Morais & Victor Augusto Durães de Faria & José Wanderley Marangon Lima & Luana Medeiros Marangon Lima & Anderson Rodrigo de Queiroz, 2023. "An Overview of Short-Term Load Forecasting for Electricity Systems Operational Planning: Machine Learning Methods and the Brazilian Experience," Energies, MDPI, vol. 16(21), pages 1-35, November.
    7. Sharma, Abhishek & Jain, Sachin Kumar, 2022. "A novel seasonal segmentation approach for day-ahead load forecasting," Energy, Elsevier, vol. 257(C).
    8. Tian, Zhirui & Gai, Mei, 2023. "A novel hybrid wind speed prediction framework based on multi-strategy improved optimizer and new data pre-processing system with feedback mechanism," Energy, Elsevier, vol. 281(C).
    9. Mustafa Saglam & Xiaojing Lv & Catalina Spataru & Omer Ali Karaman, 2024. "Instantaneous Electricity Peak Load Forecasting Using Optimization and Machine Learning," Energies, MDPI, vol. 17(4), pages 1-22, February.
    10. Fanidhar Dewangan & Almoataz Y. Abdelaziz & Monalisa Biswal, 2023. "Load Forecasting Models in Smart Grid Using Smart Meter Information: A Review," Energies, MDPI, vol. 16(3), pages 1-55, January.
    11. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Fractional-order long-term price guidance mechanism based on bidirectional prediction with attention mechanism for electric vehicle charging," Energy, Elsevier, vol. 293(C).
    12. Yan, Xiuying & Ji, Xingxing & Meng, Qinglong & Sun, Hang & Lei, Yu, 2024. "A hybrid prediction model of improved bidirectional long short-term memory network for cooling load based on PCANet and attention mechanism," Energy, Elsevier, vol. 292(C).
    13. Mingping Liu & Xihao Sun & Qingnian Wang & Suhui Deng, 2022. "Short-Term Load Forecasting Using EMD with Feature Selection and TCN-Based Deep Learning Model," Energies, MDPI, vol. 15(19), pages 1-22, September.
    14. Xiao, Xun & Mo, Huadong & Zhang, Yinan & Shan, Guangcun, 2022. "Meta-ANN – A dynamic artificial neural network refined by meta-learning for Short-Term Load Forecasting," Energy, Elsevier, vol. 246(C).
    15. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).
    16. Tong, Jianfeng & Liu, Zhenxing & Zhang, Yong & Zheng, Xiujuan & Jin, Junyang, 2023. "Improved multi-gate mixture-of-experts framework for multi-step prediction of gas load," Energy, Elsevier, vol. 282(C).
    17. Kandpal, Bakul & Pareek, Parikshit & Verma, Ashu, 2022. "A robust day-ahead scheduling strategy for EV charging stations in unbalanced distribution grid," Energy, Elsevier, vol. 249(C).
    18. Zhang, Yagang & Wang, Hui & Wang, Jingchao & Cheng, Xiaodan & Wang, Tong & Zhao, Zheng, 2024. "Ensemble optimization approach based on hybrid mode decomposition and intelligent technology for wind power prediction system," Energy, Elsevier, vol. 292(C).
    19. Liu, Che & Sun, Bo & Zhang, Chenghui & Li, Fan, 2020. "A hybrid prediction model for residential electricity consumption using holt-winters and extreme learning machine," Applied Energy, Elsevier, vol. 275(C).
    20. Khan, Waqas & Somers, Ward & Walker, Shalika & de Bont, Kevin & Van der Velden, Joep & Zeiler, Wim, 2023. "Comparison of electric vehicle load forecasting across different spatial levels with incorporated uncertainty estimation," Energy, Elsevier, vol. 283(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:299:y:2024:i:c:s0360544224010314. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.