IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v293y2024ics0360544224004389.html
   My bibliography  Save this article

CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability

Author

Listed:
  • Tian, Zhirui
  • Liu, Weican
  • Jiang, Wenqian
  • Wu, Chenye

Abstract

Independent system operators (ISOs) are pursuing day-ahead probabilistic load forecasting as it offers comprehensive load trend and pattern information. Compared with commonly adopted point forecasting, it enables ISOs to better understand the uncertainty of future demand through interval forecasting with varying confidence levels. In practice, this advantage could enable precise day-ahead forecasting for critical days with irregular load patterns (e.g., weekends or holidays), particularly when the data availability is limited. To this end, we customize a day-ahead probabilistic load forecasting framework with an emphasis on weekends based on data processing and probabilistic deep learning. Specifically, data processing combines data denoising and data augmentation techniques, incorporating peak and trend information into the denoised one-dimensional time series data to aid training. This procedure helps extract more information from the restricted training samples. The probabilistic deep learning, CNNs-Transformer, combines multi-layer Convolutional Neural Networks and Transformer, adopting QRLoss (quantile regression loss function) to achieve probabilistic forecasting. The loss penalty technique enhances the model’s attention to weekend data. Numerical studies based on field data suggest that the proposed framework can obtain accurate day-ahead probabilistic forecasting results (48-time points of the whole day) by using only two-week historical data, and the accuracy improvement over its rivals is remarkable on weekends.

Suggested Citation

  • Tian, Zhirui & Liu, Weican & Jiang, Wenqian & Wu, Chenye, 2024. "CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability," Energy, Elsevier, vol. 293(C).
  • Handle: RePEc:eee:energy:v:293:y:2024:i:c:s0360544224004389
    DOI: 10.1016/j.energy.2024.130666
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224004389
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.130666?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," Applied Energy, Elsevier, vol. 301(C).
    2. Wang, Jianzhou & Xing, Qianyi & Zeng, Bo & Zhao, Weigang, 2022. "An ensemble forecasting system for short-term power load based on multi-objective optimizer and fuzzy granulation," Applied Energy, Elsevier, vol. 327(C).
    3. Morais, Lucas Barros Scianni & Aquila, Giancarlo & de Faria, Victor Augusto Durães & Lima, Luana Medeiros Marangon & Lima, José Wanderley Marangon & de Queiroz, Anderson Rodrigo, 2023. "Short-term load forecasting using neural networks and global climate models: An application to a large-scale electrical power system," Applied Energy, Elsevier, vol. 348(C).
    4. Tian, Zhirui & Gai, Mei, 2023. "A novel hybrid wind speed prediction framework based on multi-strategy improved optimizer and new data pre-processing system with feedback mechanism," Energy, Elsevier, vol. 281(C).
    5. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    6. Huang, Qian & Li, Jinghua & Zhu, Mengshu, 2020. "An improved convolutional neural network with load range discretization for probabilistic load forecasting," Energy, Elsevier, vol. 203(C).
    7. Fu, Wenlong & Fu, Yuchen & Li, Bailing & Zhang, Hairong & Zhang, Xuanrui & Liu, Jiarui, 2023. "A compound framework incorporating improved outlier detection and correction, VMD, weight-based stacked generalization with enhanced DESMA for multi-step short-term wind speed forecasting," Applied Energy, Elsevier, vol. 348(C).
    8. Zhao, Zhenyu & Zhang, Yao & Yang, Yujia & Yuan, Shuguang, 2022. "Load forecasting via Grey Model-Least Squares Support Vector Machine model and spatial-temporal distribution of electric consumption intensity," Energy, Elsevier, vol. 255(C).
    9. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).
    10. Lv, Zhihan & Wang, Nana & Lou, Ranran & Tian, Yajun & Guizani, Mohsen, 2023. "Towards carbon Neutrality: Prediction of wave energy based on improved GRU in Maritime transportation," Applied Energy, Elsevier, vol. 331(C).
    11. Zhu, Bangzhu & Wan, Chunzhuo & Wang, Ping, 2022. "Interval forecasting of carbon price: A novel multiscale ensemble forecasting approach," Energy Economics, Elsevier, vol. 115(C).
    12. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    13. Lai, Changzhi & Wang, Yu & Fan, Kai & Cai, Qilin & Ye, Qing & Pang, Haoqiang & Wu, Xi, 2022. "An improved forecasting model of short-term electric load of papermaking enterprises for production line optimization," Energy, Elsevier, vol. 245(C).
    14. Tang, Mengcheng & Zhuang, Weichao & Li, Bingbing & Liu, Haoji & Song, Ziyou & Yin, Guodong, 2023. "Energy-optimal routing for electric vehicles using deep reinforcement learning with transformer," Applied Energy, Elsevier, vol. 350(C).
    15. Tian, Zhirui & Wang, Jiyang, 2023. "A wind speed prediction system based on new data preprocessing strategy and improved multi-objective optimizer," Renewable Energy, Elsevier, vol. 215(C).
    16. Rubasinghe, Osaka & Zhang, Tingze & Zhang, Xinan & Choi, San Shing & Chau, Tat Kei & Chow, Yau & Fernando, Tyrone & Iu, Herbert Ho-Ching, 2023. "Highly accurate peak and valley prediction short-term net load forecasting approach based on decomposition for power systems with high PV penetration," Applied Energy, Elsevier, vol. 333(C).
    17. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    18. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," LSE Research Online Documents on Economics 120774, London School of Economics and Political Science, LSE Library.
    19. Chaturvedi, Shobhit & Rajasekar, Elangovan & Natarajan, Sukumar & McCullen, Nick, 2022. "A comparative assessment of SARIMA, LSTM RNN and Fb Prophet models to forecast total and peak monthly energy demand for India," Energy Policy, Elsevier, vol. 168(C).
    20. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).
    21. Li, Jinghua & Luo, Yichen & Wei, Shanyang, 2022. "Long-term electricity consumption forecasting method based on system dynamics under the carbon-neutral target," Energy, Elsevier, vol. 244(PA).
    22. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    23. Abou Houran, Mohamad & Salman Bukhari, Syed M. & Zafar, Muhammad Hamza & Mansoor, Majad & Chen, Wenjie, 2023. "COA-CNN-LSTM: Coati optimization algorithm-based hybrid deep learning model for PV/wind power forecasting in smart grid applications," Applied Energy, Elsevier, vol. 349(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fan, Jingmin & Zhong, Mingwei & Guan, Yuanpeng & Yi, Siqi & Xu, Cancheng & Zhai, Yanpeng & Zhou, Yongwang, 2024. "An online long-term load forecasting method: Hierarchical highway network based on crisscross feature collaboration," Energy, Elsevier, vol. 299(C).
    2. Xu, Huifeng & Hu, Feihu & Liang, Xinhao & Zhao, Guoqing & Abugunmi, Mohammad, 2024. "A framework for electricity load forecasting based on attention mechanism time series depthwise separable convolutional neural network," Energy, Elsevier, vol. 299(C).
    3. Tian, Chenlu & Liu, Yechun & Zhang, Guiqing & Yang, Yalong & Yan, Yi & Li, Chengdong, 2024. "Transfer learning based hybrid model for power demand prediction of large-scale electric vehicles," Energy, Elsevier, vol. 300(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xu, Huifeng & Hu, Feihu & Liang, Xinhao & Zhao, Guoqing & Abugunmi, Mohammad, 2024. "A framework for electricity load forecasting based on attention mechanism time series depthwise separable convolutional neural network," Energy, Elsevier, vol. 299(C).
    2. Yifei Chen & Zhihan Fu, 2023. "Multi-Step Ahead Forecasting of the Energy Consumed by the Residential and Commercial Sectors in the United States Based on a Hybrid CNN-BiLSTM Model," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    3. Gomez, William & Wang, Fu-Kwun & Lo, Shih-Che, 2024. "A hybrid approach based machine learning models in electricity markets," Energy, Elsevier, vol. 289(C).
    4. Nie, Ying & Li, Ping & Wang, Jianzhou & Zhang, Lifang, 2024. "A novel multivariate electrical price bi-forecasting system based on deep learning, a multi-input multi-output structure and an operator combination mechanism," Applied Energy, Elsevier, vol. 366(C).
    5. Lin, Zijie & Xie, Linbo & Zhang, Siyuan, 2024. "A compound framework for short-term gas load forecasting combining time-enhanced perception transformer and two-stage feature extraction," Energy, Elsevier, vol. 298(C).
    6. Ma, Xin & Peng, Bo & Ma, Xiangxue & Tian, Changbin & Yan, Yi, 2023. "Multi-timescale optimization scheduling of regional integrated energy system based on source-load joint forecasting," Energy, Elsevier, vol. 283(C).
    7. Yin, Linfei & Zhou, Hang, 2024. "Modal decomposition integrated model for ultra-supercritical coal-fired power plant reheater tube temperature multi-step prediction," Energy, Elsevier, vol. 292(C).
    8. Zhou, Guangzhao & Guo, Zanquan & Sun, Simin & Jin, Qingsheng, 2023. "A CNN-BiGRU-AM neural network for AI applications in shale oil production prediction," Applied Energy, Elsevier, vol. 344(C).
    9. Lin, Shengmao & Wang, Shu & Xu, Xuefang & Li, Ruixiong & Shi, Peiming, 2024. "GAOformer: An adaptive spatiotemporal feature fusion transformer utilizing GAT and optimizable graph matrixes for offshore wind speed prediction," Energy, Elsevier, vol. 292(C).
    10. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    11. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Fractional-order long-term price guidance mechanism based on bidirectional prediction with attention mechanism for electric vehicle charging," Energy, Elsevier, vol. 293(C).
    12. Yan, Xiuying & Ji, Xingxing & Meng, Qinglong & Sun, Hang & Lei, Yu, 2024. "A hybrid prediction model of improved bidirectional long short-term memory network for cooling load based on PCANet and attention mechanism," Energy, Elsevier, vol. 292(C).
    13. Yang, Yi & Xing, Qianyi & Wang, Kang & Li, Caihong & Wang, Jianzhou & Huang, Xiaojia, 2024. "A novel combined probabilistic load forecasting system integrating hybrid quantile regression and knee improved multi-objective optimization strategy," Applied Energy, Elsevier, vol. 356(C).
    14. Jiang, Ben & Li, Yu & Rezgui, Yacine & Zhang, Chengyu & Wang, Peng & Zhao, Tianyi, 2024. "Multi-source domain generalization deep neural network model for predicting energy consumption in multiple office buildings," Energy, Elsevier, vol. 299(C).
    15. Fargalla, Mandella Ali M. & Yan, Wei & Deng, Jingen & Wu, Tao & Kiyingi, Wyclif & Li, Guangcong & Zhang, Wei, 2024. "TimeNet: Time2Vec attention-based CNN-BiGRU neural network for predicting production in shale and sandstone gas reservoirs," Energy, Elsevier, vol. 290(C).
    16. Yan, Qin & Lu, Zhiying & Liu, Hong & He, Xingtang & Zhang, Xihai & Guo, Jianlin, 2024. "Short-term prediction of integrated energy load aggregation using a bi-directional simple recurrent unit network with feature-temporal attention mechanism ensemble learning model," Applied Energy, Elsevier, vol. 355(C).
    17. Rao, Yanchun & Wang, Xiuli & Li, Hengkai, 2024. "Forecasting electricity consumption in China's Pearl River Delta urban agglomeration under the optimal economic growth path with low-carbon goals: Based on data of NPP-VIIRS-like nighttime light," Energy, Elsevier, vol. 294(C).
    18. Yuvaraj Natarajan & Sri Preethaa K. R. & Gitanjali Wadhwa & Young Choi & Zengshun Chen & Dong-Eun Lee & Yirong Mi, 2024. "Enhancing Building Energy Efficiency with IoT-Driven Hybrid Deep Learning Models for Accurate Energy Consumption Prediction," Sustainability, MDPI, vol. 16(5), pages 1-23, February.
    19. Xiao, Wenjing & Mo, Li & Xu, Zhanxing & Liu, Chang & Zhang, Yongchuan, 2024. "A hybrid electric load forecasting model based on decomposition considering fisher information," Applied Energy, Elsevier, vol. 364(C).
    20. Gao, Huanxiang & Hu, Gang & Zhang, Dongqin & Jiang, Wenjun & Ren, Hehe & Chen, Wenli, 2024. "Prediction of wind fields in mountains at multiple elevations using deep learning models," Applied Energy, Elsevier, vol. 353(PA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:293:y:2024:i:c:s0360544224004389. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.