IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v272y2023ics0360544223005674.html
   My bibliography  Save this article

An online-learning-enabled self-attention-based model for ultra-short-term wind power forecasting

Author

Listed:
  • Dai, Xiaoran
  • Liu, Guo-Ping
  • Hu, Wenshan

Abstract

Renewable wind power accounts for an increasing proportion of the smart grid nowadays. The intermittent and fluctuating nature of wind renders wind power forecasting important. Recently, deep learning techniques have shown great potential in wind power forecasting, yet the existing methods mainly employ the “offline training–online forecasting” scheme which cannot capture the time-varying relations in wind power sequences. In this paper, a self-attention-based neural network (SANN) is conceived for online learning. Explicitly, the SANN model captures the temporal relations in power sequences via the self-attention mechanism. Unlike the popular recurrent deep learning structure in time series prediction, the SANN model is recurrence-free and allows parallel computation in the procedure of online learning. Meanwhile, the online learning algorithm is capable of adapting to the weather, operational, and several environmental variations, thus improving the forecasting accuracy. Finally, experiments are carried out on two real-world datasets with different characteristics. The experiments assure that our approach is superior to the conventional counterpart and hence validate the effectiveness.

Suggested Citation

  • Dai, Xiaoran & Liu, Guo-Ping & Hu, Wenshan, 2023. "An online-learning-enabled self-attention-based model for ultra-short-term wind power forecasting," Energy, Elsevier, vol. 272(C).
  • Handle: RePEc:eee:energy:v:272:y:2023:i:c:s0360544223005674
    DOI: 10.1016/j.energy.2023.127173
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223005674
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2023.127173?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    2. Zhang, Fei & Li, Peng-Cheng & Gao, Lu & Liu, Yong-Qian & Ren, Xiao-Ying, 2021. "Application of autoregressive dynamic adaptive (ARDA) model in real-time wind power forecasting," Renewable Energy, Elsevier, vol. 169(C), pages 129-143.
    3. Li, Dan & Jiang, Fuxin & Chen, Min & Qian, Tao, 2022. "Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks," Energy, Elsevier, vol. 238(PC).
    4. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    5. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    6. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    7. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    8. Lledó, Ll. & Torralba, V. & Soret, A. & Ramon, J. & Doblas-Reyes, F.J., 2019. "Seasonal forecasts of wind power generation," Renewable Energy, Elsevier, vol. 143(C), pages 91-100.
    9. Mangalova, Ekaterina & Shesterneva, Olesya, 2016. "K-nearest neighbors for GEFCom2014 probabilistic wind power forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1067-1073.
    10. Niu, Dongxiao & Sun, Lijie & Yu, Min & Wang, Keke, 2022. "Point and interval forecasting of ultra-short-term wind power based on a data-driven method and hybrid deep learning model," Energy, Elsevier, vol. 254(PA).
    11. Fekri, Mohammad Navid & Patel, Harsh & Grolinger, Katarina & Sharma, Vinay, 2021. "Deep learning for load forecasting with smart meter data: Online Adaptive Recurrent Neural Network," Applied Energy, Elsevier, vol. 282(PA).
    12. Zhang, Yu & Li, Yanting & Zhang, Guangyao, 2020. "Short-term wind power forecasting approach based on Seq2Seq model using NWP data," Energy, Elsevier, vol. 213(C).
    13. Carneiro, Tatiane C. & Rocha, Paulo A.C. & Carvalho, Paulo C.M. & Fernández-Ramírez, Luis M., 2022. "Ridge regression ensemble of machine learning models applied to solar and wind forecasting in Brazil and Spain," Applied Energy, Elsevier, vol. 314(C).
    14. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    15. Khazaei, Sahra & Ehsan, Mehdi & Soleymani, Soodabeh & Mohammadnezhad-Shourkaei, Hosein, 2022. "A high-accuracy hybrid method for short-term wind power forecasting," Energy, Elsevier, vol. 238(PC).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Yongning & Pan, Shiji & Zhao, Yuan & Liao, Haohan & Ye, Lin & Zheng, Yingying, 2024. "Ultra-short-term wind power forecasting based on personalized robust federated learning with spatial collaboration," Energy, Elsevier, vol. 288(C).
    2. Han Peng & Songyin Li & Linjian Shangguan & Yisa Fan & Hai Zhang, 2023. "Analysis of Wind Turbine Equipment Failure and Intelligent Operation and Maintenance Research," Sustainability, MDPI, vol. 15(10), pages 1-35, May.
    3. Wang, Shuangxin & Shi, Jiarong & Yang, Wei & Yin, Qingyan, 2024. "High and low frequency wind power prediction based on Transformer and BiGRU-Attention," Energy, Elsevier, vol. 288(C).
    4. Wang, Cong & He, Yan & Zhang, Hong-li & Ma, Ping, 2024. "Wind power forecasting based on manifold learning and a double-layer SWLSTM model," Energy, Elsevier, vol. 290(C).
    5. Wu, Han & Liang, Yan & Gao, Xiao-Zhi & Du, Pei, 2024. "Auditory-circuit-motivated deep network with application to short-term electricity price forecasting," Energy, Elsevier, vol. 288(C).
    6. Zhang, Rongquan & Bu, Siqi & Li, Gangqiang, 2024. "Multi-market P2P trading of cooling–heating-power-hydrogen integrated energy systems: An equilibrium-heuristic online prediction optimization approach," Applied Energy, Elsevier, vol. 367(C).
    7. Wang, Xiaodi & Hao, Yan & Yang, Wendong, 2024. "Novel wind power ensemble forecasting system based on mixed-frequency modeling and interpretable base model selection strategy," Energy, Elsevier, vol. 297(C).
    8. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).
    9. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Fractional-order long-term price guidance mechanism based on bidirectional prediction with attention mechanism for electric vehicle charging," Energy, Elsevier, vol. 293(C).
    10. Tang, Yugui & Zhang, Shujing & Zhang, Zhen, 2024. "A privacy-preserving framework integrating federated learning and transfer learning for wind power forecasting," Energy, Elsevier, vol. 286(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    2. Han Peng & Songyin Li & Linjian Shangguan & Yisa Fan & Hai Zhang, 2023. "Analysis of Wind Turbine Equipment Failure and Intelligent Operation and Maintenance Research," Sustainability, MDPI, vol. 15(10), pages 1-35, May.
    3. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    4. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    5. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    6. Tang, Yugui & Yang, Kuo & Zhang, Shujing & Zhang, Zhen, 2024. "Wind power forecasting: A temporal domain generalization approach incorporating hybrid model and adversarial relationship-based training," Applied Energy, Elsevier, vol. 355(C).
    7. Wang, Xiaodi & Hao, Yan & Yang, Wendong, 2024. "Novel wind power ensemble forecasting system based on mixed-frequency modeling and interpretable base model selection strategy," Energy, Elsevier, vol. 297(C).
    8. Tang, Yugui & Yang, Kuo & Zheng, Yichu & Ma, Li & Zhang, Shujing & Zhang, Zhen, 2024. "Wind power forecasting: A transfer learning approach incorporating temporal convolution and adversarial training," Renewable Energy, Elsevier, vol. 224(C).
    9. Bashir, Hassan & Sibtain, Muhammad & Hanay, Özge & Azam, Muhammad Imran & Qurat-ul-Ain, & Saleem, Snoober, 2023. "Decomposition and Harris hawks optimized multivariate wind speed forecasting utilizing sequence2sequence-based spatiotemporal attention," Energy, Elsevier, vol. 278(PB).
    10. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    11. Natei Ermias Benti & Mesfin Diro Chaka & Addisu Gezahegn Semie, 2023. "Forecasting Renewable Energy Generation with Machine Learning and Deep Learning: Current Advances and Future Prospects," Sustainability, MDPI, vol. 15(9), pages 1-33, April.
    12. Fachrizal Aksan & Yang Li & Vishnu Suresh & Przemysław Janik, 2023. "Multistep Forecasting of Power Flow Based on LSTM Autoencoder: A Study Case in Regional Grid Cluster Proposal," Energies, MDPI, vol. 16(13), pages 1-20, June.
    13. Wen, Songkang & Li, Yanting & Su, Yan, 2022. "A new hybrid model for power forecasting of a wind farm using spatial–temporal correlations," Renewable Energy, Elsevier, vol. 198(C), pages 155-168.
    14. Al-qaness, Mohammed A.A. & Ewees, Ahmed A. & Fan, Hong & Abualigah, Laith & Elaziz, Mohamed Abd, 2022. "Boosted ANFIS model using augmented marine predator algorithm with mutation operators for wind power forecasting," Applied Energy, Elsevier, vol. 314(C).
    15. Hou, Guolian & Wang, Junjie & Fan, Yuzhen & Zhang, Jianhua & Huang, Congzhi, 2024. "A novel wind power deterministic and interval prediction framework based on the critic weight method, improved northern goshawk optimization, and kernel density estimation," Renewable Energy, Elsevier, vol. 226(C).
    16. Zhang, Yi-Ming & Wang, Hao, 2023. "Multi-head attention-based probabilistic CNN-BiLSTM for day-ahead wind speed forecasting," Energy, Elsevier, vol. 278(PA).
    17. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    18. Wu, Zhou & Zeng, Shaoxiong & Jiang, Ruiqi & Zhang, Haoran & Yang, Zhile, 2023. "Explainable temporal dependence in multi-step wind power forecast via decomposition based chain echo state networks," Energy, Elsevier, vol. 270(C).
    19. Liu, Chenyu & Zhang, Xuemin & Mei, Shengwei & Zhou, Qingyu & Fan, Hang, 2023. "Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction," Applied Energy, Elsevier, vol. 336(C).
    20. Parri, Srihari & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "A hybrid VMD based contextual feature representation approach for wind speed forecasting," Renewable Energy, Elsevier, vol. 219(P1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:272:y:2023:i:c:s0360544223005674. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.