IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v278y2023ipas0360544223012598.html
   My bibliography  Save this article

Multi-head attention-based probabilistic CNN-BiLSTM for day-ahead wind speed forecasting

Author

Listed:
  • Zhang, Yi-Ming
  • Wang, Hao

Abstract

Wind energy is one of the most widely used and fastest-growing renewable energy. Wind speed prediction is an efficient way to rationally dispatch wind power generation and ensure the stability of the power system. Typical deep learning algorithms, such as the convolution neural network (CNN), long short-term memory (LSTM), and their hybrid model (CNN-LSTM), have been extensively used for time-series prediction in various fields. The CNN-LSTM model exhibits superior forecasting performance by integrating the advantages of CNN and LSTM, but it fails to quantify the forecasting uncertainty that is critical for optimal management. This study proposes a probabilistic model to forecast day-ahead wind speed based on the CNN-bidirectional LSTM (BiLSTM) and deep ensemble strategy. Unlike purely statistical methods, the hybrid physical-statistical model that combines the numerical weather prediction (NWP) model and onsite measurements is employed to improve long-term forecasting accuracy. Specifically, the probabilistic CNN-BiLSTM model is developed by adjusting the network structure, and the uncertainty is optimized through a proper scoring rule. A combination of ensembles is then used to improve the robustness of probabilistic prediction. The spatial and temporal correlations of NWP data are both considered. The new probabilistic model is applied to forecast wind speed in measurements collected from the outdoor competition venues in the 2022 Winter Olympics. Nine probabilistic benchmark methods are used to compare the performance of the proposed deep ensemble model. The results indicate that the proposed model exhibits the highest forecasting accuracy and the best ability in uncertainty estimation.

Suggested Citation

  • Zhang, Yi-Ming & Wang, Hao, 2023. "Multi-head attention-based probabilistic CNN-BiLSTM for day-ahead wind speed forecasting," Energy, Elsevier, vol. 278(PA).
  • Handle: RePEc:eee:energy:v:278:y:2023:i:pa:s0360544223012598
    DOI: 10.1016/j.energy.2023.127865
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223012598
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2023.127865?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hu, Jianming & Wang, Jianzhou, 2015. "Short-term wind speed prediction using empirical wavelet transform and Gaussian process regression," Energy, Elsevier, vol. 93(P2), pages 1456-1466.
    2. Al-Yahyai, Sultan & Charabi, Yassine & Gastli, Adel, 2010. "Review of the use of Numerical Weather Prediction (NWP) Models for wind energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(9), pages 3192-3198, December.
    3. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    4. Lopes, Francis M. & Conceição, Ricardo & Silva, Hugo G. & Salgado, Rui & Collares-Pereira, Manuel, 2021. "Improved ECMWF forecasts of direct normal irradiance: A tool for better operational strategies in concentrating solar power plants," Renewable Energy, Elsevier, vol. 163(C), pages 755-771.
    5. Hoolohan, Victoria & Tomlin, Alison S. & Cockerill, Timothy, 2018. "Improved near surface wind speed predictions using Gaussian process regression combined with numerical weather predictions and observed meteorological data," Renewable Energy, Elsevier, vol. 126(C), pages 1043-1054.
    6. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    7. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    8. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    9. Yu, Enbo & Xu, Guoji & Han, Yan & Li, Yongle, 2022. "An efficient short-term wind speed prediction model based on cross-channel data integration and attention mechanisms," Energy, Elsevier, vol. 256(C).
    10. Liu, Guanjun & Qin, Hui & Shen, Qin & Lyv, Hao & Qu, Yuhua & Fu, Jialong & Liu, Yongqi & Zhou, Jianzhong, 2021. "Probabilistic spatiotemporal solar irradiation forecasting using deep ensembles convolutional shared weight long short-term memory network," Applied Energy, Elsevier, vol. 300(C).
    11. Ahmad, Tanveer & Zhang, Dongdong, 2022. "A data-driven deep sequence-to-sequence long-short memory method along with a gated recurrent neural network for wind power forecasting," Energy, Elsevier, vol. 239(PB).
    12. Liu, Yongqi & Qin, Hui & Zhang, Zhendong & Pei, Shaoqian & Jiang, Zhiqiang & Feng, Zhongkai & Zhou, Jianzhong, 2020. "Probabilistic spatiotemporal wind speed forecasting based on a variational Bayesian deep learning model," Applied Energy, Elsevier, vol. 260(C).
    13. Kim, Gyeongmin & Hur, Jin, 2021. "Probabilistic modeling of wind energy potential for power grid expansion planning," Energy, Elsevier, vol. 230(C).
    14. Zhang, Yu & Li, Yanting & Zhang, Guangyao, 2020. "Short-term wind power forecasting approach based on Seq2Seq model using NWP data," Energy, Elsevier, vol. 213(C).
    15. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    16. Feng, Cong & Cui, Mingjian & Hodge, Bri-Mathias & Zhang, Jie, 2017. "A data-driven multi-model methodology with deep feature selection for short-term wind forecasting," Applied Energy, Elsevier, vol. 190(C), pages 1245-1257.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dong, Juan & Xing, Liwen & Cui, Ningbo & Zhao, Lu & Guo, Li & Wang, Zhihui & Du, Taisheng & Tan, Mingdong & Gong, Daozhi, 2024. "Estimating reference crop evapotranspiration using improved convolutional bidirectional long short-term memory network by multi-head attention mechanism in the four climatic zones of China," Agricultural Water Management, Elsevier, vol. 292(C).
    2. Zhang, Chu & Li, Zhengbo & Ge, Yida & Liu, Qianlong & Suo, Leiming & Song, Shihao & Peng, Tian, 2024. "Enhancing short-term wind speed prediction based on an outlier-robust ensemble deep random vector functional link network with AOA-optimized VMD," Energy, Elsevier, vol. 296(C).
    3. Yan, Xiuying & Ji, Xingxing & Meng, Qinglong & Sun, Hang & Lei, Yu, 2024. "A hybrid prediction model of improved bidirectional long short-term memory network for cooling load based on PCANet and attention mechanism," Energy, Elsevier, vol. 292(C).
    4. Wang, Shuangxin & Shi, Jiarong & Yang, Wei & Yin, Qingyan, 2024. "High and low frequency wind power prediction based on Transformer and BiGRU-Attention," Energy, Elsevier, vol. 288(C).
    5. Huang, Xiaojia & Wang, Chen & Zhang, Shenghui, 2024. "Research and application of a Model selection forecasting system for wind speed and theoretical power generation in wind farms based on classification and wind conversion," Energy, Elsevier, vol. 293(C).
    6. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    3. Cai, Haoshu & Jia, Xiaodong & Feng, Jianshe & Yang, Qibo & Li, Wenzhe & Li, Fei & Lee, Jay, 2021. "A unified Bayesian filtering framework for multi-horizon wind speed prediction with improved accuracy," Renewable Energy, Elsevier, vol. 178(C), pages 709-719.
    4. Tang, Yugui & Yang, Kuo & Zhang, Shujing & Zhang, Zhen, 2024. "Wind power forecasting: A temporal domain generalization approach incorporating hybrid model and adversarial relationship-based training," Applied Energy, Elsevier, vol. 355(C).
    5. Tang, Yugui & Yang, Kuo & Zheng, Yichu & Ma, Li & Zhang, Shujing & Zhang, Zhen, 2024. "Wind power forecasting: A transfer learning approach incorporating temporal convolution and adversarial training," Renewable Energy, Elsevier, vol. 224(C).
    6. Bashir, Hassan & Sibtain, Muhammad & Hanay, Özge & Azam, Muhammad Imran & Qurat-ul-Ain, & Saleem, Snoober, 2023. "Decomposition and Harris hawks optimized multivariate wind speed forecasting utilizing sequence2sequence-based spatiotemporal attention," Energy, Elsevier, vol. 278(PB).
    7. Zhao, Jing & Guo, Zhenhai & Guo, Yanling & Lin, Wantao & Zhu, Wenjin, 2021. "A self-organizing forecast of day-ahead wind speed: Selective ensemble strategy based on numerical weather predictions," Energy, Elsevier, vol. 218(C).
    8. Yang, Yang & Lang, Jin & Wu, Jian & Zhang, Yanyan & Su, Lijie & Song, Xiangman, 2022. "Wind speed forecasting with correlation network pruning and augmentation: A two-phase deep learning method," Renewable Energy, Elsevier, vol. 198(C), pages 267-282.
    9. Zhao, Jing & Guo, Yiyi & Lin, Yihua & Zhao, Zhiyuan & Guo, Zhenhai, 2024. "A novel dynamic ensemble of numerical weather prediction for multi-step wind speed forecasting with deep reinforcement learning and error sequence modeling," Energy, Elsevier, vol. 302(C).
    10. Liu, Guanjun & Wang, Yun & Qin, Hui & Shen, Keyan & Liu, Shuai & Shen, Qin & Qu, Yuhua & Zhou, Jianzhong, 2023. "Probabilistic spatiotemporal forecasting of wind speed based on multi-network deep ensembles method," Renewable Energy, Elsevier, vol. 209(C), pages 231-247.
    11. Dai, Xiaoran & Liu, Guo-Ping & Hu, Wenshan, 2023. "An online-learning-enabled self-attention-based model for ultra-short-term wind power forecasting," Energy, Elsevier, vol. 272(C).
    12. Li, Yang & Wang, Ruinong & Li, Yuanzheng & Zhang, Meng & Long, Chao, 2023. "Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach," Applied Energy, Elsevier, vol. 329(C).
    13. Huang, Jing & Qin, Rui, 2024. "Elman neural network considering dynamic time delay estimation for short-term forecasting of offshore wind power," Applied Energy, Elsevier, vol. 358(C).
    14. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    15. Parri, Srihari & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "A hybrid VMD based contextual feature representation approach for wind speed forecasting," Renewable Energy, Elsevier, vol. 219(P1).
    16. Han, Yan & Mi, Lihua & Shen, Lian & Cai, C.S. & Liu, Yuchen & Li, Kai & Xu, Guoji, 2022. "A short-term wind speed prediction method utilizing novel hybrid deep learning algorithms to correct numerical weather forecasting," Applied Energy, Elsevier, vol. 312(C).
    17. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    18. Fang, Ping & Fu, Wenlong & Wang, Kai & Xiong, Dongzhen & Zhang, Kai, 2022. "A compositive architecture coupling outlier correction, EWT, nonlinear Volterra multi-model fusion with multi-objective optimization for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 307(C).
    19. Liang, Tao & Zhao, Qing & Lv, Qingzhao & Sun, Hexu, 2021. "A novel wind speed prediction strategy based on Bi-LSTM, MOOFADA and transfer learning for centralized control centers," Energy, Elsevier, vol. 230(C).
    20. Liu, Xingdou & Zhang, Li & Wang, Jiangong & Zhou, Yue & Gan, Wei, 2023. "A unified multi-step wind speed forecasting framework based on numerical weather prediction grids and wind farm monitoring data," Renewable Energy, Elsevier, vol. 211(C), pages 948-963.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:278:y:2023:i:pa:s0360544223012598. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.