IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v294y2024ics0360544224004985.html
   My bibliography  Save this article

A wind speed forcasting model based on rime optimization based VMD and multi-headed self-attention-LSTM

Author

Listed:
  • Liu, Wenhui
  • Bai, Yulong
  • Yue, Xiaoxin
  • Wang, Rui
  • Song, Qi

Abstract

Due to the nonlinearity, fluctuation, and intermittency of wind speed, its accurate prediction is essential for improving efficiency in wind power operation systems. In this regard, a hybrid model that combines the rime optimization algorithm (RIME), variational mode decomposition (VMD), multi-headed self-attention (MSA) mechanism and long short-term memory (LSTM) is proposed for wind speed prediction. First, the number of modes and VMD penalty parameter are optimized with RIME, the optimized parameters are brought into the VMD to decompose the raw wind speeds, and a Lagrange multiplier and quadratic penalty function are introduced to obtain the input series. Then, a LSTM short-term wind speed prediction model is constructed based on the MSA mechanism and solved for the hidden states and weights of each layer of attention in the model. Finally, a ReLU activation function is used to activate the hidden states of the LSTM model, and a weighted sum vector is used as the final sequence representation, which is inputted to the output layer for specific prediction to obtain the short-term wind speed prediction results. To verify the effectiveness of the proposed model, wind speed data from four wind farms in Ningxia, China, and two sets of wind speed data from an M2 tower in the USA are selected, and 19 models are built to compare the performance of the proposed model. The results show that the proposed model outperforms other models on all datasets in terms of all five performance metrics, with smaller errors and higher prediction accuracy.

Suggested Citation

  • Liu, Wenhui & Bai, Yulong & Yue, Xiaoxin & Wang, Rui & Song, Qi, 2024. "A wind speed forcasting model based on rime optimization based VMD and multi-headed self-attention-LSTM," Energy, Elsevier, vol. 294(C).
    • Handle: RePEc:eee:energy:v:294:y:2024:i:c:s0360544224004985
    DOI: 10.1016/j.energy.2024.130726
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224004985
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.130726?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Li & Ou, Yanxia & Cai, Jingjing & Wang, Jin & Fu, Yang & Bian, Xiaoyan, 2023. "Offshore wind speed assessment with statistical and attention-based neural network methods based on STL decomposition," Renewable Energy, Elsevier, vol. 216(C).
    2. Casciaro, Gabriele & Ferrari, Francesco & Lagomarsino-Oneto, Daniele & Lira-Loarca, Andrea & Mazzino, Andrea, 2022. "Increasing the skill of short-term wind speed ensemble forecasts combining forecasts and observations via a new dynamic calibration," Energy, Elsevier, vol. 251(C).
    3. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    4. Wu, Huijuan & Meng, Keqilao & Fan, Daoerji & Zhang, Zhanqiang & Liu, Qing, 2022. "Multistep short-term wind speed forecasting using transformer," Energy, Elsevier, vol. 261(PA).
    5. Zhang, Chu & Ma, Huixin & Hua, Lei & Sun, Wei & Nazir, Muhammad Shahzad & Peng, Tian, 2022. "An evolutionary deep learning model based on TVFEMD, improved sine cosine algorithm, CNN and BiLSTM for wind speed prediction," Energy, Elsevier, vol. 254(PA).
    6. Saeed, Adnan & Li, Chaoshun & Gan, Zhenhao & Xie, Yuying & Liu, Fangjie, 2022. "A simple approach for short-term wind speed interval prediction based on independently recurrent neural networks and error probability distribution," Energy, Elsevier, vol. 238(PC).
    7. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    8. Tian, Zhongda & Chen, Hao, 2021. "Multi-step short-term wind speed prediction based on integrated multi-model fusion," Applied Energy, Elsevier, vol. 298(C).
    9. Sareen, Karan & Panigrahi, Bijaya Ketan & Shikhola, Tushar & Sharma, Rajneesh, 2023. "An imputation and decomposition algorithms based integrated approach with bidirectional LSTM neural network for wind speed prediction," Energy, Elsevier, vol. 278(C).
    10. Duan, Jikai & Zuo, Hongchao & Bai, Yulong & Duan, Jizheng & Chang, Mingheng & Chen, Bolong, 2021. "Short-term wind speed forecasting using recurrent neural networks with error correction," Energy, Elsevier, vol. 217(C).
    11. Suo, Leiming & Peng, Tian & Song, Shihao & Zhang, Chu & Wang, Yuhan & Fu, Yongyan & Nazir, Muhammad Shahzad, 2023. "Wind speed prediction by a swarm intelligence based deep learning model via signal decomposition and parameter optimization using improved chimp optimization algorithm," Energy, Elsevier, vol. 276(C).
    12. Yang, Rui & Liu, Hui & Nikitas, Nikolaos & Duan, Zhu & Li, Yanfei & Li, Ye, 2022. "Short-term wind speed forecasting using deep reinforcement learning with improved multiple error correction approach," Energy, Elsevier, vol. 239(PB).
    13. Guanghui Che & Daocheng Zhou & Rui Wang & Lei Zhou & Hongfu Zhang & Sheng Yu, 2024. "Wind Energy Assessment in Forested Regions Based on the Combination of WRF and LSTM-Attention Models," Sustainability, MDPI, vol. 16(2), pages 1-18, January.
    14. Wang, Jujie & Li, Yaning, 2018. "Multi-step ahead wind speed prediction based on optimal feature extraction, long short term memory neural network and error correction strategy," Applied Energy, Elsevier, vol. 230(C), pages 429-443.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    2. Ban, Guihua & Chen, Yan & Xiong, Zhenhua & Zhuo, Yixin & Huang, Kui, 2024. "The univariate model for long-term wind speed forecasting based on wavelet soft threshold denoising and improved Autoformer," Energy, Elsevier, vol. 290(C).
    3. Wu, Binrong & Yu, Sihao & Peng, Lu & Wang, Lin, 2024. "Interpretable wind speed forecasting with meteorological feature exploring and two-stage decomposition," Energy, Elsevier, vol. 294(C).
    4. Li, Yanhui & Sun, Kaixuan & Yao, Qi & Wang, Lin, 2024. "A dual-optimization wind speed forecasting model based on deep learning and improved dung beetle optimization algorithm," Energy, Elsevier, vol. 286(C).
    5. Fang, Ping & Fu, Wenlong & Wang, Kai & Xiong, Dongzhen & Zhang, Kai, 2022. "A compositive architecture coupling outlier correction, EWT, nonlinear Volterra multi-model fusion with multi-objective optimization for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 307(C).
    6. Shengxiang Lv & Lin Wang & Sirui Wang, 2023. "A Hybrid Neural Network Model for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 16(4), pages 1-18, February.
    7. Wang, Yuhan & Zhang, Chu & Fu, Yongyan & Suo, Leiming & Song, Shihao & Peng, Tian & Shahzad Nazir, Muhammad, 2023. "Hybrid solar radiation forecasting model with temporal convolutional network using data decomposition and improved artificial ecosystem-based optimization algorithm," Energy, Elsevier, vol. 280(C).
    8. Jiang, Wenjun & Liu, Bo & Liang, Yang & Gao, Huanxiang & Lin, Pengfei & Zhang, Dongqin & Hu, Gang, 2024. "Applicability analysis of transformer to wind speed forecasting by a novel deep learning framework with multiple atmospheric variables," Applied Energy, Elsevier, vol. 353(PB).
    9. Zhong, Mingwei & Xu, Cancheng & Xian, Zikang & He, Guanglin & Zhai, Yanpeng & Zhou, Yongwang & Fan, Jingmin, 2024. "DTTM: A deep temporal transfer model for ultra-short-term online wind power forecasting," Energy, Elsevier, vol. 286(C).
    10. Li, Jiale & Song, Zihao & Wang, Xuefei & Wang, Yanru & Jia, Yaya, 2022. "A novel offshore wind farm typhoon wind speed prediction model based on PSO–Bi-LSTM improved by VMD," Energy, Elsevier, vol. 251(C).
    11. Zhang, Chu & Li, Zhengbo & Ge, Yida & Liu, Qianlong & Suo, Leiming & Song, Shihao & Peng, Tian, 2024. "Enhancing short-term wind speed prediction based on an outlier-robust ensemble deep random vector functional link network with AOA-optimized VMD," Energy, Elsevier, vol. 296(C).
    12. Li, Dan & Jiang, Fuxin & Chen, Min & Qian, Tao, 2022. "Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks," Energy, Elsevier, vol. 238(PC).
    13. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    14. Wu, Binrong & Wang, Lin, 2024. "Two-stage decomposition and temporal fusion transformers for interpretable wind speed forecasting," Energy, Elsevier, vol. 288(C).
    15. Zhang, Chu & Qiao, Xiujie & Zhang, Zhao & Wang, Yuhan & Fu, Yongyan & Nazir, Muhammad Shahzad & Peng, Tian, 2024. "Simultaneous forecasting of wind speed for multiple stations based on attribute-augmented spatiotemporal graph convolutional network and tree-structured parzen estimator," Energy, Elsevier, vol. 295(C).
    16. Wang, Huaqing & Tan, Zhongfu & Liang, Yan & Li, Fanqi & Zhang, Zheyu & Ju, Liwei, 2024. "A novel multi-layer stacking ensemble wind power prediction model under Tensorflow deep learning framework considering feature enhancement and data hierarchy processing," Energy, Elsevier, vol. 286(C).
    17. Ana Lagos & Joaquín E. Caicedo & Gustavo Coria & Andrés Romero Quete & Maximiliano Martínez & Gastón Suvire & Jesús Riquelme, 2022. "State-of-the-Art Using Bibliometric Analysis of Wind-Speed and -Power Forecasting Methods Applied in Power Systems," Energies, MDPI, vol. 15(18), pages 1-40, September.
    18. Hu, Yahui & Guo, Yingshi & Fu, Rui, 2023. "A novel wind speed forecasting combined model using variational mode decomposition, sparse auto-encoder and optimized fuzzy cognitive mapping network," Energy, Elsevier, vol. 278(PA).
    19. Kui Yang & Bofu Wang & Xiang Qiu & Jiahua Li & Yuze Wang & Yulu Liu, 2022. "Multi-Step Short-Term Wind Speed Prediction Models Based on Adaptive Robust Decomposition Coupled with Deep Gated Recurrent Unit," Energies, MDPI, vol. 15(12), pages 1-24, June.
    20. Gao, Huanxiang & Hu, Gang & Zhang, Dongqin & Jiang, Wenjun & Ren, Hehe & Chen, Wenli, 2024. "Prediction of wind fields in mountains at multiple elevations using deep learning models," Applied Energy, Elsevier, vol. 353(PA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:294:y:2024:i:c:s0360544224004985. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.