IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v294y2024ics0360544224004985.html
   My bibliography  Save this article

A wind speed forcasting model based on rime optimization based VMD and multi-headed self-attention-LSTM

Author

Listed:
  • Liu, Wenhui
  • Bai, Yulong
  • Yue, Xiaoxin
  • Wang, Rui
  • Song, Qi

Abstract

Due to the nonlinearity, fluctuation, and intermittency of wind speed, its accurate prediction is essential for improving efficiency in wind power operation systems. In this regard, a hybrid model that combines the rime optimization algorithm (RIME), variational mode decomposition (VMD), multi-headed self-attention (MSA) mechanism and long short-term memory (LSTM) is proposed for wind speed prediction. First, the number of modes and VMD penalty parameter are optimized with RIME, the optimized parameters are brought into the VMD to decompose the raw wind speeds, and a Lagrange multiplier and quadratic penalty function are introduced to obtain the input series. Then, a LSTM short-term wind speed prediction model is constructed based on the MSA mechanism and solved for the hidden states and weights of each layer of attention in the model. Finally, a ReLU activation function is used to activate the hidden states of the LSTM model, and a weighted sum vector is used as the final sequence representation, which is inputted to the output layer for specific prediction to obtain the short-term wind speed prediction results. To verify the effectiveness of the proposed model, wind speed data from four wind farms in Ningxia, China, and two sets of wind speed data from an M2 tower in the USA are selected, and 19 models are built to compare the performance of the proposed model. The results show that the proposed model outperforms other models on all datasets in terms of all five performance metrics, with smaller errors and higher prediction accuracy.

Suggested Citation

  • Liu, Wenhui & Bai, Yulong & Yue, Xiaoxin & Wang, Rui & Song, Qi, 2024. "A wind speed forcasting model based on rime optimization based VMD and multi-headed self-attention-LSTM," Energy, Elsevier, vol. 294(C).
    • Handle: RePEc:eee:energy:v:294:y:2024:i:c:s0360544224004985
    DOI: 10.1016/j.energy.2024.130726
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224004985
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.130726?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Li & Ou, Yanxia & Cai, Jingjing & Wang, Jin & Fu, Yang & Bian, Xiaoyan, 2023. "Offshore wind speed assessment with statistical and attention-based neural network methods based on STL decomposition," Renewable Energy, Elsevier, vol. 216(C).
    2. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    3. Tian, Zhongda & Chen, Hao, 2021. "Multi-step short-term wind speed prediction based on integrated multi-model fusion," Applied Energy, Elsevier, vol. 298(C).
    4. Sareen, Karan & Panigrahi, Bijaya Ketan & Shikhola, Tushar & Sharma, Rajneesh, 2023. "An imputation and decomposition algorithms based integrated approach with bidirectional LSTM neural network for wind speed prediction," Energy, Elsevier, vol. 278(C).
    5. Duan, Jikai & Zuo, Hongchao & Bai, Yulong & Duan, Jizheng & Chang, Mingheng & Chen, Bolong, 2021. "Short-term wind speed forecasting using recurrent neural networks with error correction," Energy, Elsevier, vol. 217(C).
    6. Suo, Leiming & Peng, Tian & Song, Shihao & Zhang, Chu & Wang, Yuhan & Fu, Yongyan & Nazir, Muhammad Shahzad, 2023. "Wind speed prediction by a swarm intelligence based deep learning model via signal decomposition and parameter optimization using improved chimp optimization algorithm," Energy, Elsevier, vol. 276(C).
    7. Yang, Rui & Liu, Hui & Nikitas, Nikolaos & Duan, Zhu & Li, Yanfei & Li, Ye, 2022. "Short-term wind speed forecasting using deep reinforcement learning with improved multiple error correction approach," Energy, Elsevier, vol. 239(PB).
    8. Guanghui Che & Daocheng Zhou & Rui Wang & Lei Zhou & Hongfu Zhang & Sheng Yu, 2024. "Wind Energy Assessment in Forested Regions Based on the Combination of WRF and LSTM-Attention Models," Sustainability, MDPI, vol. 16(2), pages 1-17, January.
    9. Wang, Jujie & Li, Yaning, 2018. "Multi-step ahead wind speed prediction based on optimal feature extraction, long short term memory neural network and error correction strategy," Applied Energy, Elsevier, vol. 230(C), pages 429-443.
    10. Casciaro, Gabriele & Ferrari, Francesco & Lagomarsino-Oneto, Daniele & Lira-Loarca, Andrea & Mazzino, Andrea, 2022. "Increasing the skill of short-term wind speed ensemble forecasts combining forecasts and observations via a new dynamic calibration," Energy, Elsevier, vol. 251(C).
    11. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    12. Wu, Huijuan & Meng, Keqilao & Fan, Daoerji & Zhang, Zhanqiang & Liu, Qing, 2022. "Multistep short-term wind speed forecasting using transformer," Energy, Elsevier, vol. 261(PA).
    13. Zhang, Chu & Ma, Huixin & Hua, Lei & Sun, Wei & Nazir, Muhammad Shahzad & Peng, Tian, 2022. "An evolutionary deep learning model based on TVFEMD, improved sine cosine algorithm, CNN and BiLSTM for wind speed prediction," Energy, Elsevier, vol. 254(PA).
    14. Saeed, Adnan & Li, Chaoshun & Gan, Zhenhao & Xie, Yuying & Liu, Fangjie, 2022. "A simple approach for short-term wind speed interval prediction based on independently recurrent neural networks and error probability distribution," Energy, Elsevier, vol. 238(PC).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sun, Xiaoying & Liu, Haizhong, 2024. "Multivariate short-term wind speed prediction based on PSO-VMD-SE-ICEEMDAN two-stage decomposition and Att-S2S," Energy, Elsevier, vol. 305(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    2. Yang, Dongchuan & Li, Mingzhu & Guo, Ju-e & Du, Pei, 2024. "An attention-based multi-input LSTM with sliding window-based two-stage decomposition for wind speed forecasting," Applied Energy, Elsevier, vol. 375(C).
    3. Wu, Binrong & Yu, Sihao & Peng, Lu & Wang, Lin, 2024. "Interpretable wind speed forecasting with meteorological feature exploring and two-stage decomposition," Energy, Elsevier, vol. 294(C).
    4. Ban, Guihua & Chen, Yan & Xiong, Zhenhua & Zhuo, Yixin & Huang, Kui, 2024. "The univariate model for long-term wind speed forecasting based on wavelet soft threshold denoising and improved Autoformer," Energy, Elsevier, vol. 290(C).
    5. Li, Yanhui & Sun, Kaixuan & Yao, Qi & Wang, Lin, 2024. "A dual-optimization wind speed forecasting model based on deep learning and improved dung beetle optimization algorithm," Energy, Elsevier, vol. 286(C).
    6. Jiang, Wenjun & Liu, Bo & Liang, Yang & Gao, Huanxiang & Lin, Pengfei & Zhang, Dongqin & Hu, Gang, 2024. "Applicability analysis of transformer to wind speed forecasting by a novel deep learning framework with multiple atmospheric variables," Applied Energy, Elsevier, vol. 353(PB).
    7. Li, Jiale & Song, Zihao & Wang, Xuefei & Wang, Yanru & Jia, Yaya, 2022. "A novel offshore wind farm typhoon wind speed prediction model based on PSO–Bi-LSTM improved by VMD," Energy, Elsevier, vol. 251(C).
    8. Li, Dan & Jiang, Fuxin & Chen, Min & Qian, Tao, 2022. "Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks," Energy, Elsevier, vol. 238(PC).
    9. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    10. Zhang, Chu & Qiao, Xiujie & Zhang, Zhao & Wang, Yuhan & Fu, Yongyan & Nazir, Muhammad Shahzad & Peng, Tian, 2024. "Simultaneous forecasting of wind speed for multiple stations based on attribute-augmented spatiotemporal graph convolutional network and tree-structured parzen estimator," Energy, Elsevier, vol. 295(C).
    11. Zhong, Mingwei & Fan, Jingmin & Luo, Jianqiang & Xiao, Xuanyi & He, Guanglin & Cai, Rui, 2024. "InfoCAVB-MemoryFormer: Forecasting of wind and photovoltaic power through the interaction of data reconstruction and data augmentation," Applied Energy, Elsevier, vol. 371(C).
    12. Ana Lagos & Joaquín E. Caicedo & Gustavo Coria & Andrés Romero Quete & Maximiliano Martínez & Gastón Suvire & Jesús Riquelme, 2022. "State-of-the-Art Using Bibliometric Analysis of Wind-Speed and -Power Forecasting Methods Applied in Power Systems," Energies, MDPI, vol. 15(18), pages 1-40, September.
    13. Sareen, Karan & Panigrahi, Bijaya Ketan & Shikhola, Tushar & Chawla, Astha, 2023. "A robust De-Noising Autoencoder imputation and VMD algorithm based deep learning technique for short-term wind speed prediction ensuring cyber resilience," Energy, Elsevier, vol. 283(C).
    14. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Fan & Hu, Qinghua, 2024. "Dynamic non-constraint ensemble model for probabilistic wind power and wind speed forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 204(C).
    15. Dongran Song & Xiao Tan & Qian Huang & Li Wang & Mi Dong & Jian Yang & Solomin Evgeny, 2024. "Review of AI-Based Wind Prediction within Recent Three Years: 2021–2023," Energies, MDPI, vol. 17(6), pages 1-22, March.
    16. Yang, Rui & Liu, Hui & Nikitas, Nikolaos & Duan, Zhu & Li, Yanfei & Li, Ye, 2022. "Short-term wind speed forecasting using deep reinforcement learning with improved multiple error correction approach," Energy, Elsevier, vol. 239(PB).
    17. Liu, Lei & Wang, Xinyu & Dong, Xue & Chen, Kang & Chen, Qiuju & Li, Bin, 2024. "Interpretable feature-temporal transformer for short-term wind power forecasting with multivariate time series," Applied Energy, Elsevier, vol. 374(C).
    18. Wang, Shuangxin & Shi, Jiarong & Yang, Wei & Yin, Qingyan, 2024. "High and low frequency wind power prediction based on Transformer and BiGRU-Attention," Energy, Elsevier, vol. 288(C).
    19. Saeed, Adnan & Li, Chaoshun & Gan, Zhenhao, 2024. "Short-term wind speed interval prediction using improved quality-driven loss based gated multi-scale convolutional sequence model," Energy, Elsevier, vol. 300(C).
    20. Fang, Ping & Fu, Wenlong & Wang, Kai & Xiong, Dongzhen & Zhang, Kai, 2022. "A compositive architecture coupling outlier correction, EWT, nonlinear Volterra multi-model fusion with multi-objective optimization for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 307(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:294:y:2024:i:c:s0360544224004985. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.