IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v375y2024ics0306261924014405.html
   My bibliography  Save this article

An attention-based multi-input LSTM with sliding window-based two-stage decomposition for wind speed forecasting

Author

Listed:
  • Yang, Dongchuan
  • Li, Mingzhu
  • Guo, Ju-e
  • Du, Pei

Abstract

Accurate forecasting of short-term wind speed is essential for enhancing the grid integration safety and economic efficiency of wind farms due to the inherent volatility and stochastic nature of wind speed. An improved hybrid model for wind speed forecasting is proposed in this study. The model incorporates three novel parts: (1) a sliding window-based two-stage decomposition (SWTSD) that leverages the strengths of improved complete ensemble empirical mode decomposition with adaptive noise (ICEEMDAN) and variational mode decomposition (VMD) is designed for effective feature extraction while preventing data leakage; (2) an attention-based multi-input long short-term memory (MI-LSTM) with additional input gates is developed to extract valuable information from each sub-series, capture the relationships between the sub-series, and mitigate noise impact; (3) a simultaneous Bayesian optimization strategy is applied to optimize hyperparameters for both the decomposition technique and the forecasting model. To verify the effectiveness of our proposed model, the wind speed dataset covering four seasons at the Dong Xinzhuang wind farm in Shaanxi, China is collected. Experimental analysis demonstrates that our proposed model is superior to benchmark models in all four comparative experiments, confirming the effectiveness of our designed decomposition, forecasting, and optimization modules. The results suggest that our proposed hybrid model could be a viable option for future short-term wind speed forecasting practices.

Suggested Citation

  • Yang, Dongchuan & Li, Mingzhu & Guo, Ju-e & Du, Pei, 2024. "An attention-based multi-input LSTM with sliding window-based two-stage decomposition for wind speed forecasting," Applied Energy, Elsevier, vol. 375(C).
    • Handle: RePEc:eee:appene:v:375:y:2024:i:c:s0306261924014405
    DOI: 10.1016/j.apenergy.2024.124057
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924014405
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.124057?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Naik, Jyotirmayee & Dash, Pradipta Kishore & Dhar, Snehamoy, 2019. "A multi-objective wind speed and wind power prediction interval forecasting using variational modes decomposition based Multi-kernel robust ridge regression," Renewable Energy, Elsevier, vol. 136(C), pages 701-731.
    2. Xu, Li & Ou, Yanxia & Cai, Jingjing & Wang, Jin & Fu, Yang & Bian, Xiaoyan, 2023. "Offshore wind speed assessment with statistical and attention-based neural network methods based on STL decomposition," Renewable Energy, Elsevier, vol. 216(C).
    3. Yang, Dongchuan & Guo, Ju-e & Li, Yanzhao & Sun, Shaolong & Wang, Shouyang, 2023. "Short-term load forecasting with an improved dynamic decomposition-reconstruction-ensemble approach," Energy, Elsevier, vol. 263(PA).
    4. Fadare, D.A., 2010. "The application of artificial neural networks to mapping of wind speed profile for energy application in Nigeria," Applied Energy, Elsevier, vol. 87(3), pages 934-942, March.
    5. Jiang, Wenjun & Lin, Pengfei & Liang, Yang & Gao, Huanxiang & Zhang, Dongqin & Hu, Gang, 2023. "A novel hybrid deep learning model for multi-step wind speed forecasting considering pairwise dependencies among multiple atmospheric variables," Energy, Elsevier, vol. 285(C).
    6. Li, Dan & Li, Yijun & Wang, Chaoqun & Chen, Min & Wu, Qi, 2023. "Forecasting carbon prices based on real-time decomposition and causal temporal convolutional networks," Applied Energy, Elsevier, vol. 331(C).
    7. Qu, Zongxi & Mao, Wenqian & Zhang, Kequan & Zhang, Wenyu & Li, Zhipeng, 2019. "Multi-step wind speed forecasting based on a hybrid decomposition technique and an improved back-propagation neural network," Renewable Energy, Elsevier, vol. 133(C), pages 919-929.
    8. Du, Pei & Yang, Dongchuan & Li, Yanzhao & Wang, Jianzhou, 2024. "An innovative interpretable combined learning model for wind speed forecasting," Applied Energy, Elsevier, vol. 358(C).
    9. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    10. Zhang, Guowei & Zhang, Yi & Wang, Hui & Liu, Da & Cheng, Runkun & Yang, Di, 2024. "Short-term wind speed forecasting based on adaptive secondary decomposition and robust temporal convolutional network," Energy, Elsevier, vol. 288(C).
    11. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.
    12. Neshat, Mehdi & Nezhad, Meysam Majidi & Abbasnejad, Ehsan & Mirjalili, Seyedali & Groppi, Daniele & Heydari, Azim & Tjernberg, Lina Bertling & Astiaso Garcia, Davide & Alexander, Bradley & Shi, Qinfen, 2021. "Wind turbine power output prediction using a new hybrid neuro-evolutionary method," Energy, Elsevier, vol. 229(C).
    13. Li, Gong & Shi, Jing, 2010. "On comparing three artificial neural networks for wind speed forecasting," Applied Energy, Elsevier, vol. 87(7), pages 2313-2320, July.
    14. Wu, Huijuan & Meng, Keqilao & Fan, Daoerji & Zhang, Zhanqiang & Liu, Qing, 2022. "Multistep short-term wind speed forecasting using transformer," Energy, Elsevier, vol. 261(PA).
    15. Zhang, Chu & Ma, Huixin & Hua, Lei & Sun, Wei & Nazir, Muhammad Shahzad & Peng, Tian, 2022. "An evolutionary deep learning model based on TVFEMD, improved sine cosine algorithm, CNN and BiLSTM for wind speed prediction," Energy, Elsevier, vol. 254(PA).
    16. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    17. Emeksiz, Cem & Tan, Mustafa, 2022. "Multi-step wind speed forecasting and Hurst analysis using novel hybrid secondary decomposition approach," Energy, Elsevier, vol. 238(PA).
    18. Duan, Jiandong & Wang, Peng & Ma, Wentao & Tian, Xuan & Fang, Shuai & Cheng, Yulin & Chang, Ying & Liu, Haofan, 2021. "Short-term wind power forecasting using the hybrid model of improved variational mode decomposition and Correntropy Long Short -term memory neural network," Energy, Elsevier, vol. 214(C).
    19. Xiao, Yu-jie & Wang, Xiao-kang & Wang, Jian-qiang & Zhang, Hong-yu, 2021. "An adaptive decomposition and ensemble model for short-term air pollutant concentration forecast using ICEEMDAN-ICA," Technological Forecasting and Social Change, Elsevier, vol. 166(C).
    20. Zhang, Jie & Draxl, Caroline & Hopson, Thomas & Monache, Luca Delle & Vanvyve, Emilie & Hodge, Bri-Mathias, 2015. "Comparison of numerical weather prediction based deterministic and probabilistic wind resource assessment methods," Applied Energy, Elsevier, vol. 156(C), pages 528-541.
    21. Emeksiz, Cem & Tan, Mustafa, 2022. "Wind speed estimation using novelty hybrid adaptive estimation model based on decomposition and deep learning methods (ICEEMDAN-CNN)," Energy, Elsevier, vol. 249(C).
    22. Bommidi, Bala Saibabu & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "Hybrid wind speed forecasting using ICEEMDAN and transformer model with novel loss function," Energy, Elsevier, vol. 265(C).
    23. Tascikaraoglu, Akin & Sanandaji, Borhan M. & Poolla, Kameshwar & Varaiya, Pravin, 2016. "Exploiting sparsity of interconnections in spatio-temporal wind speed forecasting using Wavelet Transform," Applied Energy, Elsevier, vol. 165(C), pages 735-747.
    24. Moreno, Sinvaldo Rodrigues & Mariani, Viviana Cocco & Coelho, Leandro dos Santos, 2021. "Hybrid multi-stage decomposition with parametric model applied to wind speed forecasting in Brazilian Northeast," Renewable Energy, Elsevier, vol. 164(C), pages 1508-1526.
    25. Shi, Jian & Teh, Jiashen, 2024. "Load forecasting for regional integrated energy system based on complementary ensemble empirical mode decomposition and multi-model fusion," Applied Energy, Elsevier, vol. 353(PB).
    26. Liu, Hui & Tian, Hong-qi & Liang, Xi-feng & Li, Yan-fei, 2015. "Wind speed forecasting approach using secondary decomposition algorithm and Elman neural networks," Applied Energy, Elsevier, vol. 157(C), pages 183-194.
    27. Hao, Yan & Tian, Chengshi, 2019. "A novel two-stage forecasting model based on error factor and ensemble method for multi-step wind power forecasting," Applied Energy, Elsevier, vol. 238(C), pages 368-383.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yingying He & Likai Zhang & Tengda Guan & Zheyu Zhang, 2024. "An Integrated CEEMDAN to Optimize Deep Long Short-Term Memory Model for Wind Speed Forecasting," Energies, MDPI, vol. 17(18), pages 1-29, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    2. Zhang, Guowei & Zhang, Yi & Wang, Hui & Liu, Da & Cheng, Runkun & Yang, Di, 2024. "Short-term wind speed forecasting based on adaptive secondary decomposition and robust temporal convolutional network," Energy, Elsevier, vol. 288(C).
    3. Li, Yanhui & Sun, Kaixuan & Yao, Qi & Wang, Lin, 2024. "A dual-optimization wind speed forecasting model based on deep learning and improved dung beetle optimization algorithm," Energy, Elsevier, vol. 286(C).
    4. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    5. Zhao, Yongning & Ye, Lin & Li, Zhi & Song, Xuri & Lang, Yansheng & Su, Jian, 2016. "A novel bidirectional mechanism based on time series model for wind power forecasting," Applied Energy, Elsevier, vol. 177(C), pages 793-803.
    6. Li, Dan & Jiang, Fuxin & Chen, Min & Qian, Tao, 2022. "Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks," Energy, Elsevier, vol. 238(PC).
    7. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    8. Lin, Shengmao & Wang, Shu & Xu, Xuefang & Li, Ruixiong & Shi, Peiming, 2024. "GAOformer: An adaptive spatiotemporal feature fusion transformer utilizing GAT and optimizable graph matrixes for offshore wind speed prediction," Energy, Elsevier, vol. 292(C).
    9. Zhang, Yagang & Kong, Xue & Wang, Jingchao & Wang, Hui & Cheng, Xiaodan, 2024. "Wind power forecasting system with data enhancement and algorithm improvement," Renewable and Sustainable Energy Reviews, Elsevier, vol. 196(C).
    10. Parri, Srihari & Teeparthi, Kiran & Kosana, Vishalteja, 2024. "A hybrid methodology using VMD and disentangled features for wind speed forecasting," Energy, Elsevier, vol. 288(C).
    11. Parri, Srihari & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "A hybrid VMD based contextual feature representation approach for wind speed forecasting," Renewable Energy, Elsevier, vol. 219(P1).
    12. Zhao, Ning & Su, Yi & Dai, Xianxing & Jia, Shaomin & Wang, Xuewei, 2024. "A new decomposition-ensemble strategy fusion with correntropy optimization learning algorithms for short-term wind speed prediction," Applied Energy, Elsevier, vol. 369(C).
    13. Zhang, Yagang & Zhang, Jinghui & Yu, Leyi & Pan, Zhiya & Feng, Changyou & Sun, Yiqian & Wang, Fei, 2022. "A short-term wind energy hybrid optimal prediction system with denoising and novel error correction technique," Energy, Elsevier, vol. 254(PC).
    14. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    15. Moreno, Sinvaldo Rodrigues & Seman, Laio Oriel & Stefenon, Stefano Frizzo & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2024. "Enhancing wind speed forecasting through synergy of machine learning, singular spectral analysis, and variational mode decomposition," Energy, Elsevier, vol. 292(C).
    16. Jiang, Wenjun & Liu, Bo & Liang, Yang & Gao, Huanxiang & Lin, Pengfei & Zhang, Dongqin & Hu, Gang, 2024. "Applicability analysis of transformer to wind speed forecasting by a novel deep learning framework with multiple atmospheric variables," Applied Energy, Elsevier, vol. 353(PB).
    17. Wu, Jie & Li, Na & Zhao, Yan & Wang, Jujie, 2022. "Usage of correlation analysis and hypothesis test in optimizing the gated recurrent unit network for wind speed forecasting," Energy, Elsevier, vol. 242(C).
    18. Yang, Zhongshan & Wang, Jian, 2018. "A combination forecasting approach applied in multistep wind speed forecasting based on a data processing strategy and an optimized artificial intelligence algorithm," Applied Energy, Elsevier, vol. 230(C), pages 1108-1125.
    19. Joseph, Lionel P. & Deo, Ravinesh C. & Casillas-Pérez, David & Prasad, Ramendra & Raj, Nawin & Salcedo-Sanz, Sancho, 2024. "Short-term wind speed forecasting using an optimized three-phase convolutional neural network fused with bidirectional long short-term memory network model," Applied Energy, Elsevier, vol. 359(C).
    20. Zhang, Wanqing & Lin, Zi & Liu, Xiaolei, 2022. "Short-term offshore wind power forecasting - A hybrid model based on Discrete Wavelet Transform (DWT), Seasonal Autoregressive Integrated Moving Average (SARIMA), and deep-learning-based Long Short-Te," Renewable Energy, Elsevier, vol. 185(C), pages 611-628.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:375:y:2024:i:c:s0306261924014405. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.