IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v310y2024ics0360544224029815.html
   My bibliography  Save this article

Windformer: A novel 4D high-resolution system for multi-step wind speed vector forecasting based on temporal shifted window multi-head self-attention

Author

Listed:
  • He, Jinhua
  • Hu, Zechun
  • Wang, Songpo
  • Mujeeb, Asad
  • Yang, Pengwei

Abstract

Accurate wind speed forecasting (WSF) plays a pivotal role in anticipating the power output of wind farms. Nevertheless, the stochastic and variable nature of wind speed presents a significant challenge in achieving accurate WSF. Hence, this study proposes a novel 4D high-resolution system, Windformer, for wind speed vector forecasting (WSVF). Windformer combines the ability of convolutional neural networks (CNNs) for feature extraction and transformers based on attention mechanisms for information fusion. In the Windformer, the input and output layers are mainly composed of 3D CNNs. The input layer is employed for feature extraction and information compression, while the output layer is tasked with recovering the WSV field. The key components of the model consist of encoders and decoders built upon temporal shifted window multi-head self-attention. This architecture is capable of effectively integrating spatio-temporal information. Trained on 39 years of regional reanalysis data, Windformer obtains the most accurate forecast results compared to 5 WSF baseline models. Most importantly, within the next 6 hours, Windformer demonstrates higher accuracy compared to the High-Resolution Deterministic Forecast (HRES) from the European Centre for Medium-Range Weather Forecasts (ECMWF).

Suggested Citation

  • He, Jinhua & Hu, Zechun & Wang, Songpo & Mujeeb, Asad & Yang, Pengwei, 2024. "Windformer: A novel 4D high-resolution system for multi-step wind speed vector forecasting based on temporal shifted window multi-head self-attention," Energy, Elsevier, vol. 310(C).
    • Handle: RePEc:eee:energy:v:310:y:2024:i:c:s0360544224029815
    DOI: 10.1016/j.energy.2024.133206
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224029815
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.133206?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jicheng Quan & Li Shang, 2020. "Short-Term Wind Speed Forecasting Based on Ensemble Online Sequential Extreme Learning Machine and Bayesian Optimization," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-13, November.
    2. Liu, Hui & Chen, Chao & Tian, Hong-qi & Li, Yan-fei, 2012. "A hybrid model for wind speed prediction using empirical mode decomposition and artificial neural networks," Renewable Energy, Elsevier, vol. 48(C), pages 545-556.
    3. Suman Ravuri & Karel Lenc & Matthew Willson & Dmitry Kangin & Remi Lam & Piotr Mirowski & Megan Fitzsimons & Maria Athanassiadou & Sheleem Kashem & Sam Madge & Rachel Prudden & Amol Mandhane & Aidan C, 2021. "Skilful precipitation nowcasting using deep generative models of radar," Nature, Nature, vol. 597(7878), pages 672-677, September.
    4. Al-Yahyai, Sultan & Charabi, Yassine & Gastli, Adel, 2010. "Review of the use of Numerical Weather Prediction (NWP) Models for wind energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(9), pages 3192-3198, December.
    5. Niu, Xinsong & Wang, Jiyang, 2019. "A combined model based on data preprocessing strategy and multi-objective optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 241(C), pages 519-539.
    6. Mohandes, Mohamed A. & Rehman, Shafiqur & Halawani, Talal O., 1998. "A neural networks approach for wind speed prediction," Renewable Energy, Elsevier, vol. 13(3), pages 345-354.
    7. Hong, Ying-Yi & Satriani, Thursy Rienda Aulia, 2020. "Day-ahead spatiotemporal wind speed forecasting using robust design-based deep learning neural network," Energy, Elsevier, vol. 209(C).
    8. Kaifeng Bi & Lingxi Xie & Hengheng Zhang & Xin Chen & Xiaotao Gu & Qi Tian, 2023. "Accurate medium-range global weather forecasting with 3D neural networks," Nature, Nature, vol. 619(7970), pages 533-538, July.
    9. Zhao, Jing & Guo, Yanling & Xiao, Xia & Wang, Jianzhou & Chi, Dezhong & Guo, Zhenhai, 2017. "Multi-step wind speed and power forecasts based on a WRF simulation and an optimized association method," Applied Energy, Elsevier, vol. 197(C), pages 183-202.
    10. Mohandes, M.A. & Halawani, T.O. & Rehman, S. & Hussain, Ahmed A., 2004. "Support vector machines for wind speed prediction," Renewable Energy, Elsevier, vol. 29(6), pages 939-947.
    11. Xu, Weifeng & Liu, Pan & Cheng, Lei & Zhou, Yong & Xia, Qian & Gong, Yu & Liu, Yini, 2021. "Multi-step wind speed prediction by combining a WRF simulation and an error correction strategy," Renewable Energy, Elsevier, vol. 163(C), pages 772-782.
    12. Bommidi, Bala Saibabu & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "Hybrid wind speed forecasting using ICEEMDAN and transformer model with novel loss function," Energy, Elsevier, vol. 265(C).
    13. Yang Zhang & Yidong Peng & Xiuli Qu & Jing Shi & Ergin Erdem, 2021. "A Finite Mixture GARCH Approach with EM Algorithm for Energy Forecasting Applications," Energies, MDPI, vol. 14(9), pages 1-22, April.
    14. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    15. Wang, Jianzhou & Wang, Shuai & Zeng, Bo & Lu, Haiyan, 2022. "A novel ensemble probabilistic forecasting system for uncertainty in wind speed," Applied Energy, Elsevier, vol. 313(C).
    16. Yuchen Zhang & Mingsheng Long & Kaiyuan Chen & Lanxiang Xing & Ronghua Jin & Michael I. Jordan & Jianmin Wang, 2023. "Skilful nowcasting of extreme precipitation with NowcastNet," Nature, Nature, vol. 619(7970), pages 526-532, July.
    17. Kaifeng Bi & Lingxi Xie & Hengheng Zhang & Xin Chen & Xiaotao Gu & Qi Tian, 2023. "Author Correction: Accurate medium-range global weather forecasting with 3D neural networks," Nature, Nature, vol. 621(7980), pages 45-45, September.
    18. Wu, Binrong & Yu, Sihao & Peng, Lu & Wang, Lin, 2024. "Interpretable wind speed forecasting with meteorological feature exploring and two-stage decomposition," Energy, Elsevier, vol. 294(C).
    19. Song, Jingjing & Wang, Jianzhou & Lu, Haiyan, 2018. "A novel combined model based on advanced optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 215(C), pages 643-658.
    20. Zhang, Yagang & Pan, Guifang & Chen, Bing & Han, Jingyi & Zhao, Yuan & Zhang, Chenhong, 2020. "Short-term wind speed prediction model based on GA-ANN improved by VMD," Renewable Energy, Elsevier, vol. 156(C), pages 1373-1388.
    21. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    22. Bilgili, Mehmet & Sahin, Besir & Yasar, Abdulkadir, 2007. "Application of artificial neural networks for the wind speed prediction of target station using reference stations data," Renewable Energy, Elsevier, vol. 32(14), pages 2350-2360.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Xingdou & Zhang, Li & Wang, Jiangong & Zhou, Yue & Gan, Wei, 2023. "A unified multi-step wind speed forecasting framework based on numerical weather prediction grids and wind farm monitoring data," Renewable Energy, Elsevier, vol. 211(C), pages 948-963.
    2. Ata, Rasit, 2015. "Artificial neural networks applications in wind energy systems: a review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 49(C), pages 534-562.
    3. Zhao, Jing & Guo, Yiyi & Lin, Yihua & Zhao, Zhiyuan & Guo, Zhenhai, 2024. "A novel dynamic ensemble of numerical weather prediction for multi-step wind speed forecasting with deep reinforcement learning and error sequence modeling," Energy, Elsevier, vol. 302(C).
    4. Neeraj Bokde & Andrés Feijóo & Daniel Villanueva & Kishore Kulat, 2019. "A Review on Hybrid Empirical Mode Decomposition Models for Wind Speed and Wind Power Prediction," Energies, MDPI, vol. 12(2), pages 1-42, January.
    5. Chu, Yinghao & Wang, Yiling & Yang, Dazhi & Chen, Shanlin & Li, Mengying, 2024. "A review of distributed solar forecasting with remote sensing and deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 198(C).
    6. Wang, Yaqi & Zhao, Xiaomeng & Li, Zheng & Zhu, Wenbo & Gui, Renzhou, 2024. "A novel hybrid model for multi-step-ahead forecasting of wind speed based on univariate data feature enhancement," Energy, Elsevier, vol. 312(C).
    7. Wang, Jianzhou & Xiong, Shenghua, 2014. "A hybrid forecasting model based on outlier detection and fuzzy time series – A case study on Hainan wind farm of China," Energy, Elsevier, vol. 76(C), pages 526-541.
    8. Hu, Jianming & Wang, Jianzhou & Zeng, Guowei, 2013. "A hybrid forecasting approach applied to wind speed time series," Renewable Energy, Elsevier, vol. 60(C), pages 185-194.
    9. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    10. Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong & Liu, Zhenkun, 2021. "Ensemble wind speed forecasting with multi-objective Archimedes optimization algorithm and sub-model selection," Applied Energy, Elsevier, vol. 301(C).
    11. Pan, Xiaoxin & Wang, Long & Wang, Zhongju & Huang, Chao, 2022. "Short-term wind speed forecasting based on spatial-temporal graph transformer networks," Energy, Elsevier, vol. 253(C).
    12. Yu, Min & Niu, Dongxiao & Gao, Tian & Wang, Keke & Sun, Lijie & Li, Mingyu & Xu, Xiaomin, 2023. "A novel framework for ultra-short-term interval wind power prediction based on RF-WOA-VMD and BiGRU optimized by the attention mechanism," Energy, Elsevier, vol. 269(C).
    13. Wu, Binrong & Wang, Lin, 2024. "Two-stage decomposition and temporal fusion transformers for interpretable wind speed forecasting," Energy, Elsevier, vol. 288(C).
    14. Alma Y. Alanis & Oscar D. Sanchez & Jesus G. Alvarez, 2021. "Time Series Forecasting for Wind Energy Systems Based on High Order Neural Networks," Mathematics, MDPI, vol. 9(10), pages 1-18, May.
    15. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.
    16. Ana Lagos & Joaquín E. Caicedo & Gustavo Coria & Andrés Romero Quete & Maximiliano Martínez & Gastón Suvire & Jesús Riquelme, 2022. "State-of-the-Art Using Bibliometric Analysis of Wind-Speed and -Power Forecasting Methods Applied in Power Systems," Energies, MDPI, vol. 15(18), pages 1-40, September.
    17. Zheng, Jingwei & Wang, Jianzhou, 2024. "Short-term wind speed forecasting based on recurrent neural networks and Levy crystal structure algorithm," Energy, Elsevier, vol. 293(C).
    18. Huijun Zhang & Mingjie Zhang & Ran Yi & Yaxin Liu & Qiuzi Han Wen & Xin Meng, 2024. "Growing Importance of Micro-Meteorology in the New Power System: Review, Analysis and Case Study," Energies, MDPI, vol. 17(6), pages 1-33, March.
    19. Mattia Cavaiola & Federico Cassola & Davide Sacchetti & Francesco Ferrari & Andrea Mazzino, 2024. "Hybrid AI-enhanced lightning flash prediction in the medium-range forecast horizon," Nature Communications, Nature, vol. 15(1), pages 1-15, December.
    20. Shrivastava, Nitin Anand & Lohia, Kunal & Panigrahi, Bijaya Ketan, 2016. "A multiobjective framework for wind speed prediction interval forecasts," Renewable Energy, Elsevier, vol. 87(P2), pages 903-910.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:310:y:2024:i:c:s0360544224029815. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.