IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v353y2024ipbs0306261923015192.html
   My bibliography  Save this article

Applicability analysis of transformer to wind speed forecasting by a novel deep learning framework with multiple atmospheric variables

Author

Listed:
  • Jiang, Wenjun
  • Liu, Bo
  • Liang, Yang
  • Gao, Huanxiang
  • Lin, Pengfei
  • Zhang, Dongqin
  • Hu, Gang

Abstract

Accurate wind speed forecasting plays a crucial role in the efficient and economical management of power supply systems. In this study, a novel framework combining variational mode decomposition (VMD), graph neural network (GNN) and temporal forecasting component is proposed for wind speed forecasting using multiple atmospheric variables. VMD is employed to decompose atmospheric variables into distinct subsequences at various frequencies, and GNN is utilized to effectively pass, aggregate, and update variable features, thus enabling the extraction of pairwise dependencies among the different variables. Subsequently, the transformer model is used as the temporal forecasting component in the proposed framework. Compared with several state-of-the-art transformer-based models and baseline models in AI field, the superior performance of our hybrid framework is observed. Lastly, several other deep learning models, including multi-layer perceptrons (MLP), long short-term memory (LSTM), and gated recurrent unit (GRU), are selected as forecasting component for assessing the applicability of the transformer. Interestingly, the transformer exhibits the lowest performance, while the GRU demonstrates the most promising results, with the mean absolute error (MAE) of 0.1356 m/s and 0.1085 m/s for one-step ahead forecasting, respectively. Overall, this research provides valuable insights into a novel framework and the applicability of the transformer for wind speed forecasting.

Suggested Citation

  • Jiang, Wenjun & Liu, Bo & Liang, Yang & Gao, Huanxiang & Lin, Pengfei & Zhang, Dongqin & Hu, Gang, 2024. "Applicability analysis of transformer to wind speed forecasting by a novel deep learning framework with multiple atmospheric variables," Applied Energy, Elsevier, vol. 353(PB).
    • Handle: RePEc:eee:appene:v:353:y:2024:i:pb:s0306261923015192
    DOI: 10.1016/j.apenergy.2023.122155
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923015192
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.122155?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tascikaraoglu, A. & Uzunoglu, M., 2014. "A review of combined approaches for prediction of short-term wind speed and power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 34(C), pages 243-254.
    2. Meka, Rajitha & Alaeddini, Adel & Bhaganagar, Kiran, 2021. "A robust deep learning framework for short-term wind power forecast of a full-scale wind farm using atmospheric variables," Energy, Elsevier, vol. 221(C).
    3. Pan, Xiaoxin & Wang, Long & Wang, Zhongju & Huang, Chao, 2022. "Short-term wind speed forecasting based on spatial-temporal graph transformer networks," Energy, Elsevier, vol. 253(C).
    4. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    5. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    6. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    7. Shi, Jihao & Li, Junjie & Usmani, Asif Sohail & Zhu, Yuan & Chen, Guoming & Yang, Dongdong, 2021. "Probabilistic real-time deep-water natural gas hydrate dispersion modeling by using a novel hybrid deep learning approach," Energy, Elsevier, vol. 219(C).
    8. Chengqing, Yu & Guangxi, Yan & Chengming, Yu & Yu, Zhang & Xiwei, Mi, 2023. "A multi-factor driven spatiotemporal wind power prediction model based on ensemble deep graph attention reinforcement learning networks," Energy, Elsevier, vol. 263(PE).
    9. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    10. Neshat, Mehdi & Nezhad, Meysam Majidi & Abbasnejad, Ehsan & Mirjalili, Seyedali & Groppi, Daniele & Heydari, Azim & Tjernberg, Lina Bertling & Astiaso Garcia, Davide & Alexander, Bradley & Shi, Qinfen, 2021. "Wind turbine power output prediction using a new hybrid neuro-evolutionary method," Energy, Elsevier, vol. 229(C).
    11. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    12. Wu, Huijuan & Meng, Keqilao & Fan, Daoerji & Zhang, Zhanqiang & Liu, Qing, 2022. "Multistep short-term wind speed forecasting using transformer," Energy, Elsevier, vol. 261(PA).
    13. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    14. Joseph, Lionel P. & Deo, Ravinesh C. & Prasad, Ramendra & Salcedo-Sanz, Sancho & Raj, Nawin & Soar, Jeffrey, 2023. "Near real-time wind speed forecast model with bidirectional LSTM networks," Renewable Energy, Elsevier, vol. 204(C), pages 39-58.
    15. Li, Siyi & Zhang, Mingrui & Piggott, Matthew D., 2023. "End-to-end wind turbine wake modelling with deep graph representation learning," Applied Energy, Elsevier, vol. 339(C).
    16. López, Germánico & Arboleya, Pablo, 2022. "Short-term wind speed forecasting over complex terrain using linear regression models and multivariable LSTM and NARX networks in the Andes Mountains, Ecuador," Renewable Energy, Elsevier, vol. 183(C), pages 351-368.
    17. Bommidi, Bala Saibabu & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "Hybrid wind speed forecasting using ICEEMDAN and transformer model with novel loss function," Energy, Elsevier, vol. 265(C).
    18. Neshat, Mehdi & Nezhad, Meysam Majidi & Mirjalili, Seyedali & Garcia, Davide Astiaso & Dahlquist, Erik & Gandomi, Amir H., 2023. "Short-term solar radiation forecasting using hybrid deep residual learning and gated LSTM recurrent network with differential covariance matrix adaptation evolution strategy," Energy, Elsevier, vol. 278(C).
    19. Wu, Qiang & Zheng, Hongling & Guo, Xiaozhu & Liu, Guangqiang, 2022. "Promoting wind energy for sustainable development by precise wind speed prediction based on graph neural networks," Renewable Energy, Elsevier, vol. 199(C), pages 977-992.
    20. Majidi Nezhad, Meysam & Neshat, Mehdi & Piras, Giuseppe & Astiaso Garcia, Davide, 2022. "Sites exploring prioritisation of offshore wind energy potential and mapping for wind farms installation: Iranian islands case studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dongran Song & Xiao Tan & Qian Huang & Li Wang & Mi Dong & Jian Yang & Solomin Evgeny, 2024. "Review of AI-Based Wind Prediction within Recent Three Years: 2021–2023," Energies, MDPI, vol. 17(6), pages 1-22, March.
    2. Huang, Xiaojia & Wang, Chen & Zhang, Shenghui, 2024. "Research and application of a Model selection forecasting system for wind speed and theoretical power generation in wind farms based on classification and wind conversion," Energy, Elsevier, vol. 293(C).
    3. Zhao, Ning & Su, Yi & Dai, Xianxing & Jia, Shaomin & Wang, Xuewei, 2024. "A new decomposition-ensemble strategy fusion with correntropy optimization learning algorithms for short-term wind speed prediction," Applied Energy, Elsevier, vol. 369(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Binrong & Wang, Lin, 2024. "Two-stage decomposition and temporal fusion transformers for interpretable wind speed forecasting," Energy, Elsevier, vol. 288(C).
    2. Wu, Binrong & Yu, Sihao & Peng, Lu & Wang, Lin, 2024. "Interpretable wind speed forecasting with meteorological feature exploring and two-stage decomposition," Energy, Elsevier, vol. 294(C).
    3. Wang, Shuangxin & Shi, Jiarong & Yang, Wei & Yin, Qingyan, 2024. "High and low frequency wind power prediction based on Transformer and BiGRU-Attention," Energy, Elsevier, vol. 288(C).
    4. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    5. Lin, Shengmao & Wang, Shu & Xu, Xuefang & Li, Ruixiong & Shi, Peiming, 2024. "GAOformer: An adaptive spatiotemporal feature fusion transformer utilizing GAT and optimizable graph matrixes for offshore wind speed prediction," Energy, Elsevier, vol. 292(C).
    6. Zhang, Guowei & Zhang, Yi & Wang, Hui & Liu, Da & Cheng, Runkun & Yang, Di, 2024. "Short-term wind speed forecasting based on adaptive secondary decomposition and robust temporal convolutional network," Energy, Elsevier, vol. 288(C).
    7. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    8. Chen, Zhengganzhe & Zhang, Bin & Du, Chenglong & Meng, Wei & Meng, Anbo, 2024. "A novel dynamic spatio-temporal graph convolutional network for wind speed interval prediction," Energy, Elsevier, vol. 294(C).
    9. Shengcai Zhang & Changsheng Zhu & Xiuting Guo, 2024. "Wind-Speed Multi-Step Forecasting Based on Variational Mode Decomposition, Temporal Convolutional Network, and Transformer Model," Energies, MDPI, vol. 17(9), pages 1-22, April.
    10. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    11. Zhang, Dongqin & Hu, Gang & Song, Jie & Gao, Huanxiang & Ren, Hehe & Chen, Wenli, 2024. "A novel spatio-temporal wind speed forecasting method based on the microscale meteorological model and a hybrid deep learning model," Energy, Elsevier, vol. 288(C).
    12. Shengxiang Lv & Lin Wang & Sirui Wang, 2023. "A Hybrid Neural Network Model for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 16(4), pages 1-18, February.
    13. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    14. Hu, Yue & Liu, Hanjing & Wu, Senzhen & Zhao, Yuan & Wang, Zhijin & Liu, Xiufeng, 2024. "Temporal collaborative attention for wind power forecasting," Applied Energy, Elsevier, vol. 357(C).
    15. Yang, Mao & Han, Chao & Zhang, Wei & Wang, Bo, 2024. "A short-term power prediction method for wind farm cluster based on the fusion of multi-source spatiotemporal feature information," Energy, Elsevier, vol. 294(C).
    16. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    17. Li, Yanting & Wu, Zhenyu & Su, Yan, 2023. "Adaptive short-term wind power forecasting with concept drifts," Renewable Energy, Elsevier, vol. 217(C).
    18. Joseph, Lionel P. & Deo, Ravinesh C. & Casillas-Pérez, David & Prasad, Ramendra & Raj, Nawin & Salcedo-Sanz, Sancho, 2024. "Short-term wind speed forecasting using an optimized three-phase convolutional neural network fused with bidirectional long short-term memory network model," Applied Energy, Elsevier, vol. 359(C).
    19. Ma, Long & Huang, Ling & Shi, Huifeng, 2023. "Multi-node wind speed forecasting based on a novel dynamic spatial–temporal graph network," Energy, Elsevier, vol. 285(C).
    20. Jin, Ji & Tian, Jinyu & Yu, Min & Wu, Yong & Tang, Yuanyan, 2024. "A novel ultra-short-term wind speed prediction method based on dynamic adaptive continued fraction," Chaos, Solitons & Fractals, Elsevier, vol. 180(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:353:y:2024:i:pb:s0306261923015192. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.