IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v294y2024ics0360544224006261.html
   My bibliography  Save this article

A novel model for ultra-short term wind power prediction based on Vision Transformer

Author

Listed:
  • Xiang, Ling
  • Fu, Xiaomengting
  • Yao, Qingtao
  • Zhu, Guopeng
  • Hu, Aijun

Abstract

Wind power has quickly developed in the world owing to the advantages of pure, inexpensive, and inexhaustible. However, strong volatility, unmanageable, and randomness make it difficult to achieve secure wind power generation. An excellent wind power prediction is effective for power system scheduling and safely stable operation. Vision Transformer (ViT) model is introduced for building a connection of the extracted characteristics and desired output. Long-short term memory (LSTM) is combined with ViT, and a new wind power forecasting model is proposed in this paper. For the proposed LSTM-ViT model, the temporal aspects of the weather data and correspondence properties are extracted based on LSTM. The link of the output and characteristic is established in view of the ViT, and the multi-headed self-attentiveness mechanisms in ViT fully exploit the relationship between the inputs. The validity and sophistication of the LSTM-ViT method are validated by the climate statistics and statistics of wind power. The results indicate that the wind power forecasting model is provided with higher prediction accuracy. The forecast results for the fourth quarter are used as analysis cases. The root mean square error of the method is reduced by 41.77%, 16.60%, 28.72%, 26.81%, and 16.25% compared to gate recurrent unit (GRU), LSTM, ViT, convolutional neural network (CNN)-ViT, and GRU-ViT respectively. The mean absolute error of the LSTM-ViT method in the first quarter is 0.327, with model comparison values reduction of 33.71%, 38.30%, 32.99%, 17.63% and 10.65% respectively.

Suggested Citation

  • Xiang, Ling & Fu, Xiaomengting & Yao, Qingtao & Zhu, Guopeng & Hu, Aijun, 2024. "A novel model for ultra-short term wind power prediction based on Vision Transformer," Energy, Elsevier, vol. 294(C).
    • Handle: RePEc:eee:energy:v:294:y:2024:i:c:s0360544224006261
    DOI: 10.1016/j.energy.2024.130854
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224006261
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.130854?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Thien Nguyen & Lam Nguyen & Phuoc Tran & Huu Nguyen & Dr Shahzad Sarfraz, 2021. "Improving Transformer-Based Neural Machine Translation with Prior Alignments," Complexity, Hindawi, vol. 2021, pages 1-10, May.
    2. Meka, Rajitha & Alaeddini, Adel & Bhaganagar, Kiran, 2021. "A robust deep learning framework for short-term wind power forecast of a full-scale wind farm using atmospheric variables," Energy, Elsevier, vol. 221(C).
    3. Xiong, Jinlin & Peng, Tian & Tao, Zihan & Zhang, Chu & Song, Shihao & Nazir, Muhammad Shahzad, 2023. "A dual-scale deep learning model based on ELM-BiLSTM and improved reptile search algorithm for wind power prediction," Energy, Elsevier, vol. 266(C).
    4. Xiang, Ling & Yang, Xin & Hu, Aijun & Su, Hao & Wang, Penghe, 2022. "Condition monitoring and anomaly detection of wind turbine based on cascaded and bidirectional deep learning networks," Applied Energy, Elsevier, vol. 305(C).
    5. Abou Houran, Mohamad & Salman Bukhari, Syed M. & Zafar, Muhammad Hamza & Mansoor, Majad & Chen, Wenjie, 2023. "COA-CNN-LSTM: Coati optimization algorithm-based hybrid deep learning model for PV/wind power forecasting in smart grid applications," Applied Energy, Elsevier, vol. 349(C).
    6. Yu, Guangzheng & Liu, Chengquan & Tang, Bo & Chen, Rusi & Lu, Liu & Cui, Chaoyue & Hu, Yue & Shen, Lingxu & Muyeen, S.M., 2022. "Short term wind power prediction for regional wind farms based on spatial-temporal characteristic distribution," Renewable Energy, Elsevier, vol. 199(C), pages 599-612.
    7. Peng, Tian & Zhang, Chu & Zhou, Jianzhong & Nazir, Muhammad Shahzad, 2021. "An integrated framework of Bi-directional long-short term memory (BiLSTM) based on sine cosine algorithm for hourly solar radiation forecasting," Energy, Elsevier, vol. 221(C).
    8. Draxl, Caroline & Clifton, Andrew & Hodge, Bri-Mathias & McCaa, Jim, 2015. "The Wind Integration National Dataset (WIND) Toolkit," Applied Energy, Elsevier, vol. 151(C), pages 355-366.
    9. Joseph, Lionel P. & Deo, Ravinesh C. & Prasad, Ramendra & Salcedo-Sanz, Sancho & Raj, Nawin & Soar, Jeffrey, 2023. "Near real-time wind speed forecast model with bidirectional LSTM networks," Renewable Energy, Elsevier, vol. 204(C), pages 39-58.
    10. Bingchun Liu & Shijie Zhao & Xiaogang Yu & Lei Zhang & Qingshan Wang, 2020. "A Novel Deep Learning Approach for Wind Power Forecasting Based on WD-LSTM Model," Energies, MDPI, vol. 13(18), pages 1-17, September.
    11. Zhang, Yu & Li, Yanting & Zhang, Guangyao, 2020. "Short-term wind power forecasting approach based on Seq2Seq model using NWP data," Energy, Elsevier, vol. 213(C).
    12. Wang, Jianing & Zhu, Hongqiu & Zhang, Yingjie & Cheng, Fei & Zhou, Can, 2023. "A novel prediction model for wind power based on improved long short-term memory neural network," Energy, Elsevier, vol. 265(C).
    13. Li, Ruilian & Zeng, Deliang & Li, Tingting & Ti, Baozhong & Hu, Yong, 2023. "Real-time prediction of SO2 emission concentration under wide range of variable loads by convolution-LSTM VE-transformer," Energy, Elsevier, vol. 269(C).
    14. Duarte Jacondino, William & Nascimento, Ana Lucia da Silva & Calvetti, Leonardo & Fisch, Gilberto & Augustus Assis Beneti, Cesar & da Paz, Sheila Radman, 2021. "Hourly day-ahead wind power forecasting at two wind farms in northeast Brazil using WRF model," Energy, Elsevier, vol. 230(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Dongdong & Chen, Baian & Zhu, Hongyu & Goh, Hui Hwang & Dong, Yunxuan & Wu, Thomas, 2023. "Short-term wind power prediction based on two-layer decomposition and BiTCN-BiLSTM-attention model," Energy, Elsevier, vol. 285(C).
    2. Zhang, Chu & Li, Zhengbo & Ge, Yida & Liu, Qianlong & Suo, Leiming & Song, Shihao & Peng, Tian, 2024. "Enhancing short-term wind speed prediction based on an outlier-robust ensemble deep random vector functional link network with AOA-optimized VMD," Energy, Elsevier, vol. 296(C).
    3. Meng, Anbo & Zhang, Haitao & Yin, Hao & Xian, Zikang & Chen, Shu & Zhu, Zibin & Zhang, Zheng & Rong, Jiayu & Li, Chen & Wang, Chenen & Wu, Zhenbo & Deng, Weisi & Luo, Jianqiang & Wang, Xiaolin, 2023. "A novel multi-gradient evolutionary deep learning approach for few-shot wind power prediction using time-series GAN," Energy, Elsevier, vol. 283(C).
    4. Lv, Yunlong & Hu, Qin & Xu, Hang & Lin, Huiyao & Wu, Yufan, 2024. "An ultra-short-term wind power prediction method based on spatial-temporal attention graph convolutional model," Energy, Elsevier, vol. 293(C).
    5. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    6. Zhang, Yue & Wang, Yeqin & Zhang, Chu & Qiao, Xiujie & Ge, Yida & Li, Xi & Peng, Tian & Nazir, Muhammad Shahzad, 2024. "State-of-health estimation for lithium-ion battery via an evolutionary Stacking ensemble learning paradigm of random vector functional link and active-state-tracking long–short-term memory neural netw," Applied Energy, Elsevier, vol. 356(C).
    7. Wen-Chang Tsai & Chih-Ming Hong & Chia-Sheng Tu & Whei-Min Lin & Chiung-Hsing Chen, 2023. "A Review of Modern Wind Power Generation Forecasting Technologies," Sustainability, MDPI, vol. 15(14), pages 1-40, July.
    8. Zhang, Dongqin & Hu, Gang & Song, Jie & Gao, Huanxiang & Ren, Hehe & Chen, Wenli, 2024. "A novel spatio-temporal wind speed forecasting method based on the microscale meteorological model and a hybrid deep learning model," Energy, Elsevier, vol. 288(C).
    9. Lin, Qingcheng & Cai, Huiling & Liu, Hanwei & Li, Xuefeng & Xiao, Hui, 2024. "A novel ultra-short-term wind power prediction model jointly driven by multiple algorithm optimization and adaptive selection," Energy, Elsevier, vol. 288(C).
    10. Tang, Yugui & Yang, Kuo & Zhang, Shujing & Zhang, Zhen, 2023. "Wind power forecasting: A hybrid forecasting model and multi-task learning-based framework," Energy, Elsevier, vol. 278(PA).
    11. Sun, Shaolong & Du, Zongjuan & Jin, Kun & Li, Hongtao & Wang, Shouyang, 2023. "Spatiotemporal wind power forecasting approach based on multi-factor extraction method and an indirect strategy," Applied Energy, Elsevier, vol. 350(C).
    12. Tang, Yugui & Yang, Kuo & Zhang, Shujing & Zhang, Zhen, 2024. "Wind power forecasting: A temporal domain generalization approach incorporating hybrid model and adversarial relationship-based training," Applied Energy, Elsevier, vol. 355(C).
    13. Cui, Yang & Chen, Zhenghong & He, Yingjie & Xiong, Xiong & Li, Fen, 2023. "An algorithm for forecasting day-ahead wind power via novel long short-term memory and wind power ramp events," Energy, Elsevier, vol. 263(PC).
    14. Tang, Yugui & Yang, Kuo & Zheng, Yichu & Ma, Li & Zhang, Shujing & Zhang, Zhen, 2024. "Wind power forecasting: A transfer learning approach incorporating temporal convolution and adversarial training," Renewable Energy, Elsevier, vol. 224(C).
    15. Yuan, Ran & Wang, Bo & Mao, Zhixin & Watada, Junzo, 2021. "Multi-objective wind power scenario forecasting based on PG-GAN," Energy, Elsevier, vol. 226(C).
    16. Zheng, Xidong & Bai, Feifei & Zeng, Ziyang & Jin, Tao, 2024. "A new methodology to improve wind power prediction accuracy considering power quality disturbance dimension reduction and elimination," Energy, Elsevier, vol. 287(C).
    17. Wei, Nan & Yin, Chuang & Yin, Lihua & Tan, Jingyi & Liu, Jinyuan & Wang, Shouxi & Qiao, Weibiao & Zeng, Fanhua, 2024. "Short-term load forecasting based on WM algorithm and transfer learning model," Applied Energy, Elsevier, vol. 353(PA).
    18. Jiang, Wenjun & Liu, Bo & Liang, Yang & Gao, Huanxiang & Lin, Pengfei & Zhang, Dongqin & Hu, Gang, 2024. "Applicability analysis of transformer to wind speed forecasting by a novel deep learning framework with multiple atmospheric variables," Applied Energy, Elsevier, vol. 353(PB).
    19. Wen, Songkang & Li, Yanting & Su, Yan, 2022. "A new hybrid model for power forecasting of a wind farm using spatial–temporal correlations," Renewable Energy, Elsevier, vol. 198(C), pages 155-168.
    20. Zhou, Gaoyu & Hu, Guofeng & Zhang, Daxing & Zhang, Yun, 2023. "A novel algorithm system for wind power prediction based on RANSAC data screening and Seq2Seq-Attention-BiGRU model," Energy, Elsevier, vol. 283(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:294:y:2024:i:c:s0360544224006261. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.