IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v278y2023ics0360544223010721.html
   My bibliography  Save this article

A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy

Author

Listed:
  • Nascimento, Erick Giovani Sperandio
  • de Melo, Talison A.C.
  • Moreira, Davidson M.

Abstract

This work presents a novel transformer-based deep neural network architecture integrated with wavelet transform for forecasting wind speed and wind energy (power) generation for the next 6 h ahead, using multiple meteorological variables as input for multivariate time series forecasting. To evaluate the performance of the proposed model, different case studies were investigated, using data collected from anemometers installed in three different regions in Bahia, Brazil. The performance of the proposed transformer-based model with wavelet transform was compared with an LSTM (Long Short Term Memory) model as a baseline, since it has been successfully used for time series processing in deep learning, as well as with previous state-of-the-art (SOTA) similar works. Results of the forecasting performance were evaluated using statistical metrics, along with the time for training and performing inferences, both using quantitative and qualitative analysis. They showed that the proposed method is effective for forecasting wind speed and power generation, with superior performance than the baseline model and comparable performance to previous similar SOTA works, presenting potential suitability for being extended for the general purpose of multivariate time series forecasting. Furthermore, results demonstrated that the integration of the transformer model with wavelet decomposition improved the forecast accuracy.

Suggested Citation

  • Nascimento, Erick Giovani Sperandio & de Melo, Talison A.C. & Moreira, Davidson M., 2023. "A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy," Energy, Elsevier, vol. 278(C).
    • Handle: RePEc:eee:energy:v:278:y:2023:i:c:s0360544223010721
    DOI: 10.1016/j.energy.2023.127678
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223010721
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2023.127678?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zucatelli, P.J. & Nascimento, E.G.S. & Santos, A.Á.B. & Arce, A.M.G. & Moreira, D.M., 2021. "An investigation on deep learning and wavelet transform to nowcast wind power and wind power ramp: A case study in Brazil and Uruguay," Energy, Elsevier, vol. 230(C).
    2. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    3. Lim, Bryan & Arık, Sercan Ö. & Loeff, Nicolas & Pfister, Tomas, 2021. "Temporal Fusion Transformers for interpretable multi-horizon time series forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1748-1764.
    4. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Saeed, Adnan & Li, Chaoshun & Gan, Zhenhao, 2024. "Short-term wind speed interval prediction using improved quality-driven loss based gated multi-scale convolutional sequence model," Energy, Elsevier, vol. 300(C).
    2. Wang, Jujie & Liu, Yafen & Li, Yaning, 2024. "A parallel differential learning ensemble framework based on enhanced feature extraction and anti-information leakage mechanism for ultra-short-term wind speed forecast," Applied Energy, Elsevier, vol. 361(C).
    3. Wen-Chang Tsai & Chih-Ming Hong & Chia-Sheng Tu & Whei-Min Lin & Chiung-Hsing Chen, 2023. "A Review of Modern Wind Power Generation Forecasting Technologies," Sustainability, MDPI, vol. 15(14), pages 1-40, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Du, Pei & Yang, Dongchuan & Li, Yanzhao & Wang, Jianzhou, 2024. "An innovative interpretable combined learning model for wind speed forecasting," Applied Energy, Elsevier, vol. 358(C).
    2. Bentsen, Lars Ødegaard & Warakagoda, Narada Dilp & Stenbro, Roy & Engelstad, Paal, 2023. "Spatio-temporal wind speed forecasting using graph networks and novel Transformer architectures," Applied Energy, Elsevier, vol. 333(C).
    3. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    4. Wu, Binrong & Yu, Sihao & Peng, Lu & Wang, Lin, 2024. "Interpretable wind speed forecasting with meteorological feature exploring and two-stage decomposition," Energy, Elsevier, vol. 294(C).
    5. Miguel López Santos & Xela García-Santiago & Fernando Echevarría Camarero & Gonzalo Blázquez Gil & Pablo Carrasco Ortega, 2022. "Application of Temporal Fusion Transformer for Day-Ahead PV Power Forecasting," Energies, MDPI, vol. 15(14), pages 1-22, July.
    6. Shengxiang Lv & Lin Wang & Sirui Wang, 2023. "A Hybrid Neural Network Model for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 16(4), pages 1-18, February.
    7. Liu, Chenyu & Zhang, Xuemin & Mei, Shengwei & Zhou, Qingyu & Fan, Hang, 2023. "Series-wise attention network for wind power forecasting considering temporal lag of numerical weather prediction," Applied Energy, Elsevier, vol. 336(C).
    8. Frank, Johannes, 2023. "Forecasting realized volatility in turbulent times using temporal fusion transformers," FAU Discussion Papers in Economics 03/2023, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
    9. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    10. Dong, Hanjiang & Zhu, Jizhong & Li, Shenglin & Wu, Wanli & Zhu, Haohao & Fan, Junwei, 2023. "Short-term residential household reactive power forecasting considering active power demand via deep Transformer sequence-to-sequence networks," Applied Energy, Elsevier, vol. 329(C).
    11. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    12. Wuyue An & Lin Wang & Dongfeng Zhang, 2023. "Comprehensive commodity price forecasting framework using text mining methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1865-1888, November.
    13. Kate Murray & Andrea Rossi & Diego Carraro & Andrea Visentin, 2023. "On Forecasting Cryptocurrency Prices: A Comparison of Machine Learning, Deep Learning, and Ensembles," Forecasting, MDPI, vol. 5(1), pages 1-14, January.
    14. Zhang, Yagang & Zhang, Jinghui & Yu, Leyi & Pan, Zhiya & Feng, Changyou & Sun, Yiqian & Wang, Fei, 2022. "A short-term wind energy hybrid optimal prediction system with denoising and novel error correction technique," Energy, Elsevier, vol. 254(PC).
    15. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    16. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    17. Fachrizal Aksan & Yang Li & Vishnu Suresh & Przemysław Janik, 2023. "Multistep Forecasting of Power Flow Based on LSTM Autoencoder: A Study Case in Regional Grid Cluster Proposal," Energies, MDPI, vol. 16(13), pages 1-20, June.
    18. Shichao Huang & Jing Zhang & Yu He & Xiaofan Fu & Luqin Fan & Gang Yao & Yongjun Wen, 2022. "Short-Term Load Forecasting Based on the CEEMDAN-Sample Entropy-BPNN-Transformer," Energies, MDPI, vol. 15(10), pages 1-14, May.
    19. Ma, Yixiang & Yu, Lean & Zhang, Guoxing, 2022. "Short-term wind power forecasting with an intermittency-trait-driven methodology," Renewable Energy, Elsevier, vol. 198(C), pages 872-883.
    20. Karla Schröder & Gonzalo Farias & Sebastián Dormido-Canto & Ernesto Fabregas, 2024. "Comparative Analysis of Deep Learning Methods for Fault Avoidance and Predicting Demand in Electrical Distribution," Energies, MDPI, vol. 17(11), pages 1-13, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:278:y:2023:i:c:s0360544223010721. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.