IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v309y2024ics0360544224028470.html
   My bibliography  Save this article

FedWindT: Federated learning assisted transformer architecture for collaborative and secure wind power forecasting in diverse conditions

Author

Listed:
  • Arooj, Qumrish

Abstract

Accurate wind power forecasting is crucial for efficient grid management and maximizing the utilization of wind energy. This study introduces the FedWindT, an innovative model that combines transformer neural architectures with federated learning, specifically designed to enhance wind power prediction. The transformer’s self-attention mechanism adeptly captures the temporal dynamics of wind data, while federated learning facilitates a decentralized, privacy-preserving training process. Our comprehensive empirical analysis across multiple wind farm datasets demonstrates that the FedWindT consistently outperforms traditional state-of-the-art centralized approaches. Specifically, the FedWindT achieved an average Normalized Mean Squared Error (NMSE) of 0.0109, Mean Absolute Error (MAE) of 0.0243, and Root Mean Squared Error (RMSE) of 0.0288, with R-squared (R2) values consistently closer to 1, indicating high predictive accuracy. These results validate the effectiveness of combining federated learning with advanced neural architectures and highlight a promising direction for future decentralized energy forecasting solutions.

Suggested Citation

  • Arooj, Qumrish, 2024. "FedWindT: Federated learning assisted transformer architecture for collaborative and secure wind power forecasting in diverse conditions," Energy, Elsevier, vol. 309(C).
    • Handle: RePEc:eee:energy:v:309:y:2024:i:c:s0360544224028470
    DOI: 10.1016/j.energy.2024.133072
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224028470
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2024.133072?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sun, Mucun & Feng, Cong & Zhang, Jie, 2019. "Conditional aggregated probabilistic wind power forecasting based on spatio-temporal correlation," Applied Energy, Elsevier, vol. 256(C).
    2. Liu, Hui & Chen, Chao, 2019. "Multi-objective data-ensemble wind speed forecasting model with stacked sparse autoencoder and adaptive decomposition-based error correction," Applied Energy, Elsevier, vol. 254(C).
    3. Ahmed, R. & Sreeram, V. & Mishra, Y. & Arif, M.D., 2020. "A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).
    4. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    5. Zhen, Hao & Niu, Dongxiao & Wang, Keke & Shi, Yucheng & Ji, Zhengsen & Xu, Xiaomin, 2021. "Photovoltaic power forecasting based on GA improved Bi-LSTM in microgrid without meteorological information," Energy, Elsevier, vol. 231(C).
    6. Ge Zhang & Songyang Zhu & Xiaoqing Bai, 2022. "Federated Learning-Based Multi-Energy Load Forecasting Method Using CNN-Attention-LSTM Model," Sustainability, MDPI, vol. 14(19), pages 1-14, October.
    7. Li, Yang & Wang, Ruinong & Li, Yuanzheng & Zhang, Meng & Long, Chao, 2023. "Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach," Applied Energy, Elsevier, vol. 329(C).
    8. Das, Anooshmita & Annaqeeb, Masab Khalid & Azar, Elie & Novakovic, Vojislav & Kjærgaard, Mikkel Baun, 2020. "Occupant-centric miscellaneous electric loads prediction in buildings using state-of-the-art deep learning methods," Applied Energy, Elsevier, vol. 269(C).
    9. Zhong, Mingwei & Fan, Jingmin & Luo, Jianqiang & Xiao, Xuanyi & He, Guanglin & Cai, Rui, 2024. "InfoCAVB-MemoryFormer: Forecasting of wind and photovoltaic power through the interaction of data reconstruction and data augmentation," Applied Energy, Elsevier, vol. 371(C).
    10. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    11. Tuttle, Jacob F. & Blackburn, Landen D. & Andersson, Klas & Powell, Kody M., 2021. "A systematic comparison of machine learning methods for modeling of dynamic processes applied to combustion emission rate modeling," Applied Energy, Elsevier, vol. 292(C).
    12. Peng, Tian & Zhang, Chu & Zhou, Jianzhong & Nazir, Muhammad Shahzad, 2021. "An integrated framework of Bi-directional long-short term memory (BiLSTM) based on sine cosine algorithm for hourly solar radiation forecasting," Energy, Elsevier, vol. 221(C).
    13. Lorin Jenkel & Stefan Jonas & Angela Meyer, 2023. "Privacy-Preserving Fleet-Wide Learning of Wind Turbine Conditions with Federated Learning," Energies, MDPI, vol. 16(17), pages 1-29, September.
    14. Qu, Jiaqi & Qian, Zheng & Pei, Yan, 2021. "Day-ahead hourly photovoltaic power forecasting using attention-based CNN-LSTM neural network embedded with multiple relevant and target variables prediction pattern," Energy, Elsevier, vol. 232(C).
    15. Liu, Ling & Wang, Jujie, 2021. "Super multi-step wind speed forecasting system with training set extension and horizontal–vertical integration neural network," Applied Energy, Elsevier, vol. 292(C).
    16. Amir Mosavi & Mohsen Salimi & Sina Faizollahzadeh Ardabili & Timon Rabczuk & Shahaboddin Shamshirband & Annamaria R. Varkonyi-Koczy, 2019. "State of the Art of Machine Learning Models in Energy Systems, a Systematic Review," Energies, MDPI, vol. 12(7), pages 1-42, April.
    17. Zhong, Mingwei & Xu, Cancheng & Xian, Zikang & He, Guanglin & Zhai, Yanpeng & Zhou, Yongwang & Fan, Jingmin, 2024. "DTTM: A deep temporal transfer model for ultra-short-term online wind power forecasting," Energy, Elsevier, vol. 286(C).
    18. Conor Sweeney & Ricardo J. Bessa & Jethro Browell & Pierre Pinson, 2020. "The future of forecasting for renewable energy," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 9(2), March.
    19. Liang, Tao & Zhao, Qing & Lv, Qingzhao & Sun, Hexu, 2021. "A novel wind speed prediction strategy based on Bi-LSTM, MOOFADA and transfer learning for centralized control centers," Energy, Elsevier, vol. 230(C).
    20. Yin, Hao & Ou, Zuhong & Huang, Shengquan & Meng, Anbo, 2019. "A cascaded deep learning wind power prediction approach based on a two-layer of mode decomposition," Energy, Elsevier, vol. 189(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    2. Jin, Huaiping & Zhang, Kehao & Fan, Shouyuan & Jin, Huaikang & Wang, Bin, 2024. "Wind power forecasting based on ensemble deep learning with surrogate-assisted evolutionary neural architecture search and many-objective federated learning," Energy, Elsevier, vol. 308(C).
    3. Abou Houran, Mohamad & Salman Bukhari, Syed M. & Zafar, Muhammad Hamza & Mansoor, Majad & Chen, Wenjie, 2023. "COA-CNN-LSTM: Coati optimization algorithm-based hybrid deep learning model for PV/wind power forecasting in smart grid applications," Applied Energy, Elsevier, vol. 349(C).
    4. Cao, Yisheng & Liu, Gang & Luo, Donghua & Bavirisetti, Durga Prasad & Xiao, Gang, 2023. "Multi-timescale photovoltaic power forecasting using an improved Stacking ensemble algorithm based LSTM-Informer model," Energy, Elsevier, vol. 283(C).
    5. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    6. Paweł Piotrowski & Inajara Rutyna & Dariusz Baczyński & Marcin Kopyt, 2022. "Evaluation Metrics for Wind Power Forecasts: A Comprehensive Review and Statistical Analysis of Errors," Energies, MDPI, vol. 15(24), pages 1-38, December.
    7. Tang, Yugui & Yang, Kuo & Zhang, Shujing & Zhang, Zhen, 2022. "Photovoltaic power forecasting: A hybrid deep learning model incorporating transfer learning strategy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    8. liu, Qian & li, Yulin & jiang, Hang & chen, Yilin & zhang, Jiang, 2024. "Short-term photovoltaic power forecasting based on multiple mode decomposition and parallel bidirectional long short term combined with convolutional neural networks," Energy, Elsevier, vol. 286(C).
    9. Zheng, Lingwei & Su, Ran & Sun, Xinyu & Guo, Siqi, 2023. "Historical PV-output characteristic extraction based weather-type classification strategy and its forecasting method for the day-ahead prediction of PV output," Energy, Elsevier, vol. 271(C).
    10. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    11. Jian Zhu & Zhiyuan Zhao & Xiaoran Zheng & Zhao An & Qingwu Guo & Zhikai Li & Jianling Sun & Yuanjun Guo, 2023. "Time-Series Power Forecasting for Wind and Solar Energy Based on the SL-Transformer," Energies, MDPI, vol. 16(22), pages 1-15, November.
    12. Lai, Wenzhe & Zhen, Zhao & Wang, Fei & Fu, Wenjie & Wang, Junlong & Zhang, Xudong & Ren, Hui, 2024. "Sub-region division based short-term regional distributed PV power forecasting method considering spatio-temporal correlations," Energy, Elsevier, vol. 288(C).
    13. Dokur, Emrah & Erdogan, Nuh & Salari, Mahdi Ebrahimi & Karakuzu, Cihan & Murphy, Jimmy, 2022. "Offshore wind speed short-term forecasting based on a hybrid method: Swarm decomposition and meta-extreme learning machine," Energy, Elsevier, vol. 248(C).
    14. Fachrizal Aksan & Yang Li & Vishnu Suresh & Przemysław Janik, 2023. "Multistep Forecasting of Power Flow Based on LSTM Autoencoder: A Study Case in Regional Grid Cluster Proposal," Energies, MDPI, vol. 16(13), pages 1-20, June.
    15. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    16. Wei, Nan & Yin, Chuang & Yin, Lihua & Tan, Jingyi & Liu, Jinyuan & Wang, Shouxi & Qiao, Weibiao & Zeng, Fanhua, 2024. "Short-term load forecasting based on WM algorithm and transfer learning model," Applied Energy, Elsevier, vol. 353(PA).
    17. Liu, Ling & Wang, Jujie & Li, Jianping & Wei, Lu, 2023. "An online transfer learning model for wind turbine power prediction based on spatial feature construction and system-wide update," Applied Energy, Elsevier, vol. 340(C).
    18. Lin, Yu & Lu, Qin & Tan, Bin & Yu, Yuanyuan, 2022. "Forecasting energy prices using a novel hybrid model with variational mode decomposition," Energy, Elsevier, vol. 246(C).
    19. Li, Jiale & Song, Zihao & Wang, Xuefei & Wang, Yanru & Jia, Yaya, 2022. "A novel offshore wind farm typhoon wind speed prediction model based on PSO–Bi-LSTM improved by VMD," Energy, Elsevier, vol. 251(C).
    20. Ma, Yixiang & Yu, Lean & Zhang, Guoxing, 2022. "Short-term wind power forecasting with an intermittency-trait-driven methodology," Renewable Energy, Elsevier, vol. 198(C), pages 872-883.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:309:y:2024:i:c:s0360544224028470. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.