IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v329y2023ics0306261922015483.html
   My bibliography  Save this article

Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach

Author

Listed:
  • Li, Yang
  • Wang, Ruinong
  • Li, Yuanzheng
  • Zhang, Meng
  • Long, Chao

Abstract

In a modern power system with an increasing proportion of renewable energy, wind power prediction is crucial to the arrangement of power grid dispatching plans due to the volatility of wind power. However, traditional centralized forecasting methods raise concerns regarding data privacy-preserving and data islands problem. To handle the data privacy and openness, we propose a forecasting scheme that combines federated learning and deep reinforcement learning (DRL) for ultra-short-term wind power forecasting, called federated deep reinforcement learning (FedDRL). Firstly, this paper uses the deep deterministic policy gradient (DDPG) algorithm as the basic forecasting model to improve prediction accuracy. Secondly, we integrate the DDPG forecasting model into the framework of federated learning. The designed FedDRL can obtain an accurate prediction model in a decentralized way by sharing model parameters instead of sharing private data which can avoid sensitive privacy issues. The simulation results show that the proposed FedDRL outperforms the traditional prediction methods in terms of forecasting accuracy. More importantly, while ensuring the forecasting performance, FedDRL can effectively protect the data privacy and relieve the communication pressure compared with the traditional centralized forecasting method. In addition, a simulation with different federated learning parameters is conducted to confirm the robustness of the proposed scheme.

Suggested Citation

  • Li, Yang & Wang, Ruinong & Li, Yuanzheng & Zhang, Meng & Long, Chao, 2023. "Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach," Applied Energy, Elsevier, vol. 329(C).
  • Handle: RePEc:eee:appene:v:329:y:2023:i:c:s0306261922015483
    DOI: 10.1016/j.apenergy.2022.120291
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261922015483
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2022.120291?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda & Song, Jiakang, 2018. "Deep belief network based k-means cluster approach for short-term wind power forecasting," Energy, Elsevier, vol. 165(PA), pages 840-852.
    2. Zhao, Yongning & Ye, Lin & Li, Zhi & Song, Xuri & Lang, Yansheng & Su, Jian, 2016. "A novel bidirectional mechanism based on time series model for wind power forecasting," Applied Energy, Elsevier, vol. 177(C), pages 793-803.
    3. Li, Yang & Zhang, Meng & Chen, Chen, 2022. "A Deep-Learning intelligent system incorporating data augmentation for Short-Term voltage stability assessment of power systems," Applied Energy, Elsevier, vol. 308(C).
    4. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    5. Zhang, Wenyu & Chen, Qian & Yan, Jianyong & Zhang, Shuai & Xu, Jiyuan, 2021. "A novel asynchronous deep reinforcement learning model with adaptive early forecasting method and reward incentive mechanism for short-term load forecasting," Energy, Elsevier, vol. 236(C).
    6. Li, Yang & Wang, Jinlong & Zhao, Dongbo & Li, Guoqing & Chen, Chen, 2018. "A two-stage approach for combined heat and power economic emission dispatch: Combining multi-objective optimization with integrated decision making," Energy, Elsevier, vol. 162(C), pages 237-254.
    7. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    8. Gonçalves, Carla & Bessa, Ricardo J. & Pinson, Pierre, 2021. "A critical overview of privacy-preserving approaches for collaborative forecasting," International Journal of Forecasting, Elsevier, vol. 37(1), pages 322-342.
    9. Li, Yang & Wang, Bin & Yang, Zhen & Li, Jiazheng & Chen, Chen, 2022. "Hierarchical stochastic scheduling of multi-community integrated energy systems in uncertain environments via Stackelberg game," Applied Energy, Elsevier, vol. 308(C).
    10. Li, Yang & Feng, Bo & Wang, Bin & Sun, Shuchao, 2022. "Joint planning of distributed generations and energy storage in active distribution networks: A Bi-Level programming approach," Energy, Elsevier, vol. 245(C).
    11. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    12. Conor Sweeney & Ricardo J. Bessa & Jethro Browell & Pierre Pinson, 2020. "The future of forecasting for renewable energy," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 9(2), March.
    13. Li, Yang & Yang, Zhen & Li, Guoqing & Mu, Yunfei & Zhao, Dongbo & Chen, Chen & Shen, Bo, 2018. "Optimal scheduling of isolated microgrid with an electric vehicle battery swapping station in multi-stakeholder scenarios: A bi-level programming approach via real-time pricing," Applied Energy, Elsevier, vol. 232(C), pages 54-68.
    14. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    15. Wang, Shouxiang & Zhang, Na & Wu, Lei & Wang, Yamin, 2016. "Wind speed forecasting based on the hybrid ensemble empirical mode decomposition and GA-BP neural network method," Renewable Energy, Elsevier, vol. 94(C), pages 629-636.
    16. Dariush Khezrimotlagh & Yao Chen, 2018. "The Optimization Approach," International Series in Operations Research & Management Science, in: Decision Making and Performance Evaluation Using Data Envelopment Analysis, chapter 0, pages 107-134, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Yongning & Pan, Shiji & Zhao, Yuan & Liao, Haohan & Ye, Lin & Zheng, Yingying, 2024. "Ultra-short-term wind power forecasting based on personalized robust federated learning with spatial collaboration," Energy, Elsevier, vol. 288(C).
    2. Zhang, Le & Zhu, Jizhong & Zhang, Di & Liu, Yun, 2023. "An incremental photovoltaic power prediction method considering concept drift and privacy protection," Applied Energy, Elsevier, vol. 351(C).
    3. Jiankai Gao & Yang Li & Bin Wang & Haibo Wu, 2023. "Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm," Energies, MDPI, vol. 16(7), pages 1-21, April.
    4. Jian Zhu & Zhiyuan Zhao & Xiaoran Zheng & Zhao An & Qingwu Guo & Zhikai Li & Jianling Sun & Yuanjun Guo, 2023. "Time-Series Power Forecasting for Wind and Solar Energy Based on the SL-Transformer," Energies, MDPI, vol. 16(22), pages 1-15, November.
    5. Wang, Cong & He, Yan & Zhang, Hong-li & Ma, Ping, 2024. "Wind power forecasting based on manifold learning and a double-layer SWLSTM model," Energy, Elsevier, vol. 290(C).
    6. Hu, Jiaxiang & Hu, Weihao & Cao, Di & Huang, Yuehui & Chen, Jianjun & Li, Yahe & Chen, Zhe & Blaabjerg, Frede, 2024. "Bayesian averaging-enabled transfer learning method for probabilistic wind power forecasting of newly built wind farms," Applied Energy, Elsevier, vol. 355(C).
    7. Shang, Yitong & Li, Sen, 2024. "FedPT-V2G: Security enhanced federated transformer learning for real-time V2G dispatch with non-IID data," Applied Energy, Elsevier, vol. 358(C).
    8. Ashkan Safari & Hamed Kheirandish Gharehbagh & Morteza Nazari Heris, 2023. "DeepVELOX: INVELOX Wind Turbine Intelligent Power Forecasting Using Hybrid GWO–GBR Algorithm," Energies, MDPI, vol. 16(19), pages 1-22, September.
    9. Arturs Nikulins & Kaspars Sudars & Edgars Edelmers & Ivars Namatevs & Kaspars Ozols & Vitalijs Komasilovs & Aleksejs Zacepins & Armands Kviesis & Andreas Reinhardt, 2024. "Deep Learning for Wind and Solar Energy Forecasting in Hydrogen Production," Energies, MDPI, vol. 17(5), pages 1-12, February.
    10. Ashok Bhansali & Namala Narasimhulu & Rocío Pérez de Prado & Parameshachari Bidare Divakarachari & Dayanand Lal Narayan, 2023. "A Review on Sustainable Energy Sources Using Machine Learning and Deep Learning Models," Energies, MDPI, vol. 16(17), pages 1-18, August.
    11. Xia, Qinqin & Wang, Yu & Zou, Yao & Yan, Ziming & Zhou, Niancheng & Chi, Yuan & Wang, Qianggang, 2024. "Regional-privacy-preserving operation of networked microgrids: Edge-cloud cooperative learning with differentiated policies," Applied Energy, Elsevier, vol. 370(C).
    12. Chen, Bingyang & Zeng, Xingjie & Zhang, Weishan & Fan, Lulu & Cao, Shaohua & Zhou, Jiehan, 2023. "Knowledge sharing-based multi-block federated learning for few-shot oil layer identification," Energy, Elsevier, vol. 283(C).
    13. Chen, Fuhao & Yan, Jie & Liu, Yongqian & Yan, Yamin & Tjernberg, Lina Bertling, 2024. "A novel meta-learning approach for few-shot short-term wind power forecasting," Applied Energy, Elsevier, vol. 362(C).
    14. Te Li & Mengze Zhang & Yan Zhou, 2024. "LTPNet Integration of Deep Learning and Environmental Decision Support Systems for Renewable Energy Demand Forecasting," Papers 2410.15286, arXiv.org.
    15. Wassila Tercha & Sid Ahmed Tadjer & Fathia Chekired & Laurent Canale, 2024. "Machine Learning-Based Forecasting of Temperature and Solar Irradiance for Photovoltaic Systems," Energies, MDPI, vol. 17(5), pages 1-20, February.
    16. Yang, Mao & Guo, Yunfeng & Huang, Yutong, 2023. "Wind power ultra-short-term prediction method based on NWP wind speed correction and double clustering division of transitional weather process," Energy, Elsevier, vol. 282(C).
    17. Mahdi Khodayar & Jacob Regan, 2023. "Deep Neural Networks in Power Systems: A Review," Energies, MDPI, vol. 16(12), pages 1-38, June.
    18. Wang, Tianjing & Dong, Zhao Yang, 2024. "Adaptive personalized federated reinforcement learning for multiple-ESS optimal market dispatch strategy with electric vehicles and photovoltaic power generations," Applied Energy, Elsevier, vol. 365(C).
    19. Li, Yang & Bu, Fanjin & Li, Yuanzheng & Long, Chao, 2023. "Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 333(C).
    20. Lv, Yunlong & Hu, Qin & Xu, Hang & Lin, Huiyao & Wu, Yufan, 2024. "An ultra-short-term wind power prediction method based on spatial-temporal attention graph convolutional model," Energy, Elsevier, vol. 293(C).
    21. Abdoos, Ali Akbar & Abdoos, Hatef & Kazemitabar, Javad & Mobashsher, Mohammad Mehdi & Khaloo, Hooman, 2023. "An intelligent hybrid method based on Monte Carlo simulation for short-term probabilistic wind power prediction," Energy, Elsevier, vol. 278(PA).
    22. Abou Houran, Mohamad & Salman Bukhari, Syed M. & Zafar, Muhammad Hamza & Mansoor, Majad & Chen, Wenjie, 2023. "COA-CNN-LSTM: Coati optimization algorithm-based hybrid deep learning model for PV/wind power forecasting in smart grid applications," Applied Energy, Elsevier, vol. 349(C).
    23. Tang, Yugui & Zhang, Shujing & Zhang, Zhen, 2024. "A privacy-preserving framework integrating federated learning and transfer learning for wind power forecasting," Energy, Elsevier, vol. 286(C).
    24. Li, Yang & Han, Meng & Shahidehpour, Mohammad & Li, Jiazheng & Long, Chao, 2023. "Data-driven distributionally robust scheduling of community integrated energy systems with uncertain renewable generations considering integrated demand response," Applied Energy, Elsevier, vol. 335(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yang & Han, Meng & Shahidehpour, Mohammad & Li, Jiazheng & Long, Chao, 2023. "Data-driven distributionally robust scheduling of community integrated energy systems with uncertain renewable generations considering integrated demand response," Applied Energy, Elsevier, vol. 335(C).
    2. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    3. Li, Yang & Wang, Bin & Yang, Zhen & Li, Jiazheng & Chen, Chen, 2022. "Hierarchical stochastic scheduling of multi-community integrated energy systems in uncertain environments via Stackelberg game," Applied Energy, Elsevier, vol. 308(C).
    4. Li, Yang & Bu, Fanjin & Li, Yuanzheng & Long, Chao, 2023. "Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 333(C).
    5. Jiankai Gao & Yang Li & Bin Wang & Haibo Wu, 2023. "Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm," Energies, MDPI, vol. 16(7), pages 1-21, April.
    6. Li, Dan & Jiang, Fuxin & Chen, Min & Qian, Tao, 2022. "Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks," Energy, Elsevier, vol. 238(PC).
    7. Hu, Jianming & Heng, Jiani & Wen, Jiemei & Zhao, Weigang, 2020. "Deterministic and probabilistic wind speed forecasting with de-noising-reconstruction strategy and quantile regression based algorithm," Renewable Energy, Elsevier, vol. 162(C), pages 1208-1226.
    8. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    9. Wang, Jianzhou & Niu, Tong & Lu, Haiyan & Guo, Zhenhai & Yang, Wendong & Du, Pei, 2018. "An analysis-forecast system for uncertainty modeling of wind speed: A case study of large-scale wind farms," Applied Energy, Elsevier, vol. 211(C), pages 492-512.
    10. Zhang, Yi-Ming & Wang, Hao, 2023. "Multi-head attention-based probabilistic CNN-BiLSTM for day-ahead wind speed forecasting," Energy, Elsevier, vol. 278(PA).
    11. Parri, Srihari & Teeparthi, Kiran & Kosana, Vishalteja, 2023. "A hybrid VMD based contextual feature representation approach for wind speed forecasting," Renewable Energy, Elsevier, vol. 219(P1).
    12. Shitu Zhang & Zhixun Zhu & Yang Li, 2021. "A Critical Review of Data-Driven Transient Stability Assessment of Power Systems: Principles, Prospects and Challenges," Energies, MDPI, vol. 14(21), pages 1-13, November.
    13. Ru Hou & Yi Yang & Qingcong Yuan & Yanhua Chen, 2019. "Research and Application of Hybrid Wind-Energy Forecasting Models Based on Cuckoo Search Optimization," Energies, MDPI, vol. 12(19), pages 1-17, September.
    14. Chengcheng Gu & Hua Li, 2022. "Review on Deep Learning Research and Applications in Wind and Wave Energy," Energies, MDPI, vol. 15(4), pages 1-19, February.
    15. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    16. Yang, Mao & Wang, Da & Xu, Chuanyu & Dai, Bozhi & Ma, Miaomiao & Su, Xin, 2023. "Power transfer characteristics in fluctuation partition algorithm for wind speed and its application to wind power forecasting," Renewable Energy, Elsevier, vol. 211(C), pages 582-594.
    17. Changyu Zhou & Guohe Huang & Jiapei Chen, 2019. "A Type-2 Fuzzy Chance-Constrained Fractional Integrated Modeling Method for Energy System Management of Uncertainties and Risks," Energies, MDPI, vol. 12(13), pages 1-21, June.
    18. Zonggui Yao & Chen Wang, 2018. "A Hybrid Model Based on A Modified Optimization Algorithm and An Artificial Intelligence Algorithm for Short-Term Wind Speed Multi-Step Ahead Forecasting," Sustainability, MDPI, vol. 10(5), pages 1-33, May.
    19. Donovin D. Lewis & Aron Patrick & Evan S. Jones & Rosemary E. Alden & Abdullah Al Hadi & Malcolm D. McCulloch & Dan M. Ionel, 2023. "Decarbonization Analysis for Thermal Generation and Regionally Integrated Large-Scale Renewables Based on Minutely Optimal Dispatch with a Kentucky Case Study," Energies, MDPI, vol. 16(4), pages 1-23, February.
    20. Sareen, Karan & Panigrahi, Bijaya Ketan & Shikhola, Tushar & Sharma, Rajneesh, 2023. "An imputation and decomposition algorithms based integrated approach with bidirectional LSTM neural network for wind speed prediction," Energy, Elsevier, vol. 278(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:329:y:2023:i:c:s0306261922015483. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.