IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v239y2022ipbs0360544221023768.html
   My bibliography  Save this article

Short-term wind speed forecasting using deep reinforcement learning with improved multiple error correction approach

Author

Listed:
  • Yang, Rui
  • Liu, Hui
  • Nikitas, Nikolaos
  • Duan, Zhu
  • Li, Yanfei
  • Li, Ye

Abstract

The safe and stable operation of wind power systems requires the support of wind speed prediction. To ensure the controllability and stability of smart grid dispatching, a novel hybrid model consisting of data-adaptive decomposition, reinforcement learning ensemble, and improved error correction is established for short-term wind speed forecasting. In decomposition module, empirical wavelet transform algorithm is used to adaptively disassemble and reconstruct the wind speed series. In ensemble module, Q-learning is utilized to integrate gated recurrent unit, bidirectional long short-term memory, and deep belief network. In error correction module, wavelet packet decomposition and outlier-robust extreme learning machine are combined to developing predictable components. An appropriate correction shrinkage rate is used to obtain the best correction effect. Ljung-Box Q-Test is utilized to judge the termination of the error correction iteration. Four real data are utilized to validate model performance in the case study. Experimental results show that: (a) The proposed hybrid model can accurately capture the changes of wind data. Taking 1-step prediction results as an example, the mean absolute errors for site #1, #2, #3, and #4 are 0.0829 m/s, 0.0661 m/s, 0.0906 m/s, and 0.0803 m/s, respectively; (b) Compared with several state-of-the-art models, the proposed model has the best prediction performance.

Suggested Citation

  • Yang, Rui & Liu, Hui & Nikitas, Nikolaos & Duan, Zhu & Li, Yanfei & Li, Ye, 2022. "Short-term wind speed forecasting using deep reinforcement learning with improved multiple error correction approach," Energy, Elsevier, vol. 239(PB).
  • Handle: RePEc:eee:energy:v:239:y:2022:i:pb:s0360544221023768
    DOI: 10.1016/j.energy.2021.122128
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221023768
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2021.122128?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Hui & Chen, Chao, 2019. "Multi-objective data-ensemble wind speed forecasting model with stacked sparse autoencoder and adaptive decomposition-based error correction," Applied Energy, Elsevier, vol. 254(C).
    2. Zhang, Jinliang & Tan, Zhongfu & Wei, Yiming, 2020. "An adaptive hybrid model for short term electricity price forecasting," Applied Energy, Elsevier, vol. 258(C).
    3. Hu, Rui & Hu, Weihao & Gökmen, Nuri & Li, Pengfei & Huang, Qi & Chen, Zhe, 2019. "High resolution wind speed forecasting based on wavelet decomposed phase space reconstruction and self-organizing map," Renewable Energy, Elsevier, vol. 140(C), pages 17-31.
    4. Niu, Xinsong & Wang, Jiyang, 2019. "A combined model based on data preprocessing strategy and multi-objective optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 241(C), pages 519-539.
    5. Jiang, Ping & Liu, Zhenkun & Niu, Xinsong & Zhang, Lifang, 2021. "A combined forecasting system based on statistical method, artificial neural networks, and deep learning methods for short-term wind speed forecasting," Energy, Elsevier, vol. 217(C).
    6. Xu, Weifeng & Liu, Pan & Cheng, Lei & Zhou, Yong & Xia, Qian & Gong, Yu & Liu, Yini, 2021. "Multi-step wind speed prediction by combining a WRF simulation and an error correction strategy," Renewable Energy, Elsevier, vol. 163(C), pages 772-782.
    7. Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong & Liu, Zhenkun, 2021. "Ensemble wind speed forecasting with multi-objective Archimedes optimization algorithm and sub-model selection," Applied Energy, Elsevier, vol. 301(C).
    8. Khosravi, A. & Machado, L. & Nunes, R.O., 2018. "Time-series prediction of wind speed using machine learning algorithms: A case study Osorio wind farm, Brazil," Applied Energy, Elsevier, vol. 224(C), pages 550-566.
    9. Peng, Tian & Zhang, Chu & Zhou, Jianzhong & Nazir, Muhammad Shahzad, 2021. "An integrated framework of Bi-directional long-short term memory (BiLSTM) based on sine cosine algorithm for hourly solar radiation forecasting," Energy, Elsevier, vol. 221(C).
    10. Wang, Yun & Wang, Haibo & Srinivasan, Dipti & Hu, Qinghua, 2019. "Robust functional regression for wind speed forecasting based on Sparse Bayesian learning," Renewable Energy, Elsevier, vol. 132(C), pages 43-60.
    11. Georgilakis, Pavlos S., 2008. "Technical challenges associated with the integration of wind power into power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 12(3), pages 852-863, April.
    12. Peng, Tian & Zhang, Chu & Zhou, Jianzhong & Nazir, Muhammad Shahzad, 2020. "Negative correlation learning-based RELM ensemble model integrated with OVMD for multi-step ahead wind speed forecasting," Renewable Energy, Elsevier, vol. 156(C), pages 804-819.
    13. Li, Gong & Shi, Jing, 2010. "On comparing three artificial neural networks for wind speed forecasting," Applied Energy, Elsevier, vol. 87(7), pages 2313-2320, July.
    14. Song, Jingjing & Wang, Jianzhou & Lu, Haiyan, 2018. "A novel combined model based on advanced optimization algorithm for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 215(C), pages 643-658.
    15. Liu, Hui & Mi, Xiwei & Li, Yanfei, 2018. "An experimental investigation of three new hybrid wind speed forecasting models using multi-decomposing strategy and ELM algorithm," Renewable Energy, Elsevier, vol. 123(C), pages 694-705.
    16. Emeksiz, Cem & Tan, Mustafa, 2022. "Multi-step wind speed forecasting and Hurst analysis using novel hybrid secondary decomposition approach," Energy, Elsevier, vol. 238(PA).
    17. Lei, Ma & Shiyan, Luan & Chuanwen, Jiang & Hongling, Liu & Yan, Zhang, 2009. "A review on the forecasting of wind speed and generated power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(4), pages 915-920, May.
    18. Duan, Jikai & Zuo, Hongchao & Bai, Yulong & Duan, Jizheng & Chang, Mingheng & Chen, Bolong, 2021. "Short-term wind speed forecasting using recurrent neural networks with error correction," Energy, Elsevier, vol. 217(C).
    19. Zhang, Jinliang & Wei, Yiming & Tan, Zhongfu, 2020. "An adaptive hybrid model for short term wind speed forecasting," Energy, Elsevier, vol. 190(C).
    20. Moreno, Sinvaldo Rodrigues & Mariani, Viviana Cocco & Coelho, Leandro dos Santos, 2021. "Hybrid multi-stage decomposition with parametric model applied to wind speed forecasting in Brazilian Northeast," Renewable Energy, Elsevier, vol. 164(C), pages 1508-1526.
    21. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    22. Wang, Jujie & Li, Yaning, 2018. "Multi-step ahead wind speed prediction based on optimal feature extraction, long short term memory neural network and error correction strategy," Applied Energy, Elsevier, vol. 230(C), pages 429-443.
    23. Erdem, Ergin & Shi, Jing, 2011. "ARMA based approaches for forecasting the tuple of wind speed and direction," Applied Energy, Elsevier, vol. 88(4), pages 1405-1414, April.
    24. Liu, Hui & Yang, Rui & Wang, Tiantian & Zhang, Lei, 2021. "A hybrid neural network model for short-term wind speed forecasting based on decomposition, multi-learner ensemble, and adaptive multiple error corrections," Renewable Energy, Elsevier, vol. 165(P1), pages 573-594.
    25. Hassani, Hossein & Yeganegi, Mohammad Reza, 2020. "Selecting optimal lag order in Ljung–Box test," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 541(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dongran Song & Xiao Tan & Qian Huang & Li Wang & Mi Dong & Jian Yang & Solomin Evgeny, 2024. "Review of AI-Based Wind Prediction within Recent Three Years: 2021–2023," Energies, MDPI, vol. 17(6), pages 1-22, March.
    2. Yang, Mao & Guo, Yunfeng & Fan, Fulin & Huang, Tao, 2024. "Two-stage correction prediction of wind power based on numerical weather prediction wind speed superposition correction and improved clustering," Energy, Elsevier, vol. 302(C).
    3. Garafutdinova Daniya & Decai Tang, 2024. "Green Finance and Industrial Low-Carbon Transition: A Case Study on Green Economy Policy in Kazakhstan," Sustainability, MDPI, vol. 16(17), pages 1-23, September.
    4. Sandra Minerva Valdivia-Bautista & José Antonio Domínguez-Navarro & Marco Pérez-Cisneros & Carlos Jesahel Vega-Gómez & Beatriz Castillo-Téllez, 2023. "Artificial Intelligence in Wind Speed Forecasting: A Review," Energies, MDPI, vol. 16(5), pages 1-28, March.
    5. Ana Lagos & Joaquín E. Caicedo & Gustavo Coria & Andrés Romero Quete & Maximiliano Martínez & Gastón Suvire & Jesús Riquelme, 2022. "State-of-the-Art Using Bibliometric Analysis of Wind-Speed and -Power Forecasting Methods Applied in Power Systems," Energies, MDPI, vol. 15(18), pages 1-40, September.
    6. Liu, Wenhui & Bai, Yulong & Yue, Xiaoxin & Wang, Rui & Song, Qi, 2024. "A wind speed forcasting model based on rime optimization based VMD and multi-headed self-attention-LSTM," Energy, Elsevier, vol. 294(C).
    7. Xiong, Zhanhang & Yao, Jianjiang & Huang, Yongmin & Yu, Zhaoxu & Liu, Yalei, 2024. "A wind speed forecasting method based on EMD-MGM with switching QR loss function and novel subsequence superposition," Applied Energy, Elsevier, vol. 353(PB).
    8. Ban, Guihua & Chen, Yan & Xiong, Zhenhua & Zhuo, Yixin & Huang, Kui, 2024. "The univariate model for long-term wind speed forecasting based on wavelet soft threshold denoising and improved Autoformer," Energy, Elsevier, vol. 290(C).
    9. Zhao, Jing & Guo, Yiyi & Lin, Yihua & Zhao, Zhiyuan & Guo, Zhenhai, 2024. "A novel dynamic ensemble of numerical weather prediction for multi-step wind speed forecasting with deep reinforcement learning and error sequence modeling," Energy, Elsevier, vol. 302(C).
    10. Zhou, Yanting & Ma, Zhongjing & Zhang, Jinhui & Zou, Suli, 2022. "Data-driven stochastic energy management of multi energy system using deep reinforcement learning," Energy, Elsevier, vol. 261(PA).
    11. Lilia Tightiz & Joon Yoo, 2022. "A Review on a Data-Driven Microgrid Management System Integrating an Active Distribution Network: Challenges, Issues, and New Trends," Energies, MDPI, vol. 15(22), pages 1-24, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    3. Li, Dan & Jiang, Fuxin & Chen, Min & Qian, Tao, 2022. "Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks," Energy, Elsevier, vol. 238(PC).
    4. Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong & Liu, Zhenkun, 2021. "Ensemble wind speed forecasting with multi-objective Archimedes optimization algorithm and sub-model selection," Applied Energy, Elsevier, vol. 301(C).
    5. Lu, Peng & Ye, Lin & Zhao, Yongning & Dai, Binhua & Pei, Ming & Tang, Yong, 2021. "Review of meta-heuristic algorithms for wind power prediction: Methodologies, applications and challenges," Applied Energy, Elsevier, vol. 301(C).
    6. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).
    7. Zhihao Shang & Quan Wen & Yanhua Chen & Bing Zhou & Mingliang Xu, 2022. "Wind Speed Forecasting Using Attention-Based Causal Convolutional Network and Wind Energy Conversion," Energies, MDPI, vol. 15(8), pages 1-23, April.
    8. Yang, Wendong & Sun, Shaolong & Hao, Yan & Wang, Shouyang, 2022. "A novel machine learning-based electricity price forecasting model based on optimal model selection strategy," Energy, Elsevier, vol. 238(PC).
    9. Liu, Hui & Duan, Zhu & Li, Yanfei & Lu, Haibo, 2018. "A novel ensemble model of different mother wavelets for wind speed multi-step forecasting," Applied Energy, Elsevier, vol. 228(C), pages 1783-1800.
    10. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    11. Liu, Hui & Yang, Rui & Wang, Tiantian & Zhang, Lei, 2021. "A hybrid neural network model for short-term wind speed forecasting based on decomposition, multi-learner ensemble, and adaptive multiple error corrections," Renewable Energy, Elsevier, vol. 165(P1), pages 573-594.
    12. Wang, Xuguang & Ren, Huan & Zhai, Junhai & Xing, Hongjie & Su, Jie, 2022. "Adaptive support segment based short-term wind speed forecasting," Energy, Elsevier, vol. 249(C).
    13. Li, Yanhui & Sun, Kaixuan & Yao, Qi & Wang, Lin, 2024. "A dual-optimization wind speed forecasting model based on deep learning and improved dung beetle optimization algorithm," Energy, Elsevier, vol. 286(C).
    14. Duan, Jikai & Chang, Mingheng & Chen, Xiangyue & Wang, Wenpeng & Zuo, Hongchao & Bai, Yulong & Chen, Bolong, 2022. "A combined short-term wind speed forecasting model based on CNN–RNN and linear regression optimization considering error," Renewable Energy, Elsevier, vol. 200(C), pages 788-808.
    15. Liu, Xingdou & Zhang, Li & Wang, Jiangong & Zhou, Yue & Gan, Wei, 2023. "A unified multi-step wind speed forecasting framework based on numerical weather prediction grids and wind farm monitoring data," Renewable Energy, Elsevier, vol. 211(C), pages 948-963.
    16. Acikgoz, Hakan & Budak, Umit & Korkmaz, Deniz & Yildiz, Ceyhun, 2021. "WSFNet: An efficient wind speed forecasting model using channel attention-based densely connected convolutional neural network," Energy, Elsevier, vol. 233(C).
    17. Zhao, Xinyu & Bai, Mingliang & Yang, Xusheng & Liu, Jinfu & Yu, Daren & Chang, Juntao, 2021. "Short-term probabilistic predictions of wind multi-parameter based on one-dimensional convolutional neural network with attention mechanism and multivariate copula distribution estimation," Energy, Elsevier, vol. 234(C).
    18. Wang, Xuguang & Li, Xiao & Su, Jie, 2023. "Distribution drift-adaptive short-term wind speed forecasting," Energy, Elsevier, vol. 273(C).
    19. Du, Pei & Yang, Dongchuan & Li, Yanzhao & Wang, Jianzhou, 2024. "An innovative interpretable combined learning model for wind speed forecasting," Applied Energy, Elsevier, vol. 358(C).
    20. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:239:y:2022:i:pb:s0360544221023768. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.