IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v238y2022ipbs0360544221020430.html
   My bibliography  Save this article

A hybrid deep learning architecture for wind power prediction based on bi-attention mechanism and crisscross optimization

Author

Listed:
  • Meng, Anbo
  • Chen, Shun
  • Ou, Zuhong
  • Ding, Weifeng
  • Zhou, Huaming
  • Fan, Jingmin
  • Yin, Hao

Abstract

Accurate wind power forecasting is of great significance for power system operation. In this study, a triple-stage multi-step wind power forecasting approach is proposed by applying attention-based deep residual gated recurrent unit (GRU) network combined with ensemble empirical mode decomposition (EEMD) and crisscross optimization algorithm (CSO). In the data processing stage, the EEMD is used to decompose the wind power/speed time series and a bi-attention mechanism (BA) is applied to enhance the sensitivity of model to the important information from both time and feature dimension. In the prediction stage, a series-connected deep learning model called RGRU consisting of the residual network and GRU is proposed as the forecasting model, aiming to make full use of extracting the static and dynamic coupling relationship among the input features. In the retraining-stage, a high-performance CSO algorithm is adopted to further optimize the fully-connected layer of RGRU model so as to improve the generalization ability of the model. The proposed method is validated on a wind farm located in Spain and the experimental results demonstrate that the proposed hybrid model has significant advantage over other state-of-the-art models involved in this study in terms of prediction accuracy and stability.

Suggested Citation

  • Meng, Anbo & Chen, Shun & Ou, Zuhong & Ding, Weifeng & Zhou, Huaming & Fan, Jingmin & Yin, Hao, 2022. "A hybrid deep learning architecture for wind power prediction based on bi-attention mechanism and crisscross optimization," Energy, Elsevier, vol. 238(PB).
    • Handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221020430
    DOI: 10.1016/j.energy.2021.121795
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221020430
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2021.121795?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Qunli Wu & Huaxing Lin, 2019. "Short-Term Wind Speed Forecasting Based on Hybrid Variational Mode Decomposition and Least Squares Support Vector Machine Optimized by Bat Algorithm Model," Sustainability, MDPI, vol. 11(3), pages 1-18, January.
    2. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda & Song, Jiakang, 2018. "Deep belief network based k-means cluster approach for short-term wind power forecasting," Energy, Elsevier, vol. 165(PA), pages 840-852.
    3. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    4. Qu, Zongxi & Mao, Wenqian & Zhang, Kequan & Zhang, Wenyu & Li, Zhipeng, 2019. "Multi-step wind speed forecasting based on a hybrid decomposition technique and an improved back-propagation neural network," Renewable Energy, Elsevier, vol. 133(C), pages 919-929.
    5. Kisvari, Adam & Lin, Zi & Liu, Xiaolei, 2021. "Wind power forecasting – A data-driven method along with gated recurrent neural network," Renewable Energy, Elsevier, vol. 163(C), pages 1895-1909.
    6. Wang, Jian-Zhou & Wang, Yun & Jiang, Ping, 2015. "The study and application of a novel hybrid forecasting model – A case study of wind speed forecasting in China," Applied Energy, Elsevier, vol. 143(C), pages 472-488.
    7. Liu, Hui & Mi, Xiwei & Li, Yanfei & Duan, Zhu & Xu, Yinan, 2019. "Smart wind speed deep learning based multi-step forecasting model using singular spectrum analysis, convolutional Gated Recurrent Unit network and Support Vector Regression," Renewable Energy, Elsevier, vol. 143(C), pages 842-854.
    8. Liu, Hui & Mi, Xiwei & Li, Yanfei, 2018. "An experimental investigation of three new hybrid wind speed forecasting models using multi-decomposing strategy and ELM algorithm," Renewable Energy, Elsevier, vol. 123(C), pages 694-705.
    9. Meng, Anbo & Hu, Hanwu & Yin, Hao & Peng, Xiangang & Guo, Zhuangzhi, 2015. "Crisscross optimization algorithm for large-scale dynamic economic dispatch problem with valve-point effects," Energy, Elsevier, vol. 93(P2), pages 2175-2190.
    10. Peng, Xiaosheng & Wang, Hongyu & Lang, Jianxun & Li, Wenze & Xu, Qiyou & Zhang, Zuowei & Cai, Tao & Duan, Shanxu & Liu, Fangjie & Li, Chaoshun, 2021. "EALSTM-QR: Interval wind-power prediction model based on numerical weather prediction and deep learning," Energy, Elsevier, vol. 220(C).
    11. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    12. Lin, Zi & Liu, Xiaolei, 2020. "Wind power forecasting of an offshore wind turbine based on high-frequency SCADA data and deep learning neural network," Energy, Elsevier, vol. 201(C).
    13. Wang, Shouxiang & Zhang, Na & Wu, Lei & Wang, Yamin, 2016. "Wind speed forecasting based on the hybrid ensemble empirical mode decomposition and GA-BP neural network method," Renewable Energy, Elsevier, vol. 94(C), pages 629-636.
    14. Yin, Hao & Ou, Zuhong & Huang, Shengquan & Meng, Anbo, 2019. "A cascaded deep learning wind power prediction approach based on a two-layer of mode decomposition," Energy, Elsevier, vol. 189(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Wenhe & Zhou, Hanting & Cheng, Longsheng & Xia, Min, 2023. "Prediction of regional wind power generation using a multi-objective optimized deep learning model with temporal pattern attention," Energy, Elsevier, vol. 278(PB).
    2. Fan, Jingmin & Zhong, Mingwei & Guan, Yuanpeng & Yi, Siqi & Xu, Cancheng & Zhai, Yanpeng & Zhou, Yongwang, 2024. "An online long-term load forecasting method: Hierarchical highway network based on crisscross feature collaboration," Energy, Elsevier, vol. 299(C).
    3. Yang, Mao & Guo, Yunfeng & Fan, Fulin & Huang, Tao, 2024. "Two-stage correction prediction of wind power based on numerical weather prediction wind speed superposition correction and improved clustering," Energy, Elsevier, vol. 302(C).
    4. Zang, Haixiang & Chen, Dianhao & Liu, Jingxuan & Cheng, Lilin & Sun, Guoqiang & Wei, Zhinong, 2024. "Improving ultra-short-term photovoltaic power forecasting using a novel sky-image-based framework considering spatial-temporal feature interaction," Energy, Elsevier, vol. 293(C).
    5. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    6. Lin, Qingcheng & Cai, Huiling & Liu, Hanwei & Li, Xuefeng & Xiao, Hui, 2024. "A novel ultra-short-term wind power prediction model jointly driven by multiple algorithm optimization and adaptive selection," Energy, Elsevier, vol. 288(C).
    7. Mirza, Adeel Feroz & Mansoor, Majad & Usman, Muhammad & Ling, Qiang, 2023. "A comprehensive approach for PV wind forecasting by using a hyperparameter tuned GCVCNN-MRNN deep learning model," Energy, Elsevier, vol. 283(C).
    8. Meng, Anbo & Chen, Shu & Ou, Zuhong & Xiao, Jianhua & Zhang, Jianfeng & Chen, Shun & Zhang, Zheng & Liang, Ruduo & Zhang, Zhan & Xian, Zikang & Wang, Chenen & Yin, Hao & Yan, Baiping, 2022. "A novel few-shot learning approach for wind power prediction applying secondary evolutionary generative adversarial network," Energy, Elsevier, vol. 261(PA).
    9. Lv, Yunlong & Hu, Qin & Xu, Hang & Lin, Huiyao & Wu, Yufan, 2024. "An ultra-short-term wind power prediction method based on spatial-temporal attention graph convolutional model," Energy, Elsevier, vol. 293(C).
    10. Renxi Gong & Xianglong Li, 2023. "A Short-Term Load Forecasting Model Based on Crisscross Grey Wolf Optimizer and Dual-Stage Attention Mechanism," Energies, MDPI, vol. 16(6), pages 1-24, March.
    11. Yu, Enbo & Xu, Guoji & Han, Yan & Li, Yongle, 2022. "An efficient short-term wind speed prediction model based on cross-channel data integration and attention mechanisms," Energy, Elsevier, vol. 256(C).
    12. Wu, Qiang & Zheng, Hongling & Guo, Xiaozhu & Liu, Guangqiang, 2022. "Promoting wind energy for sustainable development by precise wind speed prediction based on graph neural networks," Renewable Energy, Elsevier, vol. 199(C), pages 977-992.
    13. Guo, Nai-Zhi & Shi, Ke-Zhong & Li, Bo & Qi, Liang-Wen & Wu, Hong-Hui & Zhang, Zi-Liang & Xu, Jian-Zhong, 2022. "A physics-inspired neural network model for short-term wind power prediction considering wake effects," Energy, Elsevier, vol. 261(PA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    3. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    4. Chen, Xue-Jun & Zhao, Jing & Jia, Xiao-Zhong & Li, Zhong-Long, 2021. "Multi-step wind speed forecast based on sample clustering and an optimized hybrid system," Renewable Energy, Elsevier, vol. 165(P1), pages 595-611.
    5. Li, Dan & Jiang, Fuxin & Chen, Min & Qian, Tao, 2022. "Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks," Energy, Elsevier, vol. 238(PC).
    6. Paweł Piotrowski & Dariusz Baczyński & Marcin Kopyt & Tomasz Gulczyński, 2022. "Advanced Ensemble Methods Using Machine Learning and Deep Learning for One-Day-Ahead Forecasts of Electric Energy Production in Wind Farms," Energies, MDPI, vol. 15(4), pages 1-30, February.
    7. Huang, Hao-Hsuan & Huang, Yun-Hsun, 2024. "Applying green learning to regional wind power prediction and fluctuation risk assessment," Energy, Elsevier, vol. 295(C).
    8. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    9. Liu, Lei & Liu, Jicheng & Ye, Yu & Liu, Hui & Chen, Kun & Li, Dong & Dong, Xue & Sun, Mingzhai, 2023. "Ultra-short-term wind power forecasting based on deep Bayesian model with uncertainty," Renewable Energy, Elsevier, vol. 205(C), pages 598-607.
    10. Wang, Lin & Tao, Rui & Hu, Huanling & Zeng, Yu-Rong, 2021. "Effective wind power prediction using novel deep learning network: Stacked independently recurrent autoencoder," Renewable Energy, Elsevier, vol. 164(C), pages 642-655.
    11. Paweł Piotrowski & Inajara Rutyna & Dariusz Baczyński & Marcin Kopyt, 2022. "Evaluation Metrics for Wind Power Forecasts: A Comprehensive Review and Statistical Analysis of Errors," Energies, MDPI, vol. 15(24), pages 1-38, December.
    12. Zhang, Shuai & Chen, Yong & Xiao, Jiuhong & Zhang, Wenyu & Feng, Ruijun, 2021. "Hybrid wind speed forecasting model based on multivariate data secondary decomposition approach and deep learning algorithm with attention mechanism," Renewable Energy, Elsevier, vol. 174(C), pages 688-704.
    13. Li, Ke & Shen, Ruifang & Wang, Zhenguo & Yan, Bowen & Yang, Qingshan & Zhou, Xuhong, 2023. "An efficient wind speed prediction method based on a deep neural network without future information leakage," Energy, Elsevier, vol. 267(C).
    14. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    15. Li, Qingyang & Wang, Guosong & Wu, Xinrong & Gao, Zhigang & Dan, Bo, 2024. "Arctic short-term wind speed forecasting based on CNN-LSTM model with CEEMDAN," Energy, Elsevier, vol. 299(C).
    16. Farah, Shahid & David A, Wood & Humaira, Nisar & Aneela, Zameer & Steffen, Eger, 2022. "Short-term multi-hour ahead country-wide wind power prediction for Germany using gated recurrent unit deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    17. Lv, Sheng-Xiang & Wang, Lin, 2022. "Deep learning combined wind speed forecasting with hybrid time series decomposition and multi-objective parameter optimization," Applied Energy, Elsevier, vol. 311(C).
    18. Upma Singh & Mohammad Rizwan & Muhannad Alaraj & Ibrahim Alsaidan, 2021. "A Machine Learning-Based Gradient Boosting Regression Approach for Wind Power Production Forecasting: A Step towards Smart Grid Environments," Energies, MDPI, vol. 14(16), pages 1-21, August.
    19. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.
    20. Nathan Oaks Farrar & Mohd Hasan Ali & Dipankar Dasgupta, 2023. "Artificial Intelligence and Machine Learning in Grid Connected Wind Turbine Control Systems: A Comprehensive Review," Energies, MDPI, vol. 16(3), pages 1-25, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221020430. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.