IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v375y2024ics0306261924015125.html
   My bibliography  Save this article

Reanalysis and Ground Station data: Advanced data preprocessing in deep learning for wind power prediction

Author

Listed:
  • Ding, Jun-Wei
  • Chuang, Ming-Ju
  • Tseng, Jing-Siou
  • Hsieh, I-Yun Lisa

Abstract

Amidst the global transition to renewable energy, accurate wind power forecasting is becoming increasingly critical for grid integration. This study introduces a robust deep learning model that evaluates wind power generation using a novel approach that combines reanalysis and ground station data, aiming to improve prediction accuracy. To address potential discrepancies in raw data, preprocessing methods such as Boxplot and the DBSCAN algorithm are applied, effectively reducing outlier impact. A key innovation in our methodology is the component kriging interpolation, significantly enhancing the precision of wind speed and direction predictions. Moreover, we introduce two novel concepts: performance-based clustering and the integration of informational inputs. The clustering method organizes data by training performance, promoting a more efficient and accurate model training process. Informational inputs provide additional context, enabling the model to discern patterns across multiple wind farms, thereby improving generalizability. Employing a sophisticated four-layer Long Short-Term Memory (LSTM) network, coupled with a Multilayer Perceptron (MLP), the model uses a 48-hour lead time of combined meteorological and informational data to predict the capacity factor for the forthcoming hour. Our comprehensive testing across various wind farms yields an impressive R2 score of 0.95, demonstrating the model's exceptional predictive capabilities. This study not only advances wind power forecasting methods but also sets a new standard for the integration of diverse data sources in predictive modeling. The findings provide valuable insights for future research, potentially extending these innovative methodologies to broader applications in sustainable energy forecasting globally.

Suggested Citation

  • Ding, Jun-Wei & Chuang, Ming-Ju & Tseng, Jing-Siou & Hsieh, I-Yun Lisa, 2024. "Reanalysis and Ground Station data: Advanced data preprocessing in deep learning for wind power prediction," Applied Energy, Elsevier, vol. 375(C).
  • Handle: RePEc:eee:appene:v:375:y:2024:i:c:s0306261924015125
    DOI: 10.1016/j.apenergy.2024.124129
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924015125
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.124129?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jung, Jaesung & Broadwater, Robert P., 2014. "Current status and future advances for wind speed and power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 762-777.
    2. Tascikaraoglu, A. & Uzunoglu, M., 2014. "A review of combined approaches for prediction of short-term wind speed and power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 34(C), pages 243-254.
    3. Colak, Ilhami & Sagiroglu, Seref & Yesilbudak, Mehmet, 2012. "Data mining and wind power prediction: A literature review," Renewable Energy, Elsevier, vol. 46(C), pages 241-247.
    4. Lu, Peng & Ye, Lin & Zhao, Yongning & Dai, Binhua & Pei, Ming & Tang, Yong, 2021. "Review of meta-heuristic algorithms for wind power prediction: Methodologies, applications and challenges," Applied Energy, Elsevier, vol. 301(C).
    5. Charabi, Yassine & Al-Yahyai, Sultan & Gastli, Adel, 2011. "Evaluation of NWP performance for wind energy resource assessment in Oman," Renewable and Sustainable Energy Reviews, Elsevier, vol. 15(3), pages 1545-1555, April.
    6. Ait Maatallah, Othman & Achuthan, Ajit & Janoyan, Kerop & Marzocca, Pier, 2015. "Recursive wind speed forecasting based on Hammerstein Auto-Regressive model," Applied Energy, Elsevier, vol. 145(C), pages 191-197.
    7. Manobel, Bartolomé & Sehnke, Frank & Lazzús, Juan A. & Salfate, Ignacio & Felder, Martin & Montecinos, Sonia, 2018. "Wind turbine power curve modeling based on Gaussian Processes and Artificial Neural Networks," Renewable Energy, Elsevier, vol. 125(C), pages 1015-1020.
    8. Yang, Wenxian & Court, Richard & Jiang, Jiesheng, 2013. "Wind turbine condition monitoring by the approach of SCADA data analysis," Renewable Energy, Elsevier, vol. 53(C), pages 365-376.
    9. Al-Yahyai, Sultan & Charabi, Yassine & Al-Badi, Abdullah & Gastli, Adel, 2012. "Nested ensemble NWP approach for wind energy assessment," Renewable Energy, Elsevier, vol. 37(1), pages 150-160.
    10. Shahid, Farah & Zameer, Aneela & Mehmood, Ammara & Raja, Muhammad Asif Zahoor, 2020. "A novel wavenets long short term memory paradigm for wind power prediction," Applied Energy, Elsevier, vol. 269(C).
    11. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda & Song, Jiakang, 2018. "Deep belief network based k-means cluster approach for short-term wind power forecasting," Energy, Elsevier, vol. 165(PA), pages 840-852.
    12. Niu, Zhewen & Yu, Zeyuan & Tang, Wenhu & Wu, Qinghua & Reformat, Marek, 2020. "Wind power forecasting using attention-based gated recurrent unit network," Energy, Elsevier, vol. 196(C).
    13. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    14. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    15. Zhang, Fei & Li, Peng-Cheng & Gao, Lu & Liu, Yong-Qian & Ren, Xiao-Ying, 2021. "Application of autoregressive dynamic adaptive (ARDA) model in real-time wind power forecasting," Renewable Energy, Elsevier, vol. 169(C), pages 129-143.
    16. Yin, Shi & Liu, Hui, 2022. "Wind power prediction based on outlier correction, ensemble reinforcement learning, and residual correction," Energy, Elsevier, vol. 250(C).
    17. Lazić, Lazar & Pejanović, Goran & Živković, Momčilo, 2010. "Wind forecasts for wind power generation using the Eta model," Renewable Energy, Elsevier, vol. 35(6), pages 1236-1243.
    18. Zhengxuan Xiao & Fei Tang & Mengyuan Wang, 2023. "Wind Power Short-Term Forecasting Method Based on LSTM and Multiple Error Correction," Sustainability, MDPI, vol. 15(4), pages 1-19, February.
    19. Jingtao Huang & Gang Niu & Haiping Guan & Shuzhong Song, 2023. "Ultra-Short-Term Wind Power Prediction Based on LSTM with Loss Shrinkage Adam," Energies, MDPI, vol. 16(9), pages 1-13, April.
    20. Wang, Lin & Tao, Rui & Hu, Huanling & Zeng, Yu-Rong, 2021. "Effective wind power prediction using novel deep learning network: Stacked independently recurrent autoencoder," Renewable Energy, Elsevier, vol. 164(C), pages 642-655.
    21. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    22. Zhang, Jinhua & Yan, Jie & Infield, David & Liu, Yongqian & Lien, Fue-sang, 2019. "Short-term forecasting and uncertainty analysis of wind turbine power based on long short-term memory network and Gaussian mixture model," Applied Energy, Elsevier, vol. 241(C), pages 229-244.
    23. Sun, Haiying & Qiu, Changyu & Lu, Lin & Gao, Xiaoxia & Chen, Jian & Yang, Hongxing, 2020. "Wind turbine power modelling and optimization using artificial neural network with wind field experimental data," Applied Energy, Elsevier, vol. 280(C).
    24. Khazaei, Sahra & Ehsan, Mehdi & Soleymani, Soodabeh & Mohammadnezhad-Shourkaei, Hosein, 2022. "A high-accuracy hybrid method for short-term wind power forecasting," Energy, Elsevier, vol. 238(PC).
    25. Zhang, Yu & Li, Yanting & Zhang, Guangyao, 2020. "Short-term wind power forecasting approach based on Seq2Seq model using NWP data," Energy, Elsevier, vol. 213(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    3. Costa, Marcelo Azevedo & Ruiz-Cárdenas, Ramiro & Mineti, Leandro Brioschi & Prates, Marcos Oliveira, 2021. "Dynamic time scan forecasting for multi-step wind speed prediction," Renewable Energy, Elsevier, vol. 177(C), pages 584-595.
    4. Zhang, Yu & Li, Yanting & Zhang, Guangyao, 2020. "Short-term wind power forecasting approach based on Seq2Seq model using NWP data," Energy, Elsevier, vol. 213(C).
    5. Al-qaness, Mohammed A.A. & Ewees, Ahmed A. & Fan, Hong & Abualigah, Laith & Elaziz, Mohamed Abd, 2022. "Boosted ANFIS model using augmented marine predator algorithm with mutation operators for wind power forecasting," Applied Energy, Elsevier, vol. 314(C).
    6. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    7. Li, Yanting & Wu, Zhenyu & Su, Yan, 2023. "Adaptive short-term wind power forecasting with concept drifts," Renewable Energy, Elsevier, vol. 217(C).
    8. Dai, Xiaoran & Liu, Guo-Ping & Hu, Wenshan, 2023. "An online-learning-enabled self-attention-based model for ultra-short-term wind power forecasting," Energy, Elsevier, vol. 272(C).
    9. Lahouar, A. & Ben Hadj Slama, J., 2017. "Hour-ahead wind power forecast based on random forests," Renewable Energy, Elsevier, vol. 109(C), pages 529-541.
    10. Shahram Hanifi & Xiaolei Liu & Zi Lin & Saeid Lotfian, 2020. "A Critical Review of Wind Power Forecasting Methods—Past, Present and Future," Energies, MDPI, vol. 13(15), pages 1-24, July.
    11. Kirchner-Bossi, Nicolas & Kathari, Gabriel & Porté-Agel, Fernando, 2024. "A hybrid physics-based and data-driven model for intra-day and day-ahead wind power forecasting considering a drastically expanded predictor search space," Applied Energy, Elsevier, vol. 367(C).
    12. López, Germánico & Arboleya, Pablo, 2022. "Short-term wind speed forecasting over complex terrain using linear regression models and multivariable LSTM and NARX networks in the Andes Mountains, Ecuador," Renewable Energy, Elsevier, vol. 183(C), pages 351-368.
    13. Li, Qingyang & Wang, Guosong & Wu, Xinrong & Gao, Zhigang & Dan, Bo, 2024. "Arctic short-term wind speed forecasting based on CNN-LSTM model with CEEMDAN," Energy, Elsevier, vol. 299(C).
    14. Wang, Yun & Chen, Tuo & Zou, Runmin & Song, Dongran & Zhang, Fan & Zhang, Lingjun, 2022. "Ensemble probabilistic wind power forecasting with multi-scale features," Renewable Energy, Elsevier, vol. 201(P1), pages 734-751.
    15. Upma Singh & Mohammad Rizwan & Muhannad Alaraj & Ibrahim Alsaidan, 2021. "A Machine Learning-Based Gradient Boosting Regression Approach for Wind Power Production Forecasting: A Step towards Smart Grid Environments," Energies, MDPI, vol. 14(16), pages 1-21, August.
    16. de Azevedo Takara, Lucas & Teixeira, Ana Clara & Yazdanpanah, Hamed & Mariani, Viviana Cocco & dos Santos Coelho, Leandro, 2024. "Optimizing multi-step wind power forecasting: Integrating advanced deep neural networks with stacking-based probabilistic learning," Applied Energy, Elsevier, vol. 369(C).
    17. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    18. Meng, Anbo & Chen, Shu & Ou, Zuhong & Xiao, Jianhua & Zhang, Jianfeng & Chen, Shun & Zhang, Zheng & Liang, Ruduo & Zhang, Zhan & Xian, Zikang & Wang, Chenen & Yin, Hao & Yan, Baiping, 2022. "A novel few-shot learning approach for wind power prediction applying secondary evolutionary generative adversarial network," Energy, Elsevier, vol. 261(PA).
    19. Sharifzadeh, Mahdi & Sikinioti-Lock, Alexandra & Shah, Nilay, 2019. "Machine-learning methods for integrated renewable power generation: A comparative study of artificial neural networks, support vector regression, and Gaussian Process Regression," Renewable and Sustainable Energy Reviews, Elsevier, vol. 108(C), pages 513-538.
    20. Wu, Binrong & Wang, Lin & Zeng, Yu-Rong, 2022. "Interpretable wind speed prediction with multivariate time series and temporal fusion transformers," Energy, Elsevier, vol. 252(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:375:y:2024:i:c:s0306261924015125. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.