IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v371y2024ics0306261924011280.html
   My bibliography  Save this article

InfoCAVB-MemoryFormer: Forecasting of wind and photovoltaic power through the interaction of data reconstruction and data augmentation

Author

Listed:
  • Zhong, Mingwei
  • Fan, Jingmin
  • Luo, Jianqiang
  • Xiao, Xuanyi
  • He, Guanglin
  • Cai, Rui

Abstract

Rare or missing data pose significant challenges in the prediction of wind power (WP) and photovoltaic power (PV). Many methods address the data scarcity issue solely through augmentation techniques, often neglecting the impact of missing data on the augmentation process. When data augmentation is performed on missing datasets, the prediction accuracy cannot be further improved, and this is called as an extreme data scarcity problem. To solve this problem, we introduce two methods, called Information Maximizing Collaborative Adversarial Variational Bayes (InfoCAVB) and MemoryFormer, to achieve data augmentation based on missing data reconstruction. In this paper, the augmentation and reconstruction process are performed at the same time. When the reconstruction process is performed, InfoCAVB utilizes adversarial training to construct variational bayes that approximates the posterior distribution of real data to recover missing data. Meanwhile, in the augmentation process, InfoCAVB maximizes the mutual information between real data and reconstruction data to establish correspondences between specific dimensions of augmentation data and the features of real and reconstruction data, respectively. The advantage of InfoCAVB lies in incorporating data augmentation into data reconstruction through the information maximizing principle. Finally, we propose a MemoryFormer adapted for InfoCAVB to predict WP and PV, and the benefit of MemoryFormer lies in excavating the potential temporal correlations between reconstructed and augmented data. MemoryFormer embeds the distribution of real data into the generated data through memory units, ensuring consistent distribution during the training process of discrete reconstructed and augmented data. Experimental results indicate that the proposed InfoCAVB-MemoryFormer reduces the RMSE averages by 15.7%, 14.1%, and 5.92% for WP prediction and 28.23%, 22.67%, and 12.21% for PV prediction compared to other state-of-the-art model models, demonstrating the effectiveness of the proposed approach in extreme data scarcity scenarios.

Suggested Citation

  • Zhong, Mingwei & Fan, Jingmin & Luo, Jianqiang & Xiao, Xuanyi & He, Guanglin & Cai, Rui, 2024. "InfoCAVB-MemoryFormer: Forecasting of wind and photovoltaic power through the interaction of data reconstruction and data augmentation," Applied Energy, Elsevier, vol. 371(C).
    • Handle: RePEc:eee:appene:v:371:y:2024:i:c:s0306261924011280
    DOI: 10.1016/j.apenergy.2024.123745
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924011280
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.123745?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cadenas, Erasmo & Rivera, Wilfrido, 2009. "Short term wind speed forecasting in La Venta, Oaxaca, México, using artificial neural networks," Renewable Energy, Elsevier, vol. 34(1), pages 274-278.
    2. Zhong, Mingwei & Xu, Cancheng & Xian, Zikang & He, Guanglin & Zhai, Yanpeng & Zhou, Yongwang & Fan, Jingmin, 2024. "DTTM: A deep temporal transfer model for ultra-short-term online wind power forecasting," Energy, Elsevier, vol. 286(C).
    3. Li, Qing & Zhang, Xinyan & Ma, Tianjiao & Jiao, Chunlei & Wang, Heng & Hu, Wei, 2021. "A multi-step ahead photovoltaic power prediction model based on similar day, enhanced colliding bodies optimization, variational mode decomposition, and deep extreme learning machine," Energy, Elsevier, vol. 224(C).
    4. Mirza, Adeel Feroz & Mansoor, Majad & Usman, Muhammad & Ling, Qiang, 2023. "A comprehensive approach for PV wind forecasting by using a hyperparameter tuned GCVCNN-MRNN deep learning model," Energy, Elsevier, vol. 283(C).
    5. Yang, Mao & Guo, Yunfeng & Huang, Yutong, 2023. "Wind power ultra-short-term prediction method based on NWP wind speed correction and double clustering division of transitional weather process," Energy, Elsevier, vol. 282(C).
    6. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    7. Nunes Maciel, Joylan & Javier Gimenez Ledesma, Jorge & Hideo Ando Junior, Oswaldo, 2024. "Hybrid prediction method of solar irradiance applied to short-term photovoltaic energy generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    8. Fan, Jingmin & Zhong, Mingwei & Guan, Yuanpeng & Yi, Siqi & Xu, Cancheng & Zhai, Yanpeng & Zhou, Yongwang, 2024. "An online long-term load forecasting method: Hierarchical highway network based on crisscross feature collaboration," Energy, Elsevier, vol. 299(C).
    9. Xiong, Hualin & Xu, Beibei & Kheav, Kimleng & Luo, Xingqi & Zhang, Xingjin & Patelli, Edoardo & Guo, Pengcheng & Chen, Diyi, 2021. "Multiscale power fluctuation evaluation of a hydro-wind-photovoltaic system," Renewable Energy, Elsevier, vol. 175(C), pages 153-166.
    10. Al-Yahyai, Sultan & Charabi, Yassine & Gastli, Adel, 2010. "Review of the use of Numerical Weather Prediction (NWP) Models for wind energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(9), pages 3192-3198, December.
    11. Hassan, Muhammed A. & Al-Ghussain, Loiy & Khalil, Adel & Kaseb, Sayed A., 2022. "Self-calibrated hybrid weather forecasters for solar thermal and photovoltaic power plants," Renewable Energy, Elsevier, vol. 188(C), pages 1120-1140.
    12. Dai, Yeming & Wang, Yanxin & Leng, Mingming & Yang, Xinyu & Zhou, Qiong, 2022. "LOWESS smoothing and Random Forest based GRU model: A short-term photovoltaic power generation forecasting method," Energy, Elsevier, vol. 256(C).
    13. Xiong, Jinlin & Peng, Tian & Tao, Zihan & Zhang, Chu & Song, Shihao & Nazir, Muhammad Shahzad, 2023. "A dual-scale deep learning model based on ELM-BiLSTM and improved reptile search algorithm for wind power prediction," Energy, Elsevier, vol. 266(C).
    14. Wang, Huaqing & Tan, Zhongfu & Liang, Yan & Li, Fanqi & Zhang, Zheyu & Ju, Liwei, 2024. "A novel multi-layer stacking ensemble wind power prediction model under Tensorflow deep learning framework considering feature enhancement and data hierarchy processing," Energy, Elsevier, vol. 286(C).
    15. Mayer, Martin János & Yang, Dazhi, 2023. "Pairing ensemble numerical weather prediction with ensemble physical model chain for probabilistic photovoltaic power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 175(C).
    16. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    17. Wu, Siping & Xia, Guilin & Liu, Lang, 2023. "A novel decomposition integration model for power coal price forecasting," Resources Policy, Elsevier, vol. 80(C).
    18. Gao, Mingming & Li, Jianjing & Hong, Feng & Long, Dongteng, 2019. "Day-ahead power forecasting in a large-scale photovoltaic plant based on weather classification using LSTM," Energy, Elsevier, vol. 187(C).
    19. Nourani Esfetang, Naser & Kazemzadeh, Rasool, 2018. "A novel hybrid technique for prediction of electric power generation in wind farms based on WIPSO, neural network and wavelet transform," Energy, Elsevier, vol. 149(C), pages 662-674.
    20. Tawn, R. & Browell, J., 2022. "A review of very short-term wind and solar power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 153(C).
    21. Wu, Huijuan & Meng, Keqilao & Fan, Daoerji & Zhang, Zhanqiang & Liu, Qing, 2022. "Multistep short-term wind speed forecasting using transformer," Energy, Elsevier, vol. 261(PA).
    22. Vega-Bayo, M. & Pérez-Aracil, J. & Prieto-Godino, L. & Salcedo-Sanz, S., 2024. "Improving the prediction of extreme wind speed events with generative data augmentation techniques," Renewable Energy, Elsevier, vol. 221(C).
    23. Zhang, Chu & Ma, Huixin & Hua, Lei & Sun, Wei & Nazir, Muhammad Shahzad & Peng, Tian, 2022. "An evolutionary deep learning model based on TVFEMD, improved sine cosine algorithm, CNN and BiLSTM for wind speed prediction," Energy, Elsevier, vol. 254(PA).
    24. Hdidouan, Daniel & Staffell, Iain, 2017. "The impact of climate change on the levelised cost of wind energy," Renewable Energy, Elsevier, vol. 101(C), pages 575-592.
    25. Zhang, Yagang & Pan, Guifang & Chen, Bing & Han, Jingyi & Zhao, Yuan & Zhang, Chenhong, 2020. "Short-term wind speed prediction model based on GA-ANN improved by VMD," Renewable Energy, Elsevier, vol. 156(C), pages 1373-1388.
    26. Hu, Jianming & Heng, Jiani & Wen, Jiemei & Zhao, Weigang, 2020. "Deterministic and probabilistic wind speed forecasting with de-noising-reconstruction strategy and quantile regression based algorithm," Renewable Energy, Elsevier, vol. 162(C), pages 1208-1226.
    27. Castorrini, Alessio & Gentile, Sabrina & Geraldi, Edoardo & Bonfiglioli, Aldo, 2023. "Investigations on offshore wind turbine inflow modelling using numerical weather prediction coupled with local-scale computational fluid dynamics," Renewable and Sustainable Energy Reviews, Elsevier, vol. 171(C).
    28. Mehrjoo, Mehrdad & Jafari Jozani, Mohammad & Pawlak, Miroslaw, 2020. "Wind turbine power curve modeling for reliable power prediction using monotonic regression," Renewable Energy, Elsevier, vol. 147(P1), pages 214-222.
    29. Han, Shuo & He, Mengjiao & Zhao, Ziwen & Chen, Diyi & Xu, Beibei & Jurasz, Jakub & Liu, Fusheng & Zheng, Hongxi, 2023. "Overcoming the uncertainty and volatility of wind power: Day-ahead scheduling of hydro-wind hybrid power generation system by coordinating power regulation and frequency response flexibility," Applied Energy, Elsevier, vol. 333(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Chu & Li, Zhengbo & Ge, Yida & Liu, Qianlong & Suo, Leiming & Song, Shihao & Peng, Tian, 2024. "Enhancing short-term wind speed prediction based on an outlier-robust ensemble deep random vector functional link network with AOA-optimized VMD," Energy, Elsevier, vol. 296(C).
    2. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    3. Li, Qingyang & Wang, Guosong & Wu, Xinrong & Gao, Zhigang & Dan, Bo, 2024. "Arctic short-term wind speed forecasting based on CNN-LSTM model with CEEMDAN," Energy, Elsevier, vol. 299(C).
    4. Fan, Jingmin & Zhong, Mingwei & Guan, Yuanpeng & Yi, Siqi & Xu, Cancheng & Zhai, Yanpeng & Zhou, Yongwang, 2024. "An online long-term load forecasting method: Hierarchical highway network based on crisscross feature collaboration," Energy, Elsevier, vol. 299(C).
    5. Li, Yanhui & Sun, Kaixuan & Yao, Qi & Wang, Lin, 2024. "A dual-optimization wind speed forecasting model based on deep learning and improved dung beetle optimization algorithm," Energy, Elsevier, vol. 286(C).
    6. Liu, Lei & Wang, Xinyu & Dong, Xue & Chen, Kang & Chen, Qiuju & Li, Bin, 2024. "Interpretable feature-temporal transformer for short-term wind power forecasting with multivariate time series," Applied Energy, Elsevier, vol. 374(C).
    7. Wang, Shuangxin & Shi, Jiarong & Yang, Wei & Yin, Qingyan, 2024. "High and low frequency wind power prediction based on Transformer and BiGRU-Attention," Energy, Elsevier, vol. 288(C).
    8. Heo, SungKu & Byun, Jaewon & Ifaei, Pouya & Ko, Jaerak & Ha, Byeongmin & Hwangbo, Soonho & Yoo, ChangKyoo, 2024. "Towards mega-scale decarbonized industrial park (Mega-DIP): Generative AI-driven techno-economic and environmental assessment of renewable and sustainable energy utilization in petrochemical industry," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    9. Liu, Xingdou & Zhang, Li & Wang, Jiangong & Zhou, Yue & Gan, Wei, 2023. "A unified multi-step wind speed forecasting framework based on numerical weather prediction grids and wind farm monitoring data," Renewable Energy, Elsevier, vol. 211(C), pages 948-963.
    10. Meng, Anbo & Zhang, Haitao & Yin, Hao & Xian, Zikang & Chen, Shu & Zhu, Zibin & Zhang, Zheng & Rong, Jiayu & Li, Chen & Wang, Chenen & Wu, Zhenbo & Deng, Weisi & Luo, Jianqiang & Wang, Xiaolin, 2023. "A novel multi-gradient evolutionary deep learning approach for few-shot wind power prediction using time-series GAN," Energy, Elsevier, vol. 283(C).
    11. Li, Ke & Shen, Ruifang & Wang, Zhenguo & Yan, Bowen & Yang, Qingshan & Zhou, Xuhong, 2023. "An efficient wind speed prediction method based on a deep neural network without future information leakage," Energy, Elsevier, vol. 267(C).
    12. Lv, Sheng-Xiang & Wang, Lin, 2023. "Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model," Energy, Elsevier, vol. 263(PE).
    13. Qu, Zhijian & Hou, Xinxing & Li, Jian & Hu, Wenbo, 2024. "Short-term wind farm cluster power prediction based on dual feature extraction and quadratic decomposition aggregation," Energy, Elsevier, vol. 290(C).
    14. Wang, Yun & Chen, Tuo & Zou, Runmin & Song, Dongran & Zhang, Fan & Zhang, Lingjun, 2022. "Ensemble probabilistic wind power forecasting with multi-scale features," Renewable Energy, Elsevier, vol. 201(P1), pages 734-751.
    15. Liu, Wenhui & Bai, Yulong & Yue, Xiaoxin & Wang, Rui & Song, Qi, 2024. "A wind speed forcasting model based on rime optimization based VMD and multi-headed self-attention-LSTM," Energy, Elsevier, vol. 294(C).
    16. Chen, Zhengganzhe & Zhang, Bin & Du, Chenglong & Meng, Wei & Meng, Anbo, 2024. "A novel dynamic spatio-temporal graph convolutional network for wind speed interval prediction," Energy, Elsevier, vol. 294(C).
    17. Wang, Min & Rao, Congjun & Xiao, Xinping & Hu, Zhuo & Goh, Mark, 2024. "Efficient shrinkage temporal convolutional network model for photovoltaic power prediction," Energy, Elsevier, vol. 297(C).
    18. Zhang, Yagang & Zhao, Yunpeng & Shen, Xiaoyu & Zhang, Jinghui, 2022. "A comprehensive wind speed prediction system based on Monte Carlo and artificial intelligence algorithms," Applied Energy, Elsevier, vol. 305(C).
    19. Huang, Congzhi & Yang, Mengyuan, 2023. "Memory long and short term time series network for ultra-short-term photovoltaic power forecasting," Energy, Elsevier, vol. 279(C).
    20. Simian Pang & Zixuan Zheng & Fan Luo & Xianyong Xiao & Lanlan Xu, 2021. "Hybrid Forecasting Methodology for Wind Power-Photovoltaic-Concentrating Solar Power Generation Clustered Renewable Energy Systems," Sustainability, MDPI, vol. 13(12), pages 1-16, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:371:y:2024:i:c:s0306261924011280. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.