IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i24p6378-d1546867.html
   My bibliography  Save this article

Short-Term Photovoltaic Power Forecasting Using PV Data and Sky Images in an Auto Cross Modal Correlation Attention Multimodal Framework

Author

Listed:
  • Chen Pan

    (Department of Computer Engineering, Chonnam National University, Yeosu 59626, Republic of Korea)

  • Yuqiao Liu

    (Department of Computer Engineering, Chonnam National University, Yeosu 59626, Republic of Korea)

  • Yeonjae Oh

    (Department of Cultural Contents, Chonnam National University, Yeosu 59626, Republic of Korea)

  • Changgyoon Lim

    (Department of Computer Engineering, Chonnam National University, Yeosu 59626, Republic of Korea)

Abstract

The accurate prediction of photovoltaic (PV) power generation is crucial for improving virtual power plant (VPP) efficiency and power system stability. However, short-term PV power forecasting remains highly challenging due to the significant impact of weather changes, especially the complexity of cloud motion. To this end, this paper proposes an end-to-end innovative deep learning framework for data fusion based on multimodal learning, which utilizes a new auto cross modal correlation attention (ACMCA) mechanism designed in this paper for feature extraction and fusion by combining historical PV power generation time-series data and sky image data, thereby enhancing the model’s prediction performance under complex weather conditions. In this paper, the effectiveness of the proposed model was verified through a large number of experiments, and the experimental results showed that the model’s forecast skill (FS) reached 24.2% under all weather conditions 15 min in advance, and 24.32% under cloudy conditions with the largest fluctuations. This paper also compared the model with a variety of existing unimodal and multimodal models, respectively. The experimental results showed that the model in this paper outperformed other benchmark methods in all indices under different weather conditions, demonstrating stronger adaptability and robustness.

Suggested Citation

  • Chen Pan & Yuqiao Liu & Yeonjae Oh & Changgyoon Lim, 2024. "Short-Term Photovoltaic Power Forecasting Using PV Data and Sky Images in an Auto Cross Modal Correlation Attention Multimodal Framework," Energies, MDPI, vol. 17(24), pages 1-30, December.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:24:p:6378-:d:1546867
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/24/6378/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/24/6378/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Niu, Tong & Li, Jinkai & Wei, Wei & Yue, Hui, 2022. "A hybrid deep learning framework integrating feature selection and transfer learning for multi-step global horizontal irradiation forecasting," Applied Energy, Elsevier, vol. 326(C).
    2. Yuanhua Chen & Muhammad Shoaib Bhutta & Muhammad Abubakar & Dingtian Xiao & Fahad M. Almasoudi & Hamad Naeem & Muhammad Faheem, 2023. "Evaluation of Machine Learning Models for Smart Grid Parameters: Performance Analysis of ARIMA and Bi-LSTM," Sustainability, MDPI, vol. 15(11), pages 1-25, May.
    3. Kong, Weicong & Jia, Youwei & Dong, Zhao Yang & Meng, Ke & Chai, Songjian, 2020. "Hybrid approaches based on deep whole-sky-image learning to photovoltaic generation forecasting," Applied Energy, Elsevier, vol. 280(C).
    4. Feng, Cong & Zhang, Jie & Zhang, Wenqi & Hodge, Bri-Mathias, 2022. "Convolutional neural networks for intra-hour solar forecasting based on sky image sequences," Applied Energy, Elsevier, vol. 310(C).
    5. Ren, Simiao & Hu, Wayne & Bradbury, Kyle & Harrison-Atlas, Dylan & Malaguzzi Valeri, Laura & Murray, Brian & Malof, Jordan M., 2022. "Automated Extraction of Energy Systems Information from Remotely Sensed Data: A Review and Analysis," Applied Energy, Elsevier, vol. 326(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Jingxuan & Zang, Haixiang & Cheng, Lilin & Ding, Tao & Wei, Zhinong & Sun, Guoqiang, 2023. "A Transformer-based multimodal-learning framework using sky images for ultra-short-term solar irradiance forecasting," Applied Energy, Elsevier, vol. 342(C).
    2. Paletta, Quentin & Arbod, Guillaume & Lasenby, Joan, 2023. "Omnivision forecasting: Combining satellite and sky images for improved deterministic and probabilistic intra-hour solar energy predictions," Applied Energy, Elsevier, vol. 336(C).
    3. Zang, Haixiang & Chen, Dianhao & Liu, Jingxuan & Cheng, Lilin & Sun, Guoqiang & Wei, Zhinong, 2024. "Improving ultra-short-term photovoltaic power forecasting using a novel sky-image-based framework considering spatial-temporal feature interaction," Energy, Elsevier, vol. 293(C).
    4. Paletta, Quentin & Hu, Anthony & Arbod, Guillaume & Lasenby, Joan, 2022. "ECLIPSE: Envisioning CLoud Induced Perturbations in Solar Energy," Applied Energy, Elsevier, vol. 326(C).
    5. Liu, Jingxuan & Zang, Haixiang & Ding, Tao & Cheng, Lilin & Wei, Zhinong & Sun, Guoqiang, 2023. "Harvesting spatiotemporal correlation from sky image sequence to improve ultra-short-term solar irradiance forecasting," Renewable Energy, Elsevier, vol. 209(C), pages 619-631.
    6. Liao, Zhouyi & Coimbra, Carlos F.M., 2024. "Hybrid solar irradiance nowcasting and forecasting with the SCOPE method and convolutional neural networks," Renewable Energy, Elsevier, vol. 232(C).
    7. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    8. Mahmoud Dhimish & Pavlos I. Lazaridis, 2022. "Approximating Shading Ratio Using the Total-Sky Imaging System: An Application for Photovoltaic Systems," Energies, MDPI, vol. 15(21), pages 1-16, November.
    9. Lilla Barancsuk & Veronika Groma & Dalma Günter & János Osán & Bálint Hartmann, 2024. "Estimation of Solar Irradiance Using a Neural Network Based on the Combination of Sky Camera Images and Meteorological Data," Energies, MDPI, vol. 17(2), pages 1-25, January.
    10. Ajith, Meenu & Martínez-Ramón, Manel, 2021. "Deep learning based solar radiation micro forecast by fusion of infrared cloud images and radiation data," Applied Energy, Elsevier, vol. 294(C).
    11. Lu, Renzhi & Bai, Ruichang & Ding, Yuemin & Wei, Min & Jiang, Junhui & Sun, Mingyang & Xiao, Feng & Zhang, Hai-Tao, 2021. "A hybrid deep learning-based online energy management scheme for industrial microgrid," Applied Energy, Elsevier, vol. 304(C).
    12. Liu, Jingxuan & Zang, Haixiang & Zhang, Fengchun & Cheng, Lilin & Ding, Tao & Wei, Zhinong & Sun, Guoqiang, 2023. "A hybrid meteorological data simulation framework based on time-series generative adversarial network for global daily solar radiation estimation," Renewable Energy, Elsevier, vol. 219(P1).
    13. Fabio Giussani & Eric Wilczynski & Claudio Zandonella Callegher & Giovanni Dalle Nogare & Cristian Pozza & Antonio Novelli & Simon Pezzutto, 2024. "Use of Machine Learning Techniques on Aerial Imagery for the Extraction of Photovoltaic Data within the Urban Morphology," Sustainability, MDPI, vol. 16(5), pages 1-16, February.
    14. Zhou, Guangzhao & Guo, Zanquan & Sun, Simin & Jin, Qingsheng, 2023. "A CNN-BiGRU-AM neural network for AI applications in shale oil production prediction," Applied Energy, Elsevier, vol. 344(C).
    15. Dai, Yeming & Yu, Weijie & Leng, Mingming, 2024. "A hybrid ensemble optimized BiGRU method for short-term photovoltaic generation forecasting," Energy, Elsevier, vol. 299(C).
    16. Wang, Yuqing & Fu, Wenjie & Wang, Junlong & Zhen, Zhao & Wang, Fei, 2024. "Ultra-short-term distributed PV power forecasting for virtual power plant considering data-scarce scenarios," Applied Energy, Elsevier, vol. 373(C).
    17. Yu, Hanxin & Chen, Shanlin & Chu, Yinghao & Li, Mengying & Ding, Yueming & Cui, Rongxi & Zhao, Xin, 2024. "Self-attention mechanism to enhance the generalizability of data-driven time-series prediction: A case study of intra-hour power forecasting of urban distributed photovoltaic systems," Applied Energy, Elsevier, vol. 374(C).
    18. Liu, Guanjun & Qin, Hui & Shen, Qin & Lyv, Hao & Qu, Yuhua & Fu, Jialong & Liu, Yongqi & Zhou, Jianzhong, 2021. "Probabilistic spatiotemporal solar irradiation forecasting using deep ensembles convolutional shared weight long short-term memory network," Applied Energy, Elsevier, vol. 300(C).
    19. Hammond, Joshua E. & Lara Orozco, Ricardo A. & Baldea, Michael & Korgel, Brian A., 2024. "Short-term solar irradiance forecasting under data transmission constraints," Renewable Energy, Elsevier, vol. 233(C).
    20. Qu, Yinpeng & Xu, Jian & Sun, Yuanzhang & Liu, Dan, 2021. "A temporal distributed hybrid deep learning model for day-ahead distributed PV power forecasting," Applied Energy, Elsevier, vol. 304(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:24:p:6378-:d:1546867. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.