IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i24p6378-d1546867.html
   My bibliography  Save this article

Short-Term Photovoltaic Power Forecasting Using PV Data and Sky Images in an Auto Cross Modal Correlation Attention Multimodal Framework

Author

Listed:
  • Chen Pan

    (Department of Computer Engineering, Chonnam National University, Yeosu 59626, Republic of Korea)

  • Yuqiao Liu

    (Department of Computer Engineering, Chonnam National University, Yeosu 59626, Republic of Korea)

  • Yeonjae Oh

    (Department of Cultural Contents, Chonnam National University, Yeosu 59626, Republic of Korea)

  • Changgyoon Lim

    (Department of Computer Engineering, Chonnam National University, Yeosu 59626, Republic of Korea)

Abstract

The accurate prediction of photovoltaic (PV) power generation is crucial for improving virtual power plant (VPP) efficiency and power system stability. However, short-term PV power forecasting remains highly challenging due to the significant impact of weather changes, especially the complexity of cloud motion. To this end, this paper proposes an end-to-end innovative deep learning framework for data fusion based on multimodal learning, which utilizes a new auto cross modal correlation attention (ACMCA) mechanism designed in this paper for feature extraction and fusion by combining historical PV power generation time-series data and sky image data, thereby enhancing the model’s prediction performance under complex weather conditions. In this paper, the effectiveness of the proposed model was verified through a large number of experiments, and the experimental results showed that the model’s forecast skill (FS) reached 24.2% under all weather conditions 15 min in advance, and 24.32% under cloudy conditions with the largest fluctuations. This paper also compared the model with a variety of existing unimodal and multimodal models, respectively. The experimental results showed that the model in this paper outperformed other benchmark methods in all indices under different weather conditions, demonstrating stronger adaptability and robustness.

Suggested Citation

  • Chen Pan & Yuqiao Liu & Yeonjae Oh & Changgyoon Lim, 2024. "Short-Term Photovoltaic Power Forecasting Using PV Data and Sky Images in an Auto Cross Modal Correlation Attention Multimodal Framework," Energies, MDPI, vol. 17(24), pages 1-30, December.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:24:p:6378-:d:1546867
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/24/6378/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/24/6378/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Niu, Tong & Li, Jinkai & Wei, Wei & Yue, Hui, 2022. "A hybrid deep learning framework integrating feature selection and transfer learning for multi-step global horizontal irradiation forecasting," Applied Energy, Elsevier, vol. 326(C).
    2. Yuanhua Chen & Muhammad Shoaib Bhutta & Muhammad Abubakar & Dingtian Xiao & Fahad M. Almasoudi & Hamad Naeem & Muhammad Faheem, 2023. "Evaluation of Machine Learning Models for Smart Grid Parameters: Performance Analysis of ARIMA and Bi-LSTM," Sustainability, MDPI, vol. 15(11), pages 1-25, May.
    3. Kong, Weicong & Jia, Youwei & Dong, Zhao Yang & Meng, Ke & Chai, Songjian, 2020. "Hybrid approaches based on deep whole-sky-image learning to photovoltaic generation forecasting," Applied Energy, Elsevier, vol. 280(C).
    4. Feng, Cong & Zhang, Jie & Zhang, Wenqi & Hodge, Bri-Mathias, 2022. "Convolutional neural networks for intra-hour solar forecasting based on sky image sequences," Applied Energy, Elsevier, vol. 310(C).
    5. Ren, Simiao & Hu, Wayne & Bradbury, Kyle & Harrison-Atlas, Dylan & Malaguzzi Valeri, Laura & Murray, Brian & Malof, Jordan M., 2022. "Automated Extraction of Energy Systems Information from Remotely Sensed Data: A Review and Analysis," Applied Energy, Elsevier, vol. 326(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Jingxuan & Zang, Haixiang & Cheng, Lilin & Ding, Tao & Wei, Zhinong & Sun, Guoqiang, 2023. "A Transformer-based multimodal-learning framework using sky images for ultra-short-term solar irradiance forecasting," Applied Energy, Elsevier, vol. 342(C).
    2. Paletta, Quentin & Arbod, Guillaume & Lasenby, Joan, 2023. "Omnivision forecasting: Combining satellite and sky images for improved deterministic and probabilistic intra-hour solar energy predictions," Applied Energy, Elsevier, vol. 336(C).
    3. Zang, Haixiang & Chen, Dianhao & Liu, Jingxuan & Cheng, Lilin & Sun, Guoqiang & Wei, Zhinong, 2024. "Improving ultra-short-term photovoltaic power forecasting using a novel sky-image-based framework considering spatial-temporal feature interaction," Energy, Elsevier, vol. 293(C).
    4. Paletta, Quentin & Hu, Anthony & Arbod, Guillaume & Lasenby, Joan, 2022. "ECLIPSE: Envisioning CLoud Induced Perturbations in Solar Energy," Applied Energy, Elsevier, vol. 326(C).
    5. Liu, Jingxuan & Zang, Haixiang & Ding, Tao & Cheng, Lilin & Wei, Zhinong & Sun, Guoqiang, 2023. "Harvesting spatiotemporal correlation from sky image sequence to improve ultra-short-term solar irradiance forecasting," Renewable Energy, Elsevier, vol. 209(C), pages 619-631.
    6. Liao, Zhouyi & Coimbra, Carlos F.M., 2024. "Hybrid solar irradiance nowcasting and forecasting with the SCOPE method and convolutional neural networks," Renewable Energy, Elsevier, vol. 232(C).
    7. Nie, Yuhao & Paletta, Quentin & Scott, Andea & Pomares, Luis Martin & Arbod, Guillaume & Sgouridis, Sgouris & Lasenby, Joan & Brandt, Adam, 2024. "Sky image-based solar forecasting using deep learning with heterogeneous multi-location data: Dataset fusion versus transfer learning," Applied Energy, Elsevier, vol. 369(C).
    8. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    9. Mahmoud Dhimish & Pavlos I. Lazaridis, 2022. "Approximating Shading Ratio Using the Total-Sky Imaging System: An Application for Photovoltaic Systems," Energies, MDPI, vol. 15(21), pages 1-16, November.
    10. Namrye Son & Yoonjeong Shin, 2023. "Short- and Medium-Term Electricity Consumption Forecasting Using Prophet and GRU," Sustainability, MDPI, vol. 15(22), pages 1-16, November.
    11. Lilla Barancsuk & Veronika Groma & Dalma Günter & János Osán & Bálint Hartmann, 2024. "Estimation of Solar Irradiance Using a Neural Network Based on the Combination of Sky Camera Images and Meteorological Data," Energies, MDPI, vol. 17(2), pages 1-25, January.
    12. Ajith, Meenu & Martínez-Ramón, Manel, 2021. "Deep learning based solar radiation micro forecast by fusion of infrared cloud images and radiation data," Applied Energy, Elsevier, vol. 294(C).
    13. Stavros-Andreas Logothetis & Vasileios Salamalikis & Bijan Nouri & Jan Remund & Luis F. Zarzalejo & Yu Xie & Stefan Wilbert & Evangelos Ntavelis & Julien Nou & Niels Hendrikx & Lennard Visser & Manaji, 2022. "Solar Irradiance Ramp Forecasting Based on All-Sky Imagers," Energies, MDPI, vol. 15(17), pages 1-17, August.
    14. Hu, Yusha & Man, Yi, 2023. "Energy consumption and carbon emissions forecasting for industrial processes: Status, challenges and perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    15. Lu, Renzhi & Bai, Ruichang & Ding, Yuemin & Wei, Min & Jiang, Junhui & Sun, Mingyang & Xiao, Feng & Zhang, Hai-Tao, 2021. "A hybrid deep learning-based online energy management scheme for industrial microgrid," Applied Energy, Elsevier, vol. 304(C).
    16. Cheng, Lilin & Zang, Haixiang & Wei, Zhinong & Zhang, Fengchun & Sun, Guoqiang, 2022. "Evaluation of opaque deep-learning solar power forecast models towards power-grid applications," Renewable Energy, Elsevier, vol. 198(C), pages 960-972.
    17. Si, Zhiyuan & Yang, Ming & Yu, Yixiao & Ding, Tingting, 2021. "Photovoltaic power forecast based on satellite images considering effects of solar position," Applied Energy, Elsevier, vol. 302(C).
    18. Ahmad, Tanveer & Zhang, Dongdong & Huang, Chao, 2021. "Methodological framework for short-and medium-term energy, solar and wind power forecasting with stochastic-based machine learning approach to monetary and energy policy applications," Energy, Elsevier, vol. 231(C).
    19. Liu, Jingxuan & Zang, Haixiang & Zhang, Fengchun & Cheng, Lilin & Ding, Tao & Wei, Zhinong & Sun, Guoqiang, 2023. "A hybrid meteorological data simulation framework based on time-series generative adversarial network for global daily solar radiation estimation," Renewable Energy, Elsevier, vol. 219(P1).
    20. Despotovic, Milan & Voyant, Cyril & Garcia-Gutierrez, Luis & Almorox, Javier & Notton, Gilles, 2024. "Solar irradiance time series forecasting using auto-regressive and extreme learning methods: Influence of transfer learning and clustering," Applied Energy, Elsevier, vol. 365(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:24:p:6378-:d:1546867. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.