IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v189y2024ipbs1364032123008353.html
   My bibliography  Save this article

Open-source sky image datasets for solar forecasting with deep learning: A comprehensive survey

Author

Listed:
  • Nie, Yuhao
  • Li, Xiatong
  • Paletta, Quentin
  • Aragon, Max
  • Scott, Andea
  • Brandt, Adam

Abstract

Sky image-based solar forecasting using deep learning has been recognized as a promising approach in reducing the uncertainty of solar power generation. However, a major challenge is the lack of large quantity of sky image data encompassing diverse sky conditions for model training. This study presents a comprehensive survey of open-source sky image datasets for solar forecasting and related research areas, including cloud segmentation, classification and motion prediction which could potentially enhance solar forecasting capabilities. In total, 72 open-source sky image datasets are identified globally that satisfy the needs of deep learning-based method development. A database containing information about various aspects of the identified datasets is constructed. A multi-criteria ranking system is further developed to evaluate each dataset based on eight dimensions which could have important impacts on the data usage. Finally, insights on the applications of these datasets are provided. This study streamlines the processes of identifying and selecting sky image datasets, and could potentially accelerate the method development and benchmark in solar forecasting and related fields including energy meteorology and atmospheric science.

Suggested Citation

  • Nie, Yuhao & Li, Xiatong & Paletta, Quentin & Aragon, Max & Scott, Andea & Brandt, Adam, 2024. "Open-source sky image datasets for solar forecasting with deep learning: A comprehensive survey," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    • Handle: RePEc:eee:rensus:v:189:y:2024:i:pb:s1364032123008353
    DOI: 10.1016/j.rser.2023.113977
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032123008353
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.rser.2023.113977?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ahmed, R. & Sreeram, V. & Mishra, Y. & Arif, M.D., 2020. "A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).
    2. Voyant, Cyril & Notton, Gilles & Kalogirou, Soteris & Nivet, Marie-Laure & Paoli, Christophe & Motte, Fabrice & Fouilloy, Alexis, 2017. "Machine learning methods for solar radiation forecasting: A review," Renewable Energy, Elsevier, vol. 105(C), pages 569-582.
    3. Das, Utpal Kumar & Tey, Kok Soon & Seyedmahmoudian, Mehdi & Mekhilef, Saad & Idris, Moh Yamani Idna & Van Deventer, Willem & Horan, Bend & Stojcevski, Alex, 2018. "Forecasting of photovoltaic power generation and model optimization: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 912-928.
    4. Pedro, Hugo T.C. & Coimbra, Carlos F.M. & David, Mathieu & Lauret, Philippe, 2018. "Assessment of machine learning techniques for deterministic and probabilistic intra-hour solar forecasts," Renewable Energy, Elsevier, vol. 123(C), pages 191-203.
    5. Ajith, Meenu & Martínez-Ramón, Manel, 2021. "Deep learning based solar radiation micro forecast by fusion of infrared cloud images and radiation data," Applied Energy, Elsevier, vol. 294(C).
    6. Anne-Wil Harzing, 2013. "A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1057-1075, March.
    7. Ren, Ye & Suganthan, P.N. & Srikanth, N., 2015. "Ensemble methods for wind and solar power forecasting—A state-of-the-art review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 50(C), pages 82-91.
    8. Sengupta, Manajit & Xie, Yu & Lopez, Anthony & Habte, Aron & Maclaurin, Galen & Shelby, James, 2018. "The National Solar Radiation Data Base (NSRDB)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 89(C), pages 51-60.
    9. Walter Richardson & Hariharan Krishnaswami & Rolando Vega & Michael Cervantes, 2017. "A Low Cost, Edge Computing, All-Sky Imager for Cloud Tracking and Intra-Hour Irradiance Forecasting," Sustainability, MDPI, vol. 9(4), pages 1-17, March.
    10. Chu, Yinghao & Li, Mengying & Pedro, Hugo T.C. & Coimbra, Carlos F.M., 2015. "Real-time prediction intervals for intra-hour DNI forecasts," Renewable Energy, Elsevier, vol. 83(C), pages 234-244.
    11. van der Meer, D.W. & Widén, J. & Munkhammar, J., 2018. "Review on probabilistic forecasting of photovoltaic power production and electricity consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1484-1512.
    12. Feng, Cong & Zhang, Jie & Zhang, Wenqi & Hodge, Bri-Mathias, 2022. "Convolutional neural networks for intra-hour solar forecasting based on sky image sequences," Applied Energy, Elsevier, vol. 310(C).
    13. Caldas, M. & Alonso-Suárez, R., 2019. "Very short-term solar irradiance forecast using all-sky imaging and real-time irradiance measurements," Renewable Energy, Elsevier, vol. 143(C), pages 1643-1658.
    14. Chu, Yinghao & Coimbra, Carlos F.M., 2017. "Short-term probabilistic forecasts for Direct Normal Irradiance," Renewable Energy, Elsevier, vol. 101(C), pages 526-536.
    15. Zhang, Liwenbo & Wilson, Robin & Sumner, Mark & Wu, Yupeng, 2023. "Advanced multimodal fusion method for very short-term solar irradiance forecasting using sky images and meteorological data: A gate and transformer mechanism approach," Renewable Energy, Elsevier, vol. 216(C).
    16. Paletta, Quentin & Hu, Anthony & Arbod, Guillaume & Lasenby, Joan, 2022. "ECLIPSE: Envisioning CLoud Induced Perturbations in Solar Energy," Applied Energy, Elsevier, vol. 326(C).
    17. Barbieri, Florian & Rajakaruna, Sumedha & Ghosh, Arindam, 2017. "Very short-term photovoltaic power forecasting with cloud modeling: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 242-263.
    18. Li, Mengying & Chu, Yinghao & Pedro, Hugo T.C. & Coimbra, Carlos F.M., 2016. "Quantitative evaluation of the impact of cloud transmittance and cloud velocity on the accuracy of short-term DNI forecasts," Renewable Energy, Elsevier, vol. 86(C), pages 1362-1371.
    19. Guilherme Fonseca Bassous & Rodrigo Flora Calili & Carlos Hall Barbosa, 2021. "Development of a Low-Cost Data Acquisition System for Very Short-Term Photovoltaic Power Forecasting," Energies, MDPI, vol. 14(19), pages 1-28, September.
    20. Diagne, Maimouna & David, Mathieu & Lauret, Philippe & Boland, John & Schmutz, Nicolas, 2013. "Review of solar irradiance forecasting methods and a proposition for small-scale insular grids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 65-76.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nie, Yuhao & Paletta, Quentin & Scott, Andea & Pomares, Luis Martin & Arbod, Guillaume & Sgouridis, Sgouris & Lasenby, Joan & Brandt, Adam, 2024. "Sky image-based solar forecasting using deep learning with heterogeneous multi-location data: Dataset fusion versus transfer learning," Applied Energy, Elsevier, vol. 369(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Fan & Zhang, Yao & Wang, Jianxue, 2023. "Recent advances in intra-hour solar forecasting: A review of ground-based sky image methods," International Journal of Forecasting, Elsevier, vol. 39(1), pages 244-265.
    2. Erdener, Burcin Cakir & Feng, Cong & Doubleday, Kate & Florita, Anthony & Hodge, Bri-Mathias, 2022. "A review of behind-the-meter solar forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    3. du Plessis, A.A. & Strauss, J.M. & Rix, A.J., 2021. "Short-term solar power forecasting: Investigating the ability of deep learning models to capture low-level utility-scale Photovoltaic system behaviour," Applied Energy, Elsevier, vol. 285(C).
    4. Benali, L. & Notton, G. & Fouilloy, A. & Voyant, C. & Dizene, R., 2019. "Solar radiation forecasting using artificial neural network and random forest methods: Application to normal beam, horizontal diffuse and global components," Renewable Energy, Elsevier, vol. 132(C), pages 871-884.
    5. Samu, Remember & Calais, Martina & Shafiullah, G.M. & Moghbel, Moayed & Shoeb, Md Asaduzzaman & Nouri, Bijan & Blum, Niklas, 2021. "Applications for solar irradiance nowcasting in the control of microgrids: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 147(C).
    6. van der Meer, D.W. & Widén, J. & Munkhammar, J., 2018. "Review on probabilistic forecasting of photovoltaic power production and electricity consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1484-1512.
    7. Chu, Yinghao & Wang, Yiling & Yang, Dazhi & Chen, Shanlin & Li, Mengying, 2024. "A review of distributed solar forecasting with remote sensing and deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 198(C).
    8. Guilherme Fonseca Bassous & Rodrigo Flora Calili & Carlos Hall Barbosa, 2021. "Development of a Low-Cost Data Acquisition System for Very Short-Term Photovoltaic Power Forecasting," Energies, MDPI, vol. 14(19), pages 1-28, September.
    9. Elena Collino & Dario Ronzio, 2021. "Exploitation of a New Short-Term Multimodel Photovoltaic Power Forecasting Method in the Very Short-Term Horizon to Derive a Multi-Time Scale Forecasting System," Energies, MDPI, vol. 14(3), pages 1-30, February.
    10. Nie, Yuhao & Paletta, Quentin & Scott, Andea & Pomares, Luis Martin & Arbod, Guillaume & Sgouridis, Sgouris & Lasenby, Joan & Brandt, Adam, 2024. "Sky image-based solar forecasting using deep learning with heterogeneous multi-location data: Dataset fusion versus transfer learning," Applied Energy, Elsevier, vol. 369(C).
    11. Pedregal, Diego J. & Trapero, Juan R., 2021. "Adjusted combination of moving averages: A forecasting system for medium-term solar irradiance," Applied Energy, Elsevier, vol. 298(C).
    12. Alonso-Suárez, R. & David, M. & Branco, V. & Lauret, P., 2020. "Intra-day solar probabilistic forecasts including local short-term variability and satellite information," Renewable Energy, Elsevier, vol. 158(C), pages 554-573.
    13. Tang, Yugui & Yang, Kuo & Zhang, Shujing & Zhang, Zhen, 2022. "Photovoltaic power forecasting: A hybrid deep learning model incorporating transfer learning strategy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    14. Zang, Haixiang & Chen, Dianhao & Liu, Jingxuan & Cheng, Lilin & Sun, Guoqiang & Wei, Zhinong, 2024. "Improving ultra-short-term photovoltaic power forecasting using a novel sky-image-based framework considering spatial-temporal feature interaction," Energy, Elsevier, vol. 293(C).
    15. Niu, Yinsen & Song, Jifeng & Zou, Lianglin & Yan, Zixuan & Lin, Xilong, 2024. "Cloud detection method using ground-based sky images based on clear sky library and superpixel local threshold," Renewable Energy, Elsevier, vol. 226(C).
    16. Ahn, Hyeunguk, 2024. "A framework for developing data-driven correction factors for solar PV systems," Energy, Elsevier, vol. 290(C).
    17. Rodríguez, Fermín & Galarza, Ainhoa & Vasquez, Juan C. & Guerrero, Josep M., 2022. "Using deep learning and meteorological parameters to forecast the photovoltaic generators intra-hour output power interval for smart grid control," Energy, Elsevier, vol. 239(PB).
    18. Kim, Jimin & Obregon, Josue & Park, Hoonseok & Jung, Jae-Yoon, 2024. "Multi-step photovoltaic power forecasting using transformer and recurrent neural networks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 200(C).
    19. Llinet Benavides Cesar & Rodrigo Amaro e Silva & Miguel Ángel Manso Callejo & Calimanut-Ionut Cira, 2022. "Review on Spatio-Temporal Solar Forecasting Methods Driven by In Situ Measurements or Their Combination with Satellite and Numerical Weather Prediction (NWP) Estimates," Energies, MDPI, vol. 15(12), pages 1-23, June.
    20. Paletta, Quentin & Hu, Anthony & Arbod, Guillaume & Lasenby, Joan, 2022. "ECLIPSE: Envisioning CLoud Induced Perturbations in Solar Energy," Applied Energy, Elsevier, vol. 326(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:189:y:2024:i:pb:s1364032123008353. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.