IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v155y2022ics1364032121011734.html
   My bibliography  Save this article

Ensemble solar forecasting and post-processing using dropout neural network and information from neighboring satellite pixels

Author

Listed:
  • Yagli, Gokhan Mert
  • Yang, Dazhi
  • Srinivasan, Dipti

Abstract

Ensemble weather forecasts are often found to be under-dispersed and biased. Post-processing using spatio-temporal information is, therefore, required if one wishes to improve the quality of the raw forecasts. It is on this account that the present article generates and post-processes ensemble solar forecasts using satellite-derived irradiance not only from the focal pixel but also from the neighboring pixels. The ensemble forecasting model of choice is a dropout neural network with Monte Carlo sampling, eliminating the need for training multiple models and ensuring parameter diversity in ensemble forecasting. Subsequently, ensemble forecasts are post-processed using both parametric and nonparametric post-processing techniques, such as nonhomogenous regression, generalized additive model, linear quantile regression, or quantile random forests. The proposed forecasting framework is demonstrated and verified using four years of half-hourly data, at seven locations in the United States. Continuous ranked probability skill scores as high as 66% have been obtained when comparing the proposed method to a conditional climatology reference. The content of this article may be useful to a wide range of stakeholders in the power system, including but not limited to: independent system operators, who aim at efficiently maintaining the system’s reliability; utility- and distributed-scale PV plant owners, who wish to avoid penalties for power deviation between the scheduled and real-time delivery; and forecast retailers, who can benefit from selling solar forecasts of higher quality.

Suggested Citation

  • Yagli, Gokhan Mert & Yang, Dazhi & Srinivasan, Dipti, 2022. "Ensemble solar forecasting and post-processing using dropout neural network and information from neighboring satellite pixels," Renewable and Sustainable Energy Reviews, Elsevier, vol. 155(C).
  • Handle: RePEc:eee:rensus:v:155:y:2022:i:c:s1364032121011734
    DOI: 10.1016/j.rser.2021.111909
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032121011734
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.rser.2021.111909?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sun, Xixi & Bright, Jamie M. & Gueymard, Christian A. & Bai, Xinyu & Acord, Brendan & Wang, Peng, 2021. "Worldwide performance assessment of 95 direct and diffuse clear-sky irradiance models using principal component analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    2. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    3. Yagli, Gokhan Mert & Yang, Dazhi & Gandhi, Oktoviano & Srinivasan, Dipti, 2020. "Can we justify producing univariate machine-learning forecasts with satellite-derived solar irradiance?," Applied Energy, Elsevier, vol. 259(C).
    4. Yang, Dazhi, 2018. "A correct validation of the National Solar Radiation Data Base (NSRDB)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 97(C), pages 152-155.
    5. Sun, Xixi & Bright, Jamie M. & Gueymard, Christian A. & Acord, Brendan & Wang, Peng & Engerer, Nicholas A., 2019. "Worldwide performance assessment of 75 global clear-sky irradiance models using Principal Component Analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 111(C), pages 550-570.
    6. Sebastian Lerch & Sándor Baran, 2017. "Similarity-based semilocal estimation of post-processing models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(1), pages 29-51, January.
    7. Yang, Dazhi & Gu, Chaojun & Dong, Zibo & Jirutitijaroen, Panida & Chen, Nan & Walsh, Wilfred M., 2013. "Solar irradiance forecasting using spatial-temporal covariance structures and time-forward kriging," Renewable Energy, Elsevier, vol. 60(C), pages 235-245.
    8. van der Meer, D.W. & Widén, J. & Munkhammar, J., 2018. "Review on probabilistic forecasting of photovoltaic power production and electricity consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1484-1512.
    9. Yagli, Gokhan Mert & Yang, Dazhi & Srinivasan, Dipti, 2019. "Automatic hourly solar forecasting using machine learning models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 105(C), pages 487-498.
    10. Ren, Ye & Suganthan, P.N. & Srikanth, N., 2015. "Ensemble methods for wind and solar power forecasting—A state-of-the-art review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 50(C), pages 82-91.
    11. Sengupta, Manajit & Xie, Yu & Lopez, Anthony & Habte, Aron & Maclaurin, Galen & Shelby, James, 2018. "The National Solar Radiation Data Base (NSRDB)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 89(C), pages 51-60.
    12. Tao Hong & Pierre Pinson & Yi Wang & Rafal Weron & Dazhi Yang & Hamidreza Zareipour, 2020. "Energy forecasting: A review and outlook," WORking papers in Management Science (WORMS) WORMS/20/08, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    13. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Dazhi & Yang, Guoming & Liu, Bai, 2023. "Combining quantiles of calibrated solar forecasts from ensemble numerical weather prediction," Renewable Energy, Elsevier, vol. 215(C).
    2. Ifaei, Pouya & Nazari-Heris, Morteza & Tayerani Charmchi, Amir Saman & Asadi, Somayeh & Yoo, ChangKyoo, 2023. "Sustainable energies and machine learning: An organized review of recent applications and challenges," Energy, Elsevier, vol. 266(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    2. Yang, Dazhi & Wang, Wenting & Gueymard, Christian A. & Hong, Tao & Kleissl, Jan & Huang, Jing & Perez, Marc J. & Perez, Richard & Bright, Jamie M. & Xia, Xiang’ao & van der Meer, Dennis & Peters, Ian , 2022. "A review of solar forecasting, its dependence on atmospheric sciences and implications for grid integration: Towards carbon neutrality," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    3. Zhang, Gang & Yang, Dazhi & Galanis, George & Androulakis, Emmanouil, 2022. "Solar forecasting with hourly updated numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 154(C).
    4. Yang, Dazhi & Kleissl, Jan, 2023. "Summarizing ensemble NWP forecasts for grid operators: Consistency, elicitability, and economic value," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1640-1654.
    5. Yang, Dazhi, 2022. "Estimating 1-min beam and diffuse irradiance from the global irradiance: A review and an extensive worldwide comparison of latest separation models at 126 stations," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    6. Yang, Dazhi & Yang, Guoming & Liu, Bai, 2023. "Combining quantiles of calibrated solar forecasts from ensemble numerical weather prediction," Renewable Energy, Elsevier, vol. 215(C).
    7. Erdener, Burcin Cakir & Feng, Cong & Doubleday, Kate & Florita, Anthony & Hodge, Bri-Mathias, 2022. "A review of behind-the-meter solar forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    8. Ruiz-Arias, José A., 2023. "SPARTA: Solar parameterization for the radiative transfer of the cloudless atmosphere," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    9. Quan, Hao & Yang, Dazhi, 2020. "Probabilistic solar irradiance transposition models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 125(C).
    10. Markovics, Dávid & Mayer, Martin János, 2022. "Comparison of machine learning methods for photovoltaic power forecasting based on numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    11. Mayer, Martin János, 2022. "Benefits of physical and machine learning hybridization for photovoltaic power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    12. Chen, Shanlin & Liang, Zhaojian & Dong, Peixin & Guo, Su & Li, Mengying, 2023. "A transferable turbidity estimation method for estimating clear-sky solar irradiance," Renewable Energy, Elsevier, vol. 206(C), pages 635-644.
    13. Nie, Yuhao & Li, Xiatong & Paletta, Quentin & Aragon, Max & Scott, Andea & Brandt, Adam, 2024. "Open-source sky image datasets for solar forecasting with deep learning: A comprehensive survey," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    14. Gandhi, Oktoviano & Zhang, Wenjie & Kumar, Dhivya Sampath & Rodríguez-Gallegos, Carlos D. & Yagli, Gokhan Mert & Yang, Dazhi & Reindl, Thomas & Srinivasan, Dipti, 2024. "The value of solar forecasts and the cost of their errors: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    15. Voyant, Cyril & Notton, Gilles & Duchaud, Jean-Laurent & Gutiérrez, Luis Antonio García & Bright, Jamie M. & Yang, Dazhi, 2022. "Benchmarks for solar radiation time series forecasting," Renewable Energy, Elsevier, vol. 191(C), pages 747-762.
    16. Liu, Bai & Yang, Dazhi & Mayer, Martin János & Coimbra, Carlos F.M. & Kleissl, Jan & Kay, Merlinde & Wang, Wenting & Bright, Jamie M. & Xia, Xiang’ao & Lv, Xin & Srinivasan, Dipti & Wu, Yan & Beyer, H, 2023. "Predictability and forecast skill of solar irradiance over the contiguous United States," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    17. Yagli, Gokhan Mert & Yang, Dazhi & Gandhi, Oktoviano & Srinivasan, Dipti, 2020. "Can we justify producing univariate machine-learning forecasts with satellite-derived solar irradiance?," Applied Energy, Elsevier, vol. 259(C).
    18. Yang, Dazhi, 2022. "Correlogram, predictability error growth, and bounds of mean square error of solar irradiance forecasts," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    19. Yang, Dazhi & Wu, Elynn & Kleissl, Jan, 2019. "Operational solar forecasting for the real-time market," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1499-1519.
    20. Llinet Benavides Cesar & Rodrigo Amaro e Silva & Miguel Ángel Manso Callejo & Calimanut-Ionut Cira, 2022. "Review on Spatio-Temporal Solar Forecasting Methods Driven by In Situ Measurements or Their Combination with Satellite and Numerical Weather Prediction (NWP) Estimates," Energies, MDPI, vol. 15(12), pages 1-23, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:155:y:2022:i:c:s1364032121011734. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.