IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v168y2022ics1364032122006566.html
   My bibliography  Save this article

Benefits of physical and machine learning hybridization for photovoltaic power forecasting

Author

Listed:
  • Mayer, Martin János

Abstract

Irradiance-to-power conversion is an essential step of state-of-the-art photovoltaic (PV) power forecasting, regardless of the source and post-processing of irradiance forecasts. The two distinct approaches for mapping the irradiance forecasts to PV power are physical and data-driven, which can also be hybridized. The contribution of this paper is twofold; first, it proposes a concept and identifies the best implementation of a hybrid physical and machine learning irradiance-to-power conversion method. Second, a head-to-head comparison of the physical, data-driven, and hybrid methods is performed for the operational day-ahead power forecasting of 14 PV plants in Hungary based on numerical weather prediction (NWP). To respect the rule of consistency but still obtain as complete picture as possible, two directives are set, namely minimizing the mean absolute error (MAE) and minimizing the root mean square error (RMSE), and separate sets of forecasts are optimized for both directives. The results reveal that for two years of training data, the hybrid method that involves the most physically-calculated predictors can reduce the MAE by 5.2% and 10.4% compared, respectively, to the optimized physical model chains and the machine learning without any physical considerations. The two most important physical modeling steps are separation and transposition modeling, and the rest of the physical PV simulation can be left to machine learning in hybrid models without a significant increase in the errors. The optimization of the physical model chains is found to be important even in the case of hybrid modeling; therefore, it should become a standard procedure in practical applications. Finally, the hybrid method is only beneficial for at least one year of training data, while in the initial period of the operation of a PV plant, it is advised to stay with optimized physical modeling. The guidelines and recommendations of this paper can help both researchers and practitioners design and optimize their power conversion model to increase the accuracy of the PV power forecasts.

Suggested Citation

  • Mayer, Martin János, 2022. "Benefits of physical and machine learning hybridization for photovoltaic power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    • Handle: RePEc:eee:rensus:v:168:y:2022:i:c:s1364032122006566
    DOI: 10.1016/j.rser.2022.112772
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032122006566
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.rser.2022.112772?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter Bauer & Alan Thorpe & Gilbert Brunet, 2015. "The quiet revolution of numerical weather prediction," Nature, Nature, vol. 525(7567), pages 47-55, September.
    2. Sun, Xixi & Bright, Jamie M. & Gueymard, Christian A. & Acord, Brendan & Wang, Peng & Engerer, Nicholas A., 2019. "Worldwide performance assessment of 75 global clear-sky irradiance models using Principal Component Analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 111(C), pages 550-570.
    3. Tao Hong & Pierre Pinson & Yi Wang & Rafal Weron & Dazhi Yang & Hamidreza Zareipour, 2020. "Energy forecasting: A review and outlook," WORking papers in Management Science (WORMS) WORMS/20/08, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    4. Martin Hofmann & Gunther Seckmeyer, 2017. "Influence of Various Irradiance Models and Their Combination on Simulation Results of Photovoltaic Systems," Energies, MDPI, vol. 10(10), pages 1-24, September.
    5. Yang, Dazhi & Wang, Wenting & Gueymard, Christian A. & Hong, Tao & Kleissl, Jan & Huang, Jing & Perez, Marc J. & Perez, Richard & Bright, Jamie M. & Xia, Xiang’ao & van der Meer, Dennis & Peters, Ian , 2022. "A review of solar forecasting, its dependence on atmospheric sciences and implications for grid integration: Towards carbon neutrality," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    6. Zhang, Gang & Yang, Dazhi & Galanis, George & Androulakis, Emmanouil, 2022. "Solar forecasting with hourly updated numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 154(C).
    7. Mayer, Martin János & Gróf, Gyula, 2021. "Extensive comparison of physical models for photovoltaic power forecasting," Applied Energy, Elsevier, vol. 283(C).
    8. Wang, Wenting & Yang, Dazhi & Huang, Nantian & Lyu, Chao & Zhang, Gang & Han, Xueying, 2022. "Irradiance-to-power conversion based on physical model chain: An application on the optimal configuration of multi-energy microgrid in cold climate," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    9. Markovics, Dávid & Mayer, Martin János, 2022. "Comparison of machine learning methods for photovoltaic power forecasting based on numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    10. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda, 2019. "A comparison of day-ahead photovoltaic power forecasting models based on deep learning neural network," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    11. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    12. Ogliari, Emanuele & Dolara, Alberto & Manzolini, Giampaolo & Leva, Sonia, 2017. "Physical and hybrid methods comparison for the day ahead PV output power forecast," Renewable Energy, Elsevier, vol. 113(C), pages 11-21.
    13. Ramadhan, Raden A.A. & Heatubun, Yosca R.J. & Tan, Sek F. & Lee, Hyun-Jin, 2021. "Comparison of physical and machine learning models for estimating solar irradiance and photovoltaic power," Renewable Energy, Elsevier, vol. 178(C), pages 1006-1019.
    14. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    15. Theocharides, Spyros & Makrides, George & Livera, Andreas & Theristis, Marios & Kaimakis, Paris & Georghiou, George E., 2020. "Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing," Applied Energy, Elsevier, vol. 268(C).
    16. Yang, Dazhi & Wu, Elynn & Kleissl, Jan, 2019. "Operational solar forecasting for the real-time market," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1499-1519.
    17. Mayer, Martin János, 2022. "Impact of the tilt angle, inverter sizing factor and row spacing on the photovoltaic power forecast accuracy," Applied Energy, Elsevier, vol. 323(C).
    18. Luo, Xing & Zhang, Dongxiao & Zhu, Xu, 2021. "Deep learning based forecasting of photovoltaic power generation by incorporating domain knowledge," Energy, Elsevier, vol. 225(C).
    19. Yang, Dazhi, 2022. "Estimating 1-min beam and diffuse irradiance from the global irradiance: A review and an extensive worldwide comparison of latest separation models at 126 stations," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    20. Visser, Lennard & AlSkaif, Tarek & van Sark, Wilfried, 2022. "Operational day-ahead solar power forecasting for aggregated PV systems with a varying spatial distribution," Renewable Energy, Elsevier, vol. 183(C), pages 267-282.
    21. Abreu, Edgar F.M. & Canhoto, Paulo & Costa, Maria João, 2019. "Prediction of diffuse horizontal irradiance using a new climate zone model," Renewable and Sustainable Energy Reviews, Elsevier, vol. 110(C), pages 28-42.
    22. Leva, S. & Dolara, A. & Grimaccia, F. & Mussetta, M. & Ogliari, E., 2017. "Analysis and validation of 24 hours ahead neural network forecasting of photovoltaic output power," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 131(C), pages 88-100.
    23. Starke, Allan R. & Lemos, Leonardo F.L. & Boland, John & Cardemil, José M. & Colle, Sergio, 2018. "Resolution of the cloud enhancement problem for one-minute diffuse radiation prediction," Renewable Energy, Elsevier, vol. 125(C), pages 472-484.
    24. Mattei, M. & Notton, G. & Cristofari, C. & Muselli, M. & Poggi, P., 2006. "Calculation of the polycrystalline PV module temperature using a simple method of energy balance," Renewable Energy, Elsevier, vol. 31(4), pages 553-567.
    25. Schinke-Nendza, A. & von Loeper, F. & Osinski, P. & Schaumann, P. & Schmidt, V. & Weber, C., 2021. "Probabilistic forecasting of photovoltaic power supply — A hybrid approach using D-vine copulas to model spatial dependencies," Applied Energy, Elsevier, vol. 304(C).
    26. Alessandro Niccolai & Alberto Dolara & Emanuele Ogliari, 2021. "Hybrid PV Power Forecasting Methods: A Comparison of Different Approaches," Energies, MDPI, vol. 14(2), pages 1-18, January.
    27. Ridley, Barbara & Boland, John & Lauret, Philippe, 2010. "Modelling of diffuse solar fraction with multiple predictors," Renewable Energy, Elsevier, vol. 35(2), pages 478-483.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Wenting & Guo, Yufeng & Yang, Dazhi & Zhang, Zili & Kleissl, Jan & van der Meer, Dennis & Yang, Guoming & Hong, Tao & Liu, Bai & Huang, Nantian & Mayer, Martin János, 2024. "Economics of physics-based solar forecasting in power system day-ahead scheduling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 199(C).
    2. Cao, Yisheng & Liu, Gang & Luo, Donghua & Bavirisetti, Durga Prasad & Xiao, Gang, 2023. "Multi-timescale photovoltaic power forecasting using an improved Stacking ensemble algorithm based LSTM-Informer model," Energy, Elsevier, vol. 283(C).
    3. Honglin Xue & Junwei Ma & Jianliang Zhang & Penghui Jin & Jian Wu & Feng Du, 2024. "Power Forecasting for Photovoltaic Microgrid Based on MultiScale CNN-LSTM Network Models," Energies, MDPI, vol. 17(16), pages 1-13, August.
    4. Adam Krechowicz & Maria Krechowicz & Katarzyna Poczeta, 2022. "Machine Learning Approaches to Predict Electricity Production from Renewable Energy Sources," Energies, MDPI, vol. 15(23), pages 1-41, December.
    5. Mayer, Martin János & Yang, Dazhi & Szintai, Balázs, 2023. "Comparing global and regional downscaled NWP models for irradiance and photovoltaic power forecasting: ECMWF versus AROME," Applied Energy, Elsevier, vol. 352(C).
    6. Ali, Mumtaz & Prasad, Ramendra & Jamei, Mehdi & Malik, Anurag & Xiang, Yong & Abdulla, Shahab & Deo, Ravinesh C. & Farooque, Aitazaz A. & Labban, Abdulhaleem H., 2024. "Short-term wave power forecasting with hybrid multivariate variational mode decomposition model integrated with cascaded feedforward neural networks," Renewable Energy, Elsevier, vol. 221(C).
    7. Nunes Maciel, Joylan & Javier Gimenez Ledesma, Jorge & Hideo Ando Junior, Oswaldo, 2024. "Hybrid prediction method of solar irradiance applied to short-term photovoltaic energy generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    8. Amedeo Buonanno & Giampaolo Caputo & Irena Balog & Salvatore Fabozzi & Giovanna Adinolfi & Francesco Pascarella & Gianni Leanza & Giorgio Graditi & Maria Valenti, 2024. "Machine Learning and Weather Model Combination for PV Production Forecasting," Energies, MDPI, vol. 17(9), pages 1-15, May.
    9. Chu, Yinghao & Yang, Dazhi & Yu, Hanxin & Zhao, Xin & Li, Mengying, 2024. "Can end-to-end data-driven models outperform traditional semi-physical models in separating 1-min irradiance?," Applied Energy, Elsevier, vol. 356(C).
    10. Mayer, Martin János & Yang, Dazhi, 2022. "Probabilistic photovoltaic power forecasting using a calibrated ensemble of model chains," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    11. Mayer, Martin János & Biró, Bence & Szücs, Botond & Aszódi, Attila, 2023. "Probabilistic modeling of future electricity systems with high renewable energy penetration using machine learning," Applied Energy, Elsevier, vol. 336(C).
    12. Mayer, Martin János & Yang, Dazhi, 2023. "Pairing ensemble numerical weather prediction with ensemble physical model chain for probabilistic photovoltaic power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 175(C).
    13. Aristeidis Mystakidis & Paraskevas Koukaras & Nikolaos Tsalikidis & Dimosthenis Ioannidis & Christos Tjortjis, 2024. "Energy Forecasting: A Comprehensive Review of Techniques and Technologies," Energies, MDPI, vol. 17(7), pages 1-33, March.
    14. Mauro Tucci & Antonio Piazzi & Dimitri Thomopulos, 2024. "Machine Learning Models for Regional Photovoltaic Power Generation Forecasting with Limited Plant-Specific Data," Energies, MDPI, vol. 17(10), pages 1-21, May.
    15. Jiang, Chengcheng & Zhu, Qunzhi, 2023. "Evaluating the most significant input parameters for forecasting global solar radiation of different sequences based on Informer," Applied Energy, Elsevier, vol. 348(C).
    16. Sarmas, Elissaios & Spiliotis, Evangelos & Stamatopoulos, Efstathios & Marinakis, Vangelis & Doukas, Haris, 2023. "Short-term photovoltaic power forecasting using meta-learning and numerical weather prediction independent Long Short-Term Memory models," Renewable Energy, Elsevier, vol. 216(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mayer, Martin János & Yang, Dazhi, 2022. "Probabilistic photovoltaic power forecasting using a calibrated ensemble of model chains," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    2. Mayer, Martin János & Gróf, Gyula, 2021. "Extensive comparison of physical models for photovoltaic power forecasting," Applied Energy, Elsevier, vol. 283(C).
    3. Mayer, Martin János & Yang, Dazhi, 2023. "Pairing ensemble numerical weather prediction with ensemble physical model chain for probabilistic photovoltaic power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 175(C).
    4. Mayer, Martin János, 2022. "Impact of the tilt angle, inverter sizing factor and row spacing on the photovoltaic power forecast accuracy," Applied Energy, Elsevier, vol. 323(C).
    5. Yang, Dazhi & Wang, Wenting & Gueymard, Christian A. & Hong, Tao & Kleissl, Jan & Huang, Jing & Perez, Marc J. & Perez, Richard & Bright, Jamie M. & Xia, Xiang’ao & van der Meer, Dennis & Peters, Ian , 2022. "A review of solar forecasting, its dependence on atmospheric sciences and implications for grid integration: Towards carbon neutrality," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    6. Sabadus, Andreea & Blaga, Robert & Hategan, Sergiu-Mihai & Calinoiu, Delia & Paulescu, Eugenia & Mares, Oana & Boata, Remus & Stefu, Nicoleta & Paulescu, Marius & Badescu, Viorel, 2024. "A cross-sectional survey of deterministic PV power forecasting: Progress and limitations in current approaches," Renewable Energy, Elsevier, vol. 226(C).
    7. Yang, Dazhi & Kleissl, Jan, 2023. "Summarizing ensemble NWP forecasts for grid operators: Consistency, elicitability, and economic value," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1640-1654.
    8. Yang, Dazhi & Gu, Yizhan & Mayer, Martin János & Gueymard, Christian A. & Wang, Wenting & Kleissl, Jan & Li, Mengying & Chu, Yinghao & Bright, Jamie M., 2024. "Regime-dependent 1-min irradiance separation model with climatology clustering," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    9. Markovics, Dávid & Mayer, Martin János, 2022. "Comparison of machine learning methods for photovoltaic power forecasting based on numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    10. Mayer, Martin János & Yang, Dazhi & Szintai, Balázs, 2023. "Comparing global and regional downscaled NWP models for irradiance and photovoltaic power forecasting: ECMWF versus AROME," Applied Energy, Elsevier, vol. 352(C).
    11. Mayer, Martin János & Yang, Dazhi, 2023. "Calibration of deterministic NWP forecasts and its impact on verification," International Journal of Forecasting, Elsevier, vol. 39(2), pages 981-991.
    12. Sarmas, Elissaios & Spiliotis, Evangelos & Stamatopoulos, Efstathios & Marinakis, Vangelis & Doukas, Haris, 2023. "Short-term photovoltaic power forecasting using meta-learning and numerical weather prediction independent Long Short-Term Memory models," Renewable Energy, Elsevier, vol. 216(C).
    13. Wang, Wenting & Guo, Yufeng & Yang, Dazhi & Zhang, Zili & Kleissl, Jan & van der Meer, Dennis & Yang, Guoming & Hong, Tao & Liu, Bai & Huang, Nantian & Mayer, Martin János, 2024. "Economics of physics-based solar forecasting in power system day-ahead scheduling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 199(C).
    14. Manni, Mattia & Jouttijärvi, Sami & Ranta, Samuli & Miettunen, Kati & Lobaccaro, Gabriele, 2024. "Validation of model chains for global tilted irradiance on East-West vertical bifacial photovoltaics at high latitudes," Renewable Energy, Elsevier, vol. 220(C).
    15. Yang, Dazhi, 2022. "Estimating 1-min beam and diffuse irradiance from the global irradiance: A review and an extensive worldwide comparison of latest separation models at 126 stations," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    16. Yang, Dazhi & Yang, Guoming & Liu, Bai, 2023. "Combining quantiles of calibrated solar forecasts from ensemble numerical weather prediction," Renewable Energy, Elsevier, vol. 215(C).
    17. Zhang, Gang & Yang, Dazhi & Galanis, George & Androulakis, Emmanouil, 2022. "Solar forecasting with hourly updated numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 154(C).
    18. Gandhi, Oktoviano & Zhang, Wenjie & Kumar, Dhivya Sampath & Rodríguez-Gallegos, Carlos D. & Yagli, Gokhan Mert & Yang, Dazhi & Reindl, Thomas & Srinivasan, Dipti, 2024. "The value of solar forecasts and the cost of their errors: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    19. Liu, Bai & Yang, Dazhi & Mayer, Martin János & Coimbra, Carlos F.M. & Kleissl, Jan & Kay, Merlinde & Wang, Wenting & Bright, Jamie M. & Xia, Xiang’ao & Lv, Xin & Srinivasan, Dipti & Wu, Yan & Beyer, H, 2023. "Predictability and forecast skill of solar irradiance over the contiguous United States," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    20. Visser, L.R. & AlSkaif, T.A. & Khurram, A. & Kleissl, J. & van Sark, W.G.H.J.M., 2024. "Probabilistic solar power forecasting: An economic and technical evaluation of an optimal market bidding strategy," Applied Energy, Elsevier, vol. 370(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:168:y:2022:i:c:s1364032122006566. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.