IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v306y2022ipas0306261921012861.html
   My bibliography  Save this article

Solar and wind power generation forecasts using elastic net in time-varying forecast combinations

Author

Listed:
  • Nikodinoska, Dragana
  • Käso, Mathias
  • Müsgens, Felix

Abstract

Precise renewable energy feed-in forecasts are essential for an effective and efficient integration of renewables into energy systems, and research contributions that help to reduce the uncertainty related to renewables are in high demand. This importance will increase in the future, as renewable energies are the world’s fastest growing electricity generation capacities. Forecast combinations have been empirically proven to outperform individual forecasting models in many disciplines. Our work uses an elastic net method, with cross-validation and rolling window estimation, in the context of renewable energy forecasts. Namely, the forecast combinations are obtained using regional data from Germany for both solar photovoltaic and wind feed-in during the period 2010–2018, with quarter-hourly frequency. The dynamic elastic net estimation, preceded by dynamic data pre-processing, improves forecasting accuracy for both photovoltaic and wind power feed-in forecasts. Moreover, our forecasting framework outperforms benchmarks such as simple average and individual forecasts. Our forecasting framework can be applied widely to estimate renewable power in other countries, systems, or individual power plants.

Suggested Citation

  • Nikodinoska, Dragana & Käso, Mathias & Müsgens, Felix, 2022. "Solar and wind power generation forecasts using elastic net in time-varying forecast combinations," Applied Energy, Elsevier, vol. 306(PA).
  • Handle: RePEc:eee:appene:v:306:y:2022:i:pa:s0306261921012861
    DOI: 10.1016/j.apenergy.2021.117983
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921012861
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.117983?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Inoue, Atsushi & Jin, Lu & Rossi, Barbara, 2017. "Rolling window selection for out-of-sample forecasting with time-varying parameters," Journal of Econometrics, Elsevier, vol. 196(1), pages 55-67.
    2. Jung, Jaesung & Broadwater, Robert P., 2014. "Current status and future advances for wind speed and power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 762-777.
    3. Tascikaraoglu, A. & Uzunoglu, M., 2014. "A review of combined approaches for prediction of short-term wind speed and power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 34(C), pages 243-254.
    4. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    5. Liu, Zhenkun & Jiang, Ping & Zhang, Lifang & Niu, Xinsong, 2020. "A combined forecasting model for time series: Application to short-term wind speed forecasting," Applied Energy, Elsevier, vol. 259(C).
    6. Das, Utpal Kumar & Tey, Kok Soon & Seyedmahmoudian, Mehdi & Mekhilef, Saad & Idris, Moh Yamani Idna & Van Deventer, Willem & Horan, Bend & Stojcevski, Alex, 2018. "Forecasting of photovoltaic power generation and model optimization: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 912-928.
    7. Poncela, Marta & Poncela, Pilar & Perán, José Ramón, 2013. "Automatic tuning of Kalman filters by maximum likelihood methods for wind energy forecasting," Applied Energy, Elsevier, vol. 108(C), pages 349-362.
    8. Ren, Ye & Suganthan, P.N. & Srikanth, N., 2015. "Ensemble methods for wind and solar power forecasting—A state-of-the-art review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 50(C), pages 82-91.
    9. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    10. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    11. Nowotarski, Jakub & Raviv, Eran & Trück, Stefan & Weron, Rafał, 2014. "An empirical comparison of alternative schemes for combining electricity spot price forecasts," Energy Economics, Elsevier, vol. 46(C), pages 395-412.
    12. Mohandes, Mohamed A. & Rehman, Shafiqur & Halawani, Talal O., 1998. "A neural networks approach for wind speed prediction," Renewable Energy, Elsevier, vol. 13(3), pages 345-354.
    13. Yang, Xiuyuan & Xu, Minglu & Xu, Shouchen & Han, Xiaojuan, 2017. "Day-ahead forecasting of photovoltaic output power with similar cloud space fusion based on incomplete historical data mining," Applied Energy, Elsevier, vol. 206(C), pages 683-696.
    14. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, August.
    15. Patrick Jaillet & Ehud I. Ronn & Stathis Tompaidis, 2004. "Valuation of Commodity-Based Swing Options," Management Science, INFORMS, vol. 50(7), pages 909-921, July.
    16. Francis X. Diebold & Minchul Shin, 2017. "Beating the Simple Average: Egalitarian LASSO for Combining Economic Forecasts," PIER Working Paper Archive 17-017, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 20 Aug 2017.
    17. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.
    18. Cassola, Federico & Burlando, Massimiliano, 2012. "Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output," Applied Energy, Elsevier, vol. 99(C), pages 154-166.
    19. Kath, Christopher & Ziel, Florian, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Energy Economics, Elsevier, vol. 76(C), pages 411-423.
    20. Costa, Alexandre & Crespo, Antonio & Navarro, Jorge & Lizcano, Gil & Madsen, Henrik & Feitosa, Everaldo, 2008. "A review on the young history of the wind power short-term prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 12(6), pages 1725-1744, August.
    21. Li, Gong & Shi, Jing, 2010. "On comparing three artificial neural networks for wind speed forecasting," Applied Energy, Elsevier, vol. 87(7), pages 2313-2320, July.
    22. Li, Jiahan & Chen, Weiye, 2014. "Forecasting macroeconomic time series: LASSO-based approaches and their forecast combinations with dynamic factor models," International Journal of Forecasting, Elsevier, vol. 30(4), pages 996-1015.
    23. Rintamäki, Tuomas & Siddiqui, Afzal S. & Salo, Ahti, 2017. "Does renewable energy generation decrease the volatility of electricity prices? An analysis of Denmark and Germany," Energy Economics, Elsevier, vol. 62(C), pages 270-282.
    24. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    25. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    26. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    27. Theocharides, Spyros & Makrides, George & Livera, Andreas & Theristis, Marios & Kaimakis, Paris & Georghiou, George E., 2020. "Day-ahead photovoltaic power production forecasting methodology based on machine learning and statistical post-processing," Applied Energy, Elsevier, vol. 268(C).
    28. Antonio Bracale & Guido Carpinelli & Pasquale De Falco, 2019. "Developing and Comparing Different Strategies for Combining Probabilistic Photovoltaic Power Forecasts in an Ensemble Method," Energies, MDPI, vol. 12(6), pages 1-16, March.
    29. Larson, David P. & Nonnenmacher, Lukas & Coimbra, Carlos F.M., 2016. "Day-ahead forecasting of solar power output from photovoltaic plants in the American Southwest," Renewable Energy, Elsevier, vol. 91(C), pages 11-20.
    30. Marta Poncela-Blanco & Pilar Poncela, 2021. "Improving Wind Power Forecasts: Combination through Multivariate Dimension Reduction Techniques," Energies, MDPI, vol. 14(5), pages 1-16, March.
    31. Gürtler, Marc & Paulsen, Thomas, 2018. "The effect of wind and solar power forecasts on day-ahead and intraday electricity prices in Germany," Energy Economics, Elsevier, vol. 75(C), pages 150-162.
    32. Angelica Gianfreda & Derek Bunn, 2018. "A Stochastic Latent Moment Model for Electricity Price Formation," BEMPS - Bozen Economics & Management Paper Series BEMPS46, Faculty of Economics and Management at the Free University of Bozen.
    33. Fernandez-Jimenez, L. Alfredo & Muñoz-Jimenez, Andrés & Falces, Alberto & Mendoza-Villena, Montserrat & Garcia-Garrido, Eduardo & Lara-Santillan, Pedro M. & Zorzano-Alba, Enrique & Zorzano-Santamaria,, 2012. "Short-term power forecasting system for photovoltaic plants," Renewable Energy, Elsevier, vol. 44(C), pages 311-317.
    34. Foley, Aoife M. & Leahy, Paul G. & Marvuglia, Antonino & McKeogh, Eamon J., 2012. "Current methods and advances in forecasting of wind power generation," Renewable Energy, Elsevier, vol. 37(1), pages 1-8.
    35. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    36. Lingohr, Daniel & Müller, Gernot, 2019. "Stochastic modeling of intraday photovoltaic power generation," Energy Economics, Elsevier, vol. 81(C), pages 175-186.
    37. Massimiliano Marcellino, "undated". "Forecast pooling for short time series of macroeconomic variables," Working Papers 212, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    38. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    39. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Wenting & Guo, Yufeng & Yang, Dazhi & Zhang, Zili & Kleissl, Jan & van der Meer, Dennis & Yang, Guoming & Hong, Tao & Liu, Bai & Huang, Nantian & Mayer, Martin János, 2024. "Economics of physics-based solar forecasting in power system day-ahead scheduling," Renewable and Sustainable Energy Reviews, Elsevier, vol. 199(C).
    2. Yin, He & Yang, Mao-sen & Lan, Hai & Hong, Ying-Yi & Guo, Dong & Jin, Feng, 2024. "A hybrid graph attention network based method for interval prediction of shipboard solar irradiation," Energy, Elsevier, vol. 298(C).
    3. Yin, Linfei & Qiu, Yao, 2022. "Neural network dynamic differential control for long-term price guidance mechanism of flexible energy service providers," Energy, Elsevier, vol. 255(C).
    4. Nguyen, Thi Ngoc & Müsgens, Felix, 2022. "What drives the accuracy of PV output forecasts?," Applied Energy, Elsevier, vol. 323(C).
    5. Jinhua Zhang & Hui Li & Peng Cheng & Jie Yan, 2024. "Interpretable Wind Power Short-Term Power Prediction Model Using Deep Graph Attention Network," Energies, MDPI, vol. 17(2), pages 1-16, January.
    6. Jing, Zhiqiang & Wang, Yimin & Chang, Jianxia & Wang, Xuebin & Zhou, Yong & Li, Liang & Tian, Yuyu, 2024. "Benefit compensation of hydropower-wind-photovoltaic complementary operation in the large clean energy base," Applied Energy, Elsevier, vol. 354(PA).
    7. Ahmed, Faraedoon & Al Kez, Dlzar & McLoone, Seán & Best, Robert James & Cameron, Ché & Foley, Aoife, 2023. "Dynamic grid stability in low carbon power systems with minimum inertia," Renewable Energy, Elsevier, vol. 210(C), pages 486-506.
    8. Li, Yanhui & Sun, Kaixuan & Yao, Qi & Wang, Lin, 2024. "A dual-optimization wind speed forecasting model based on deep learning and improved dung beetle optimization algorithm," Energy, Elsevier, vol. 286(C).
    9. Hu, Miaosen & Zheng, Guoqiang & Su, Zhonge & Kong, Lingrui & Wang, Guodong, 2024. "Short-term wind power prediction based on improved variational modal decomposition, least absolute shrinkage and selection operator, and BiGRU networks," Energy, Elsevier, vol. 303(C).
    10. Sabadus, Andreea & Blaga, Robert & Hategan, Sergiu-Mihai & Calinoiu, Delia & Paulescu, Eugenia & Mares, Oana & Boata, Remus & Stefu, Nicoleta & Paulescu, Marius & Badescu, Viorel, 2024. "A cross-sectional survey of deterministic PV power forecasting: Progress and limitations in current approaches," Renewable Energy, Elsevier, vol. 226(C).
    11. Amir A. Imam & Abdullah Abusorrah & Mustafa M. A. Seedahmed & Mousa Marzband, 2024. "Accurate Forecasting of Global Horizontal Irradiance in Saudi Arabia: A Comparative Study of Machine Learning Predictive Models and Feature Selection Techniques," Mathematics, MDPI, vol. 12(16), pages 1-25, August.
    12. He Yin & Hai Lan & Ying-Yi Hong & Zhuangwei Wang & Peng Cheng & Dan Li & Dong Guo, 2023. "A Comprehensive Review of Shipboard Power Systems with New Energy Sources," Energies, MDPI, vol. 16(5), pages 1-44, February.
    13. Ye, Lin & Li, Yilin & Pei, Ming & Zhao, Yongning & Li, Zhuo & Lu, Peng, 2022. "A novel integrated method for short-term wind power forecasting based on fluctuation clustering and history matching," Applied Energy, Elsevier, vol. 327(C).
    14. Souhir Ben Amor & Thomas Mobius & Felix Musgens, 2024. "Bridging an energy system model with an ensemble deep-learning approach for electricity price forecasting," Papers 2411.04880, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Uniejewski, Bartosz & Maciejowska, Katarzyna, 2023. "LASSO principal component averaging: A fully automated approach for point forecast pooling," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1839-1852.
    2. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    3. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    4. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    5. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    6. Iason Kynigakis & Ekaterini Panopoulou, 2022. "Does model complexity add value to asset allocation? Evidence from machine learning forecasting models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 603-639, April.
    7. Lu, Peng & Ye, Lin & Zhao, Yongning & Dai, Binhua & Pei, Ming & Tang, Yong, 2021. "Review of meta-heuristic algorithms for wind power prediction: Methodologies, applications and challenges," Applied Energy, Elsevier, vol. 301(C).
    8. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.
    9. Li, Jiahan & Chen, Weiye, 2014. "Forecasting macroeconomic time series: LASSO-based approaches and their forecast combinations with dynamic factor models," International Journal of Forecasting, Elsevier, vol. 30(4), pages 996-1015.
    10. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    11. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    12. Panopoulou, Ekaterini & Vrontos, Spyridon, 2015. "Hedge fund return predictability; To combine forecasts or combine information?," Journal of Banking & Finance, Elsevier, vol. 56(C), pages 103-122.
    13. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.
    14. Feijóo, Andrés & Villanueva, Daniel, 2016. "Assessing wind speed simulation methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 56(C), pages 473-483.
    15. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    16. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    17. Bartosz Uniejewski, 2024. "Regularization for electricity price forecasting," Papers 2404.03968, arXiv.org.
    18. Kath, Christopher & Ziel, Florian, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Energy Economics, Elsevier, vol. 76(C), pages 411-423.
    19. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    20. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.

    More about this item

    Keywords

    Forecast combinations; Forecast pooling; Shrinkage; Elastic net; Dynamic forecasts; Data pre-processing;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:306:y:2022:i:pa:s0306261921012861. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.