IDEAS home Printed from https://ideas.repec.org/p/wuu/wpaper/hsc1904.html
   My bibliography  Save this paper

Regularized Quantile Regression Averaging for probabilistic electricity price forecasting

Author

Listed:
  • Bartosz Uniejewski
  • Rafal Weron

Abstract

Quantile Regression Averaging (QRA) has sparked interest in the electricity price forecasting community after its unprecedented success in the Global Energy Forecasting Competition 2014, where the top two winning teams in the price track used variants of QRA. However, recent studies have reported the method's vulnerability to low quality predictors when the set of regressors is larger than just a few. To address this issue, we consider a regularized variant of QRA, which utilizes the Least Absolute Shrinkage and Selection Operator (LASSO) to automatically select the relevant regressors. We evaluate the introduced technique – dubbed LASSO QRA or LQRA for short – using datasets from the Polish and Nordic power markets, a set of 25 point forecasts obtained for calibration windows of different lengths and 20 different values of the regularization parameter. By comparing against nearly 30 benchmarks, we provide evidence for its superior predictive performance in terms of the Kupiec test, the pinball score and the test for conditional predictive accuracy.

Suggested Citation

  • Bartosz Uniejewski & Rafal Weron, 2019. "Regularized Quantile Regression Averaging for probabilistic electricity price forecasting," HSC Research Reports HSC/19/04, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
  • Handle: RePEc:wuu:wpaper:hsc1904
    as

    Download full text from publisher

    File URL: http://www.im.pwr.wroc.pl/~hugo/RePEc/wuu/wpaper/HSC_19_04.pdf
    File Function: Original version, 2019
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Katarzyna Hubicka & Grzegorz Marcjasz & Rafal Weron, 2018. "A note on averaging day-ahead electricity price forecasts across calibration windows," HSC Research Reports HSC/18/03, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    2. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    3. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    4. Micha{l} Narajewski & Florian Ziel, 2018. "Econometric modelling and forecasting of intraday electricity prices," Papers 1812.09081, arXiv.org, revised Sep 2019.
    5. Sebastiano Manzan, 2015. "Forecasting the Distribution of Economic Variables in a Data-Rich Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 144-164, January.
    6. Lars Ivar Hagfors & Hilde Hørthe Kamperud & Florentina Paraschiv & Marcel Prokopczuk & Alma Sator & Sjur Westgaard, 2016. "Prediction of extreme price occurrences in the German day-ahead electricity market," Quantitative Finance, Taylor & Francis Journals, vol. 16(12), pages 1929-1948, December.
    7. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    8. Misiorek Adam & Trueck Stefan & Weron Rafal, 2006. "Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-36, September.
    9. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    10. Derek W. Bunn & Angelica Gianfreda & Stefan Kermer, 2018. "A Trading-Based Evaluation of Density Forecasts in a Real-Time Electricity Market," Energies, MDPI, vol. 11(10), pages 1-13, October.
    11. Grossi, Luigi & Nan, Fany, 2019. "Robust forecasting of electricity prices: Simulations, models and the impact of renewable sources," Technological Forecasting and Social Change, Elsevier, vol. 141(C), pages 305-318.
    12. Grzegorz Marcjasz, 2020. "Forecasting Electricity Prices Using Deep Neural Networks: A Robust Hyper-Parameter Selection Scheme," Energies, MDPI, vol. 13(18), pages 1-18, September.
    13. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    14. Narajewski, Michał & Ziel, Florian, 2020. "Econometric modelling and forecasting of intraday electricity prices," Journal of Commodity Markets, Elsevier, vol. 19(C).
    15. Tim Janke & Florian Steinke, 2019. "Forecasting the Price Distribution of Continuous Intraday Electricity Trading," Energies, MDPI, vol. 12(22), pages 1-14, November.
    16. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    17. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    18. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    19. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    20. Florian Ziel, 2015. "Forecasting Electricity Spot Prices using Lasso: On Capturing the Autoregressive Intraday Structure," Papers 1509.01966, arXiv.org, revised Jan 2016.
    21. Tao Hong & Pierre Pinson & Yi Wang & Rafal Weron & Dazhi Yang & Hamidreza Zareipour, 2020. "Energy forecasting: A review and outlook," WORking papers in Management Science (WORMS) WORMS/20/08, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    22. Afanasyev, Dmitriy O. & Fedorova, Elena A., 2019. "On the impact of outlier filtering on the electricity price forecasting accuracy," Applied Energy, Elsevier, vol. 236(C), pages 196-210.
    23. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    24. Maciejowska, Katarzyna & Nowotarski, Jakub, 2016. "A hybrid model for GEFCom2014 probabilistic electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1051-1056.
    25. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    26. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    27. Antonio Bracale & Guido Carpinelli & Pasquale De Falco, 2019. "Developing and Comparing Different Strategies for Combining Probabilistic Photovoltaic Power Forecasts in an Ensemble Method," Energies, MDPI, vol. 12(6), pages 1-16, March.
    28. Adam Misiorek & Rafal Weron, 2006. "Interval forecasting of spot electricity prices," HSC Research Reports HSC/06/05, Hugo Steinhaus Center, Wroclaw University of Technology.
    29. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    30. Hagfors, Lars Ivar & Bunn, Derek & Kristoffersen, Eline & Staver, Tiril Toftdahl & Westgaard, Sjur, 2016. "Modeling the UK electricity price distributions using quantile regression," Energy, Elsevier, vol. 102(C), pages 231-243.
    31. Lisi, Francesco & Pelagatti, Matteo M., 2018. "Component estimation for electricity market data: Deterministic or stochastic?," Energy Economics, Elsevier, vol. 74(C), pages 13-37.
    32. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    33. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    34. Zhang, Wenjie & Quan, Hao & Srinivasan, Dipti, 2018. "Parallel and reliable probabilistic load forecasting via quantile regression forest and quantile determination," Energy, Elsevier, vol. 160(C), pages 810-819.
    35. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    36. Phathutshedzo Mpfumali & Caston Sigauke & Alphonce Bere & Sophie Mulaudzi, 2019. "Day Ahead Hourly Global Horizontal Irradiance Forecasting—Application to South African Data," Energies, MDPI, vol. 12(18), pages 1-28, September.
    37. Maciejowska, Katarzyna, 2020. "Assessing the impact of renewable energy sources on the electricity price level and variability – A quantile regression approach," Energy Economics, Elsevier, vol. 85(C).
    38. Lebotsa, Moshoko Emily & Sigauke, Caston & Bere, Alphonce & Fildes, Robert & Boylan, John E., 2018. "Short term electricity demand forecasting using partially linear additive quantile regression with an application to the unit commitment problem," Applied Energy, Elsevier, vol. 222(C), pages 104-118.
    39. Maciejowska, Katarzyna & Nowotarski, Jakub & Weron, Rafał, 2016. "Probabilistic forecasting of electricity spot prices using Factor Quantile Regression Averaging," International Journal of Forecasting, Elsevier, vol. 32(3), pages 957-965.
    40. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    41. Jakub Nowotarski & Rafał Weron, 2015. "Computing electricity spot price prediction intervals using quantile regression and forecast averaging," Computational Statistics, Springer, vol. 30(3), pages 791-803, September.
    42. Tomasz Sikorski & Michał Jasiński & Edyta Ropuszyńska-Surma & Magdalena Węglarz & Dominika Kaczorowska & Paweł Kostyła & Zbigniew Leonowicz & Robert Lis & Jacek Rezmer & Wilhelm Rojewski & Marian Sobi, 2019. "A Case Study on Distributed Energy Resources and Energy-Storage Systems in a Virtual Power Plant Concept: Economic Aspects," Energies, MDPI, vol. 12(23), pages 1-21, November.
    43. Bartosz Uniejewski & Rafal Weron & Florian Ziel, 2017. "Variance stabilizing transformations for electricity spot price forecasting," HSC Research Reports HSC/17/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    44. Janczura, Joanna & Trück, Stefan & Weron, Rafał & Wolff, Rodney C., 2013. "Identifying spikes and seasonal components in electricity spot price data: A guide to robust modeling," Energy Economics, Elsevier, vol. 38(C), pages 96-110.
    45. Eun Ryung Lee & Hohsuk Noh & Byeong U. Park, 2014. "Model Selection via Bayesian Information Criterion for Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 216-229, March.
    46. Gaillard, Pierre & Goude, Yannig & Nedellec, Raphaël, 2016. "Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1038-1050.
    47. Kostrzewski, Maciej & Kostrzewska, Jadwiga, 2019. "Probabilistic electricity price forecasting with Bayesian stochastic volatility models," Energy Economics, Elsevier, vol. 80(C), pages 610-620.
    48. Kenneth C. Lichtendahl & Yael Grushka-Cockayne & Robert L. Winkler, 2013. "Is It Better to Average Probabilities or Quantiles?," Management Science, INFORMS, vol. 59(7), pages 1594-1611, July.
    49. Weron, Rafal & Misiorek, Adam, 2006. "Point and interval forecasting of wholesale electricity prices: Evidence from the Nord Pool market," MPRA Paper 1363, University Library of Munich, Germany.
    50. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    2. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    3. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    4. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    5. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    6. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    7. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    8. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    11. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    12. Bartosz Uniejewski, 2023. "Smoothing Quantile Regression Averaging: A new approach to probabilistic forecasting of electricity prices," Papers 2302.00411, arXiv.org, revised Nov 2024.
    13. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    14. Bartosz Uniejewski & Rafał Weron, 2018. "Efficient Forecasting of Electricity Spot Prices with Expert and LASSO Models," Energies, MDPI, vol. 11(8), pages 1-26, August.
    15. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    16. Grzegorz Marcjasz & Bartosz Uniejewski & Rafał Weron, 2020. "Beating the Naïve—Combining LASSO with Naïve Intraday Electricity Price Forecasts," Energies, MDPI, vol. 13(7), pages 1-16, April.
    17. Michał Narajewski, 2022. "Probabilistic Forecasting of German Electricity Imbalance Prices," Energies, MDPI, vol. 15(14), pages 1-17, July.
    18. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    19. Uniejewski, Bartosz & Maciejowska, Katarzyna, 2023. "LASSO principal component averaging: A fully automated approach for point forecast pooling," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1839-1852.
    20. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.

    More about this item

    Keywords

    Electricity price forecasting; Probabilistic forecast; Quantile Regression Averaging; LASSO; Kupiec test; Pinball score; Conditional predictive accuracy;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q41 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Demand and Supply; Prices
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wuu:wpaper:hsc1904. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rafal Weron (email available below). General contact details of provider: https://edirc.repec.org/data/hspwrpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.