IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2406.00326.html
   My bibliography  Save this paper

From day-ahead to mid and long-term horizons with econometric electricity price forecasting models

Author

Listed:
  • Paul Ghelasi
  • Florian Ziel

Abstract

The recent energy crisis starting in 2021 led to record-high gas, coal, carbon and power prices, with electricity reaching up to 40 times the pre-crisis average. This had dramatic consequences for operational and risk management prompting the need for robust econometric models for mid to long-term electricity price forecasting. After a comprehensive literature analysis, we identify key challenges and address them with novel approaches: 1) Fundamental information is incorporated by constraining coefficients with bounds derived from fundamental models offering interpretability; 2) Short-term regressors such as load and renewables can be used in long-term forecasts by incorporating their seasonal expectations to stabilize the model; 3) Unit root behavior of power prices, induced by fuel prices, can be managed by estimating same-day relationships and projecting them forward. We develop interpretable models for a range of forecasting horizons from one day to one year ahead, providing guidelines on robust modeling frameworks and key explanatory variables for each horizon. Our study, focused on Europe's largest energy market, Germany, analyzes hourly electricity prices using regularized regression methods and generalized additive models.

Suggested Citation

  • Paul Ghelasi & Florian Ziel, 2024. "From day-ahead to mid and long-term horizons with econometric electricity price forecasting models," Papers 2406.00326, arXiv.org, revised Aug 2024.
  • Handle: RePEc:arx:papers:2406.00326
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2406.00326
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Smyth, Russell, 2013. "Are fluctuations in energy variables permanent or transitory? A survey of the literature on the integration properties of energy consumption and production," Applied Energy, Elsevier, vol. 104(C), pages 371-378.
    2. Wagner, Andreas & Ramentol, Enislay & Schirra, Florian & Michaeli, Hendrik, 2022. "Short- and long-term forecasting of electricity prices using embedding of calendar information in neural networks," Journal of Commodity Markets, Elsevier, vol. 28(C).
    3. Shahzad Aslam & Nasir Ayub & Umer Farooq & Muhammad Junaid Alvi & Fahad R. Albogamy & Gul Rukh & Syed Irtaza Haider & Ahmad Taher Azar & Rasool Bukhsh, 2021. "Towards Electric Price and Load Forecasting Using CNN-Based Ensembler in Smart Grid," Sustainability, MDPI, vol. 13(22), pages 1-28, November.
    4. Carlo Fezzi and Luca Mosetti, 2020. "Size Matters: Estimation Sample Length and Electricity Price Forecasting Accuracy," The Energy Journal, International Association for Energy Economics, vol. 0(Number 4), pages 231-254.
    5. Ricardo Gonçalves & Flávio Menezes, 2022. "Market‐wide impact of renewables on electricity prices in Australia," The Economic Record, The Economic Society of Australia, vol. 98(320), pages 1-21, March.
    6. Helmut Lütkepohl, 2005. "New Introduction to Multiple Time Series Analysis," Springer Books, Springer, number 978-3-540-27752-1, June.
    7. Sayar Karmakar & Marek Chudý & Wei Biao Wu, 2022. "Long‐term prediction intervals with many covariates," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(4), pages 587-609, July.
    8. Jorge Barrientos Marin & Elkin Tabares Orozco & Esteban Velilla, 2018. "Forecasting electricity price in Colombia: A comparison between Neural Network, ARMA process and Hybrid Models," International Journal of Energy Economics and Policy, Econjournals, vol. 8(3), pages 97-106.
    9. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    10. Florian Ziel & Rick Steinert, 2015. "Electricity Price Forecasting using Sale and Purchase Curves: The X-Model," Papers 1509.00372, arXiv.org, revised Aug 2016.
    11. Eduardo Schwartz & James E. Smith, 2000. "Short-Term Variations and Long-Term Dynamics in Commodity Prices," Management Science, INFORMS, vol. 46(7), pages 893-911, July.
    12. Simon N. Wood, 2003. "Thin plate regression splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(1), pages 95-114, February.
    13. Bartosz Uniejewski & Rafal Weron & Florian Ziel, 2017. "Variance stabilizing transformations for electricity spot price forecasting," HSC Research Reports HSC/17/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    14. Rick Steinert & Florian Ziel, 2019. "Short- to Mid-term Day-Ahead Electricity Price Forecasting Using Futures," The Energy Journal, , vol. 40(1), pages 105-128, January.
    15. Simon N. Wood, 2011. "Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 3-36, January.
    16. Katarzyna Maciejowska & Bartosz Uniejewski & Tomasz Serafin, 2020. "PCA Forecast Averaging—Predicting Day-Ahead and Intraday Electricity Prices," Energies, MDPI, vol. 13(14), pages 1-19, July.
    17. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    18. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    19. Gabrielli, Paolo & Wüthrich, Moritz & Blume, Steffen & Sansavini, Giovanni, 2022. "Data-driven modeling for long-term electricity price forecasting," Energy, Elsevier, vol. 244(PB).
    20. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    21. Black, Fischer & Scholes, Myron S, 1973. "The Pricing of Options and Corporate Liabilities," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 637-654, May-June.
    22. Narajewski, Michał & Ziel, Florian, 2020. "Econometric modelling and forecasting of intraday electricity prices," Journal of Commodity Markets, Elsevier, vol. 19(C).
    23. Jonathan Berrisch & Sven Pappert & Florian Ziel & Antonia Arsova, 2022. "Modeling Volatility and Dependence of European Carbon and Energy Prices," Papers 2208.14311, arXiv.org, revised Feb 2023.
    24. Foroni, Claudia & Ravazzolo, Francesco & Rossini, Luca, 2023. "Are low frequency macroeconomic variables important for high frequency electricity prices?," Economic Modelling, Elsevier, vol. 120(C).
    25. Gabriel Di Bella & Mr. Mark J Flanagan & Karim Foda & Svitlana Maslova & Alex Pienkowski & Martin Stuermer & Mr. Frederik G Toscani, 2022. "Natural Gas in Europe: The Potential Impact of Disruptions to Supply," IMF Working Papers 2022/145, International Monetary Fund.
    26. Billé, Anna Gloria & Gianfreda, Angelica & Del Grosso, Filippo & Ravazzolo, Francesco, 2023. "Forecasting electricity prices with expert, linear, and nonlinear models," International Journal of Forecasting, Elsevier, vol. 39(2), pages 570-586.
    27. Nowotarski, Jakub & Weron, Rafał, 2016. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 57(C), pages 228-235.
    28. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    29. Simon N. Wood, 2004. "Stable and Efficient Multiple Smoothing Parameter Estimation for Generalized Additive Models," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 673-686, January.
    30. Rick Steinert and Florian Ziel, 2019. "Short- to Mid-term Day-Ahead Electricity Price Forecasting Using Futures," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1).
    31. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    32. Lion Hirth, 2018. "What caused the drop in European electricity prices? A factor decomposition analysis," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1).
    33. Philip Beran & Arne Vogler, 2021. "Multi-Day-Ahead Electricity Price Forecasting: A Comparison of fundamental, econometric and hybrid Models," EWL Working Papers 2102, University of Duisburg-Essen, Chair for Management Science and Energy Economics, revised Oct 2021.
    34. Simon N. Wood & Natalya Pya & Benjamin Säfken, 2016. "Smoothing Parameter and Model Selection for General Smooth Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1548-1563, October.
    35. Caldana, Ruggero & Fusai, Gianluca & Roncoroni, Andrea, 2017. "Electricity forward curves with thin granularity: Theory and empirical evidence in the hourly EPEXspot market," European Journal of Operational Research, Elsevier, vol. 261(2), pages 715-734.
    36. Berrisch, Jonathan & Pappert, Sven & Ziel, Florian & Arsova, Antonia, 2023. "Modeling volatility and dependence of European carbon and energy prices," Finance Research Letters, Elsevier, vol. 52(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    2. Micha{l} Narajewski & Florian Ziel, 2021. "Optimal bidding in hourly and quarter-hourly electricity price auctions: trading large volumes of power with market impact and transaction costs," Papers 2104.14204, arXiv.org, revised Feb 2022.
    3. Narajewski, Michał & Ziel, Florian, 2022. "Optimal bidding in hourly and quarter-hourly electricity price auctions: Trading large volumes of power with market impact and transaction costs," Energy Economics, Elsevier, vol. 110(C).
    4. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    5. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    6. Wagner, Andreas & Ramentol, Enislay & Schirra, Florian & Michaeli, Hendrik, 2022. "Short- and long-term forecasting of electricity prices using embedding of calendar information in neural networks," Journal of Commodity Markets, Elsevier, vol. 28(C).
    7. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    8. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    9. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    10. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    11. Michał Narajewski, 2022. "Probabilistic Forecasting of German Electricity Imbalance Prices," Energies, MDPI, vol. 15(14), pages 1-17, July.
    12. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    13. E. Zanini & E. Eastoe & M. J. Jones & D. Randell & P. Jonathan, 2020. "Flexible covariate representations for extremes," Environmetrics, John Wiley & Sons, Ltd., vol. 31(5), August.
    14. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    15. Sergei Kulakov, 2019. "X-model: further development and possible modifications," Papers 1907.09206, arXiv.org.
    16. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    17. Sergei Kulakov, 2020. "X-Model: Further Development and Possible Modifications," Forecasting, MDPI, vol. 2(1), pages 1-16, February.
    18. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    19. Øystein Sørensen & Anders M. Fjell & Kristine B. Walhovd, 2023. "Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models," Psychometrika, Springer;The Psychometric Society, vol. 88(2), pages 456-486, June.
    20. Mira Watermeyer & Thomas Mobius & Oliver Grothe & Felix Musgens, 2023. "A hybrid model for day-ahead electricity price forecasting: Combining fundamental and stochastic modelling," Papers 2304.09336, arXiv.org.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2406.00326. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.