IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v367y2024ics030626192400624x.html
   My bibliography  Save this article

Multivariate scenario generation of day-ahead electricity prices using normalizing flows

Author

Listed:
  • Hilger, Hannes
  • Witthaut, Dirk
  • Dahmen, Manuel
  • Rydin Gorjão, Leonardo
  • Trebbien, Julius
  • Cramer, Eike

Abstract

Trading on the day-ahead electricity markets requires accurate information about the realization of electricity prices and the uncertainty attached to the predictions. Deriving accurate forecasting models presents a difficult task due to the day-ahead price’s non-stationarity resulting from changing market conditions, e.g., due to changes resulting from the energy crisis in 2021. We present a probabilistic forecasting approach for day-ahead electricity prices using the fully data-driven deep generative model called normalizing flow. Our modeling approach generates full-day scenarios of day-ahead electricity prices based on conditional features such as residual load forecasts. Furthermore, we propose extended feature sets of prior realizations and a periodic retraining scheme that allows the normalizing flow to adapt to the changing conditions of modern electricity markets. Our results highlight that the normalizing flow generates high-quality scenarios that reproduce the true price distribution and yield accurate forecasts. Additionally, our analysis highlights how our improvements towards adaptations in changing regimes allow the normalizing flow to adapt to changing market conditions and enable continued sampling of high-quality day-ahead price scenarios.

Suggested Citation

  • Hilger, Hannes & Witthaut, Dirk & Dahmen, Manuel & Rydin Gorjão, Leonardo & Trebbien, Julius & Cramer, Eike, 2024. "Multivariate scenario generation of day-ahead electricity prices using normalizing flows," Applied Energy, Elsevier, vol. 367(C).
    • Handle: RePEc:eee:appene:v:367:y:2024:i:c:s030626192400624x
    DOI: 10.1016/j.apenergy.2024.123241
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626192400624X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.123241?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Huisman, Ronald & Huurman, Christian & Mahieu, Ronald, 2007. "Hourly electricity prices in day-ahead markets," Energy Economics, Elsevier, vol. 29(2), pages 240-248, March.
    2. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    3. Qi, Yuchen & Hu, Wei & Dong, Yu & Fan, Yue & Dong, Ling & Xiao, Ming, 2020. "Optimal configuration of concentrating solar power in multienergy power systems with an improved variational autoencoder," Applied Energy, Elsevier, vol. 274(C).
    4. Nadja Klein & Michael Stanley Smith & David J. Nott, 2023. "Deep distributional time series models and the probabilistic forecasting of intraday electricity prices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 493-511, June.
    5. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    6. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    7. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    8. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    9. Khosravi, Abbas & Nahavandi, Saeid & Creighton, Doug, 2013. "Quantifying uncertainties of neural network-based electricity price forecasts," Applied Energy, Elsevier, vol. 112(C), pages 120-129.
    10. Arkadiusz Jk{e}drzejewski & Jesus Lago & Grzegorz Marcjasz & Rafa{l} Weron, 2022. "Electricity Price Forecasting: The Dawn of Machine Learning," Papers 2204.00883, arXiv.org.
    11. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    12. Staffell, Iain & Pfenninger, Stefan, 2018. "The increasing impact of weather on electricity supply and demand," Energy, Elsevier, vol. 145(C), pages 65-78.
    13. Pinson, P. & Girard, R., 2012. "Evaluating the quality of scenarios of short-term wind power generation," Applied Energy, Elsevier, vol. 96(C), pages 12-20.
    14. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    15. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    16. Cramer, Eike & Witthaut, Dirk & Mitsos, Alexander & Dahmen, Manuel, 2023. "Multivariate probabilistic forecasting of intraday electricity prices using normalizing flows," Applied Energy, Elsevier, vol. 346(C).
    17. Andreas Goldthau & Simone Tagliapietra, 2022. "Energy crisis: five questions that must be answered in 2023," Nature, Nature, vol. 612(7941), pages 627-630, December.
    18. Grothe, Oliver & Kächele, Fabian & Krüger, Fabian, 2023. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 120(C).
    19. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    20. Tschora, Léonard & Pierre, Erwan & Plantevit, Marc & Robardet, Céline, 2022. "Electricity price forecasting on the day-ahead market using machine learning," Applied Energy, Elsevier, vol. 313(C).
    21. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    22. Léonard Tschora & Erwan Pierre & Marc Plantevit & Céline Robardet, 2022. "Electricity price forecasting on the day-ahead market using machine learning," Post-Print hal-03621974, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cramer, Eike & Witthaut, Dirk & Mitsos, Alexander & Dahmen, Manuel, 2023. "Multivariate probabilistic forecasting of intraday electricity prices using normalizing flows," Applied Energy, Elsevier, vol. 346(C).
    2. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    3. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    4. Michał Narajewski, 2022. "Probabilistic Forecasting of German Electricity Imbalance Prices," Energies, MDPI, vol. 15(14), pages 1-17, July.
    5. Serafin, Tomasz & Marcjasz, Grzegorz & Weron, Rafał, 2022. "Trading on short-term path forecasts of intraday electricity prices," Energy Economics, Elsevier, vol. 112(C).
    6. Bartosz Uniejewski, 2023. "Smoothing Quantile Regression Averaging: A new approach to probabilistic forecasting of electricity prices," Papers 2302.00411, arXiv.org, revised Nov 2024.
    7. Weronika Nitka & Rafał Weron, 2023. "Combining predictive distributions of electricity prices. Does minimizing the CRPS lead to optimal decisions in day-ahead bidding?," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 33(3), pages 105-118.
    8. Jozef Barunik & Lubos Hanus, 2023. "Learning Probability Distributions of Day-Ahead Electricity Prices," Papers 2310.02867, arXiv.org, revised Oct 2023.
    9. Micha{l} Narajewski, 2022. "Probabilistic forecasting of German electricity imbalance prices," Papers 2205.11439, arXiv.org.
    10. Micha{l} Narajewski & Florian Ziel, 2021. "Optimal bidding in hourly and quarter-hourly electricity price auctions: trading large volumes of power with market impact and transaction costs," Papers 2104.14204, arXiv.org, revised Feb 2022.
    11. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    12. Grothe, Oliver & Kächele, Fabian & Krüger, Fabian, 2023. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 120(C).
    13. Nie, Ying & Li, Ping & Wang, Jianzhou & Zhang, Lifang, 2024. "A novel multivariate electrical price bi-forecasting system based on deep learning, a multi-input multi-output structure and an operator combination mechanism," Applied Energy, Elsevier, vol. 366(C).
    14. Nametala, Ciniro Aparecido Leite & Faria, Wandry Rodrigues & Lage, Guilherme Guimarães & Pereira, Benvindo Rodrigues, 2023. "Analysis of hourly price granularity implementation in the Brazilian deregulated electricity contracting environment," Utilities Policy, Elsevier, vol. 81(C).
    15. Mira Watermeyer & Thomas Mobius & Oliver Grothe & Felix Musgens, 2023. "A hybrid model for day-ahead electricity price forecasting: Combining fundamental and stochastic modelling," Papers 2304.09336, arXiv.org.
    16. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    17. Lehna, Malte & Scheller, Fabian & Herwartz, Helmut, 2022. "Forecasting day-ahead electricity prices: A comparison of time series and neural network models taking external regressors into account," Energy Economics, Elsevier, vol. 106(C).
    18. Narajewski, Michał & Ziel, Florian, 2022. "Optimal bidding in hourly and quarter-hourly electricity price auctions: Trading large volumes of power with market impact and transaction costs," Energy Economics, Elsevier, vol. 110(C).
    19. Stephen Haben & Julien Caudron & Jake Verma, 2021. "Probabilistic Day-Ahead Wholesale Price Forecast: A Case Study in Great Britain," Forecasting, MDPI, vol. 3(3), pages 1-37, August.
    20. Bartosz Uniejewski, 2024. "Regularization for electricity price forecasting," Papers 2404.03968, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:367:y:2024:i:c:s030626192400624x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.