IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2405.17070.html
   My bibliography  Save this paper

Efficient mid-term forecasting of hourly electricity load using generalized additive models

Author

Listed:
  • Monika Zimmermann
  • Florian Ziel

Abstract

Accurate mid-term (weeks to one year) hourly electricity load forecasts are essential for strategic decision-making in power plant operation, ensuring supply security and grid stability, and energy trading. While numerous models effectively predict short-term (hours to a few days) hourly load, mid-term forecasting solutions remain scarce. In mid-term load forecasting, besides daily, weekly, and annual seasonal and autoregressive effects, capturing weather and holiday effects, as well as socio-economic non-stationarities in the data, poses significant modeling challenges. To address these challenges, we propose a novel forecasting method using Generalized Additive Models (GAMs) built from interpretable P-splines and enhanced with autoregressive post-processing. This model uses smoothed temperatures, Error-Trend-Seasonal (ETS) modeled non-stationary states, a nuanced representation of holiday effects with weekday variations, and seasonal information as input. The proposed model is evaluated on load data from 24 European countries. This analysis demonstrates that the model not only has significantly enhanced forecasting accuracy compared to state-of-the-art methods but also offers valuable insights into the influence of individual components on predicted load, given its full interpretability. Achieving performance akin to day-ahead TSO forecasts in fast computation times of a few seconds for several years of hourly data underscores the model's potential for practical application in the power system industry.

Suggested Citation

  • Monika Zimmermann & Florian Ziel, 2024. "Efficient mid-term forecasting of hourly electricity load using generalized additive models," Papers 2405.17070, arXiv.org.
  • Handle: RePEc:arx:papers:2405.17070
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2405.17070
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Smyth, Russell, 2013. "Are fluctuations in energy variables permanent or transitory? A survey of the literature on the integration properties of energy consumption and production," Applied Energy, Elsevier, vol. 104(C), pages 371-378.
    2. Bessec, Marie & Fouquau, Julien, 2008. "The non-linear link between electricity consumption and temperature in Europe: A threshold panel approach," Energy Economics, Elsevier, vol. 30(5), pages 2705-2721, September.
    3. Salah Bouktif & Ali Fiaz & Ali Ouni & Mohamed Adel Serhani, 2018. "Optimal Deep Learning LSTM Model for Electric Load Forecasting using Feature Selection and Genetic Algorithm: Comparison with Machine Learning Approaches †," Energies, MDPI, vol. 11(7), pages 1-20, June.
    4. Nedellec, Raphael & Cugliari, Jairo & Goude, Yannig, 2014. "GEFCom2012: Electric load forecasting and backcasting with semi-parametric models," International Journal of Forecasting, Elsevier, vol. 30(2), pages 375-381.
    5. Perron, Pierre, 1997. "Further evidence on breaking trend functions in macroeconomic variables," Journal of Econometrics, Elsevier, vol. 80(2), pages 355-385, October.
    6. Gil-Alana, L. A. & Robinson, P. M., 1997. "Testing of unit root and other nonstationary hypotheses in macroeconomic time series," Journal of Econometrics, Elsevier, vol. 80(2), pages 241-268, October.
    7. Simon N. Wood & Yannig Goude & Simon Shaw, 2015. "Generalized additive models for large data sets," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 64(1), pages 139-155, January.
    8. Franses, Philip Hans, 2016. "A note on the Mean Absolute Scaled Error," International Journal of Forecasting, Elsevier, vol. 32(1), pages 20-22.
    9. Kalhori, M. Rostam Niakan & Emami, I. Taheri & Fallahi, F. & Tabarzadi, M., 2022. "A data-driven knowledge-based system with reasoning under uncertain evidence for regional long-term hourly load forecasting," Applied Energy, Elsevier, vol. 314(C).
    10. Bashiri Behmiri, Niaz & Fezzi, Carlo & Ravazzolo, Francesco, 2023. "Incorporating air temperature into mid-term electricity load forecasting models using time-series regressions and neural networks," Energy, Elsevier, vol. 278(C).
    11. Hong, Tao & Xie, Jingrui & Black, Jonathan, 2019. "Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1389-1399.
    12. David F. Hendry & Katarina Juselius, 2001. "Explaining Cointegration Analysis: Part II," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 75-120.
    13. Gaillard, Pierre & Goude, Yannig & Nedellec, Raphaël, 2016. "Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1038-1050.
    14. Ziel, Florian & Liu, Bidong, 2016. "Lasso estimation for GEFCom2014 probabilistic electric load forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1029-1037.
    15. Haben, Stephen & Giasemidis, Georgios & Ziel, Florian & Arora, Siddharth, 2019. "Short term load forecasting and the effect of temperature at the low voltage level," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1469-1484.
    16. Oreshkin, Boris N. & Dudek, Grzegorz & Pełka, Paweł & Turkina, Ekaterina, 2021. "N-BEATS neural network for mid-term electricity load forecasting," Applied Energy, Elsevier, vol. 293(C).
    17. Sizhe Zhang & Jinqi Liu & Jihong Wang, 2023. "High-Resolution Load Forecasting on Multiple Time Scales Using Long Short-Term Memory and Support Vector Machine," Energies, MDPI, vol. 16(4), pages 1-22, February.
    18. Ziel, Florian, 2019. "Quantile regression for the qualifying match of GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1400-1408.
    19. Luo, Jian & Hong, Tao & Fang, Shu-Cherng, 2018. "Benchmarking robustness of load forecasting models under data integrity attacks," International Journal of Forecasting, Elsevier, vol. 34(1), pages 89-104.
    20. Narayan, Paresh Kumar & Liu, Ruipeng, 2015. "A unit root model for trending time-series energy variables," Energy Economics, Elsevier, vol. 50(C), pages 391-402.
    21. De Felice, Matteo & Alessandri, Andrea & Catalano, Franco, 2015. "Seasonal climate forecasts for medium-term electricity demand forecasting," Applied Energy, Elsevier, vol. 137(C), pages 435-444.
    22. Behm, Christian & Nolting, Lars & Praktiknjo, Aaron, 2020. "How to model European electricity load profiles using artificial neural networks," Applied Energy, Elsevier, vol. 277(C).
    23. Goodwin, Paul & Lawton, Richard, 1999. "On the asymmetry of the symmetric MAPE," International Journal of Forecasting, Elsevier, vol. 15(4), pages 405-408, October.
    24. Nelson, Charles R. & Plosser, Charles I., 1982. "Trends and random walks in macroeconmic time series : Some evidence and implications," Journal of Monetary Economics, Elsevier, vol. 10(2), pages 139-162.
    25. Masoud Sobhani & Allison Campbell & Saurabh Sangamwar & Changlin Li & Tao Hong, 2019. "Combining Weather Stations for Electric Load Forecasting," Energies, MDPI, vol. 12(8), pages 1-11, April.
    26. repec:dau:papers:123456789/8180 is not listed on IDEAS
    27. Fildes, Robert, 1992. "The evaluation of extrapolative forecasting methods," International Journal of Forecasting, Elsevier, vol. 8(1), pages 81-98, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moreno-Carbonell, Santiago & Sánchez-Úbeda, Eugenio F. & Muñoz, Antonio, 2020. "Rethinking weather station selection for electric load forecasting using genetic algorithms," International Journal of Forecasting, Elsevier, vol. 36(2), pages 695-712.
    2. Rostami-Tabar, Bahman & Ziel, Florian, 2022. "Anticipating special events in Emergency Department forecasting," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1197-1213.
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Florian Ziel, 2020. "Load Nowcasting: Predicting Actuals with Limited Data," Energies, MDPI, vol. 13(6), pages 1-15, March.
    5. Auer, Benjamin R., 2016. "How does Germany's green energy policy affect electricity market volatility? An application of conditional autoregressive range models," Energy Policy, Elsevier, vol. 98(C), pages 621-628.
    6. Schneider, Nicolas & Strielkowski, Wadim, 2023. "Modelling the unit root properties of electricity data—A general note on time-domain applications," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 618(C).
    7. Guglielmo Maria Caporale & Luis A. Gil-Alana & Manuel Monge, 2019. "Energy Consumption in the GCC Countries: Evidence on Persistence," CESifo Working Paper Series 7470, CESifo.
    8. Nnaemeka Vincent Emodi & Taha Chaiechi & ABM Rabiul Alam Beg, 2018. "The impact of climate change on electricity demand in Australia," Energy & Environment, , vol. 29(7), pages 1263-1297, November.
    9. Razvan Pascalau, 2010. "Unit root tests with smooth breaks: an application to the Nelson-Plosser data set," Applied Economics Letters, Taylor & Francis Journals, vol. 17(6), pages 565-570.
    10. Gao Lu Zou & Kwong Wing Chau, 2015. "Determinants and Sustainability of House Prices: The Case of Shanghai, China," Sustainability, MDPI, vol. 7(4), pages 1-25, April.
    11. Sobhani, Masoud & Hong, Tao & Martin, Claude, 2020. "Temperature anomaly detection for electric load forecasting," International Journal of Forecasting, Elsevier, vol. 36(2), pages 324-333.
    12. Jose Maria Fernandez-Crehuet & Luis Alberiko Gil-Alana & Cristina Martí Barco, 2020. "Unemployment and Fertility: A Long Run Relationship," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(3), pages 1177-1196, December.
    13. Narayan, Paresh Kumar & Narayan, Seema & Smyth, Russell, 2011. "Energy consumption at business cycle horizons: The case of the United States," Energy Economics, Elsevier, vol. 33(2), pages 161-167, March.
    14. Bashiri Behmiri, Niaz & Fezzi, Carlo & Ravazzolo, Francesco, 2023. "Incorporating air temperature into mid-term electricity load forecasting models using time-series regressions and neural networks," Energy, Elsevier, vol. 278(C).
    15. Paul Anton Verwiebe & Stephan Seim & Simon Burges & Lennart Schulz & Joachim Müller-Kirchenbauer, 2021. "Modeling Energy Demand—A Systematic Literature Review," Energies, MDPI, vol. 14(23), pages 1-58, November.
    16. Cem Ertur & Antonio Musolesi, 2017. "Weak and Strong Cross‐Sectional Dependence: A Panel Data Analysis of International Technology Diffusion," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 477-503, April.
    17. Michelacci, Claudio & Zaffaroni, Paolo, 2000. "(Fractional) beta convergence," Journal of Monetary Economics, Elsevier, vol. 45(1), pages 129-153, February.
    18. Brittle, Shane, 2009. "Ricardian Equivalence and the Efficacy of Fiscal Policy in Australia," Economics Working Papers wp09-10, School of Economics, University of Wollongong, NSW, Australia.
    19. Nidhal Mgadmi & Houssem Rachdi & Hichem Saidi & Khaled Guesmi, 2019. "On the Instability of Tunisian Money Demand: Some Empirical Issues with Structural Breaks," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 17(1), pages 153-165, March.
    20. Luis A. Gil-Alana & Antonio Moreno & Seonghoon Cho, 2012. "The Deaton paradox in a long memory context with structural breaks," Applied Economics, Taylor & Francis Journals, vol. 44(25), pages 3309-3322, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2405.17070. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.