IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v29y2013i1p1-12.html
   My bibliography  Save this article

A comparison of periodic autoregressive and dynamic factor models in intraday energy demand forecasting

Author

Listed:
  • Mestekemper, Thomas
  • Kauermann, Göran
  • Smith, Michael S.

Abstract

We suggest a new approach for forecasting energy demand at an intraday resolution. The demand in each intraday period is modeled using semiparametric regression smoothing to account for calendar and weather components. Residual serial dependence is captured by one of two multivariate stationary time series models, with a dimension equal to the number of intraday periods. These are a periodic autoregression and a dynamic factor model. We show the benefits of our approach in the forecasting of (a) district heating demand in a steam network in Germany and (b) aggregate electricity demand in the state of Victoria, Australia. In both studies, accounting for weather can improve the forecast quality substantially, as does the use of time series models. We compare the effectiveness of the periodic autoregression with three variations of the dynamic factor model, and find that the dynamic factor model consistently provides more accurate forecasts. Overall, our approach combines many of the features which have previously been shown to provide high quality forecasts of energy demand over horizons of up to one week, as well as introducing some novel ones.

Suggested Citation

  • Mestekemper, Thomas & Kauermann, Göran & Smith, Michael S., 2013. "A comparison of periodic autoregressive and dynamic factor models in intraday energy demand forecasting," International Journal of Forecasting, Elsevier, vol. 29(1), pages 1-12.
  • Handle: RePEc:eee:intfor:v:29:y:2013:i:1:p:1-12
    DOI: 10.1016/j.ijforecast.2012.03.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207012000520
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2012.03.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dotzauer, Erik, 2002. "Simple model for prediction of loads in district-heating systems," Applied Energy, Elsevier, vol. 73(3-4), pages 277-284, November.
    2. repec:cup:cbooks:9780521785167 is not listed on IDEAS
    3. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    4. Dordonnat, V. & Koopman, S.J. & Ooms, M. & Dessertaine, A. & Collet, J., 2008. "An hourly periodic state space model for modelling French national electricity load," International Journal of Forecasting, Elsevier, vol. 24(4), pages 566-587.
    5. Jörg Breitung & Sandra Eickmeier, 2006. "Dynamic Factor Models," Springer Books, in: Olaf Hübler & Jachim Frohn (ed.), Modern Econometric Analysis, chapter 3, pages 25-40, Springer.
    6. Broszkiewicz-Suwaj, E & Makagon, A & Weron, R & Wyłomańska, A, 2004. "On detecting and modeling periodic correlation in financial data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 336(1), pages 196-205.
    7. Ramanathan, Ramu & Engle, Robert & Granger, Clive W. J. & Vahid-Araghi, Farshid & Brace, Casey, 1997. "Shorte-run forecasts of electricity loads and peaks," International Journal of Forecasting, Elsevier, vol. 13(2), pages 161-174, June.
    8. Smith, Michael, 2000. "Modeling and Short-term Forecasting of New South Wales Electricity System Load," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(4), pages 465-478, October.
    9. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian density forecasting of intraday electricity prices using multivariate skew t distributions," International Journal of Forecasting, Elsevier, vol. 24(4), pages 710-727.
    10. Sailor, David J. & Muñoz, J.Ricardo, 1997. "Sensitivity of electricity and natural gas consumption to climate in the U.S.A.—Methodology and results for eight states," Energy, Elsevier, vol. 22(10), pages 987-998.
    11. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian identification, selection and estimation of semiparametric functions in high-dimensional additive models," Journal of Econometrics, Elsevier, vol. 143(2), pages 291-316, April.
    12. Jeng‐Min Chiou & Hans‐Georg Müller & Jane‐Ling Wang, 2003. "Functional quasi‐likelihood regression models with smooth random effects," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 405-423, May.
    13. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    14. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    15. Cottet R. & Smith M., 2003. "Bayesian Modeling and Forecasting of Intraday Electricity Load," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 839-849, January.
    16. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    17. Hahn, Heiko & Meyer-Nieberg, Silja & Pickl, Stefan, 2009. "Electric load forecasting methods: Tools for decision making," European Journal of Operational Research, Elsevier, vol. 199(3), pages 902-907, December.
    18. Simon N. Wood, 2008. "Fast stable direct fitting and smoothness selection for generalized additive models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(3), pages 495-518, July.
    19. Soares, Lacir J. & Medeiros, Marcelo C., 2008. "Modeling and forecasting short-term electricity load: A comparison of methods with an application to Brazilian data," International Journal of Forecasting, Elsevier, vol. 24(4), pages 630-644.
    20. Franses, Philip Hans & Paap, Richard, 2004. "Periodic Time Series Models," OUP Catalogue, Oxford University Press, number 9780199242030, Decembrie.
    21. Pardo, Angel & Meneu, Vicente & Valor, Enric, 2002. "Temperature and seasonality influences on Spanish electricity load," Energy Economics, Elsevier, vol. 24(1), pages 55-70, January.
    22. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601, December.
    23. Rotger, G.P. & Franses, Ph.H.B.F., 2006. "Forecasting high-frequency electricity demand with a diffusion index model," Econometric Institute Research Papers EI 2006-38, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    24. Göran Kauermann & Tatyana Krivobokova & Ludwig Fahrmeir, 2009. "Some asymptotic results on generalized penalized spline smoothing," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 487-503, April.
    25. Jean Boivin & Serena Ng, 2005. "Understanding and Comparing Factor-Based Forecasts," International Journal of Central Banking, International Journal of Central Banking, vol. 1(3), December.
    26. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    27. repec:cup:cbooks:9780521780506 is not listed on IDEAS
    28. Hallin, Marc & Liska, Roman, 2007. "Determining the Number of Factors in the General Dynamic Factor Model," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 603-617, June.
    29. M. P. Wand, 2003. "Smoothing and mixed models," Computational Statistics, Springer, vol. 18(2), pages 223-249, July.
    30. Krivobokova, Tatyana & Kauermann, Goran, 2007. "A Note on Penalized Spline Smoothing With Correlated Errors," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1328-1337, December.
    31. Moral-Carcedo, Julian & Vicens-Otero, Jose, 2005. "Modelling the non-linear response of Spanish electricity demand to temperature variations," Energy Economics, Elsevier, vol. 27(3), pages 477-494, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shao, Zhen & Gao, Fei & Zhang, Qiang & Yang, Shan-Lin, 2015. "Multivariate statistical and similarity measure based semiparametric modeling of the probability distribution: A novel approach to the case study of mid-long term electricity consumption forecasting i," Applied Energy, Elsevier, vol. 156(C), pages 502-518.
    2. Shao, Zhen & Gao, Fei & Yang, Shan-Lin & Yu, Ben-gong, 2015. "A new semiparametric and EEMD based framework for mid-term electricity demand forecasting in China: Hidden characteristic extraction and probability density prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 876-889.
    3. Nigitz, Thomas & Gölles, Markus, 2019. "A generally applicable, simple and adaptive forecasting method for the short-term heat load of consumers," Applied Energy, Elsevier, vol. 241(C), pages 73-81.
    4. Wang, Siyan & Sun, Xun & Lall, Upmanu, 2017. "A hierarchical Bayesian regression model for predicting summer residential electricity demand across the U.S.A," Energy, Elsevier, vol. 140(P1), pages 601-611.
    5. Moral-Carcedo, Julián & Pérez-García, Julián, 2019. "Time of day effects of temperature and daylight on short term electricity load," Energy, Elsevier, vol. 174(C), pages 169-183.
    6. Habeebur Rahman & Iniyan Selvarasan & Jahitha Begum A, 2018. "Short-Term Forecasting of Total Energy Consumption for India-A Black Box Based Approach," Energies, MDPI, vol. 11(12), pages 1-21, December.
    7. Moral-Carcedo, Julián & Pérez-García, Julián, 2017. "Integrating long-term economic scenarios into peak load forecasting: An application to Spain," Energy, Elsevier, vol. 140(P1), pages 682-695.
    8. Fang, Tingting & Lahdelma, Risto, 2016. "Evaluation of a multiple linear regression model and SARIMA model in forecasting heat demand for district heating system," Applied Energy, Elsevier, vol. 179(C), pages 544-552.
    9. Salisu, Afees A. & Ayinde, Taofeek O., 2016. "Modeling energy demand: Some emerging issues," Renewable and Sustainable Energy Reviews, Elsevier, vol. 54(C), pages 1470-1480.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vaz, Lucélia Viviane & Filho, Getulio Borges da Silveira, 2017. "Functional Autoregressive Models: An Application to Brazilian Hourly Electricity Load," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 37(2), November.
    2. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2010. "Are disaggregate data useful for factor analysis in forecasting French GDP?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 132-144.
    3. Mario Forni & Alessandro Giovannelli & Marco Lippi & Stefano Soccorsi, 2018. "Dynamic factor model with infinite‐dimensional factor space: Forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(5), pages 625-642, August.
    4. Nii Ayi Armah & Norman Swanson, 2010. "Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Large Scale Macroeconomic Time Series Environments," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 476-510.
    5. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    6. Ergemen, Yunus Emre & Rodríguez-Caballero, C. Vladimir, 2023. "Estimation of a dynamic multi-level factor model with possible long-range dependence," International Journal of Forecasting, Elsevier, vol. 39(1), pages 405-430.
    7. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    8. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    9. Jaume Rosselló Nadal & Mohcine Bakhat, 2009. "A new approach to estimating tourism-induced electricity consumption," CRE Working Papers (Documents de treball del CRE) 2009/6, Centre de Recerca Econòmica (UIB ·"Sa Nostra").
    10. Luciani, Matteo, 2014. "Forecasting with approximate dynamic factor models: The role of non-pervasive shocks," International Journal of Forecasting, Elsevier, vol. 30(1), pages 20-29.
    11. Forni, Mario & Gambetti, Luca, 2010. "The dynamic effects of monetary policy: A structural factor model approach," Journal of Monetary Economics, Elsevier, vol. 57(2), pages 203-216, March.
    12. Bork, Lasse, 2009. "Estimating US Monetary Policy Shocks Using a Factor-Augmented Vector Autoregression: An EM Algorithm Approach," Finance Research Group Working Papers F-2009-03, University of Aarhus, Aarhus School of Business, Department of Business Studies.
    13. Mayr, Johannes, 2010. "Forecasting Macroeconomic Aggregates," Munich Dissertations in Economics 11140, University of Munich, Department of Economics.
    14. Pilar Poncela & Esther Ruiz, 2016. "Small- Versus Big-Data Factor Extraction in Dynamic Factor Models: An Empirical Assessment," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 401-434, Emerald Group Publishing Limited.
    15. Matteo Luciani, 2015. "Monetary Policy and the Housing Market: A Structural Factor Analysis," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(2), pages 199-218, March.
    16. Filippo Altissimo & Riccardo Cristadoro & Mario Forni & Marco Lippi & Giovanni Veronese, 2010. "New Eurocoin: Tracking Economic Growth in Real Time," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1024-1034, November.
    17. Bakhat, Mohcine & Rosselló, Jaume, 2011. "Estimation of tourism-induced electricity consumption: The case study of Balearics Islands, Spain," Energy Economics, Elsevier, vol. 33(3), pages 437-444, May.
    18. Kihwan Kim & Hyun Hak Kim & Norman R. Swanson, 2023. "Mixing mixed frequency and diffusion indices in good times and in bad: an assessment based on historical data around the great recession of 2008," Empirical Economics, Springer, vol. 64(3), pages 1421-1469, March.
    19. Helmut Lütkepohl, 2014. "Structural Vector Autoregressive Analysis in a Data Rich Environment: A Survey," Discussion Papers of DIW Berlin 1351, DIW Berlin, German Institute for Economic Research.
    20. Lippi, Marco & Deistler, Manfred & Anderson, Brian, 2023. "High-Dimensional Dynamic Factor Models: A Selective Survey and Lines of Future Research," Econometrics and Statistics, Elsevier, vol. 26(C), pages 3-16.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:29:y:2013:i:1:p:1-12. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.