IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2017-3.html
   My bibliography  Save this paper

Coherent Probabilistic Forecasts for Hierarchical Time Series

Author

Listed:
  • Souhaib Ben Taieb
  • James W. Taylor
  • Rob J. Hyndman

Abstract

Many applications require forecasts for a hierarchy comprising a set of time series along with aggregates of subsets of these series. Although forecasts can be produced independently for each series in the hierarchy, typically this does not lead to coherent forecasts -- the property that forecasts add up appropriately across the hierarchy. State-of-the-art hierarchical forecasting methods usually reconcile the independently generated forecasts to satisfy the aggregation constraints. A fundamental limitation of prior research is that it has considered only the problem of forecasting the mean of each time series. We consider the situation where probabilistic forecasts are needed for each series in the hierarchy. We define forecast coherency in this setting, and propose an algorithm to compute predictive distributions for each series in the hierarchy. Our algorithm has the advantage of synthesizing information from different levels in the hierarchy through a sparse forecast combination and a probabilistic hierarchical aggregation. We evaluate the accuracy of our forecasting algorithm on both simulated data and large-scale electricity smart meter data. The results show consistent performance gains compared to state-of-the art methods.

Suggested Citation

  • Souhaib Ben Taieb & James W. Taylor & Rob J. Hyndman, 2017. "Coherent Probabilistic Forecasts for Hierarchical Time Series," Monash Econometrics and Business Statistics Working Papers 3/17, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2017-3
    as

    Download full text from publisher

    File URL: http://business.monash.edu/econometrics-and-business-statistics/research/publications/ebs/wp03-17.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    2. Mirko Kremer & Enno Siemsen & Douglas J. Thomas, 2016. "The Sum and Its Parts: Judgmental Hierarchical Forecasting," Management Science, INFORMS, vol. 62(9), pages 2745-2764, September.
    3. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    4. Torsten Hothorn & Thomas Kneib & Peter Bühlmann, 2014. "Conditional transformation models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 3-27, January.
    5. Hyndman, Rob J. & Lee, Alan J. & Wang, Earo, 2016. "Fast computation of reconciled forecasts for hierarchical and grouped time series," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 16-32.
    6. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    7. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    8. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    9. Arbenz, Philipp & Hummel, Christoph & Mainik, Georg, 2012. "Copula based hierarchical risk aggregation through sample reordering," Insurance: Mathematics and Economics, Elsevier, vol. 51(1), pages 122-133.
    10. Arora, Siddharth & Taylor, James W., 2016. "Forecasting electricity smart meter data using conditional kernel density estimation," Omega, Elsevier, vol. 59(PA), pages 47-59.
    11. Andrew J. Patton, 2006. "Modelling Asymmetric Exchange Rate Dependence," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(2), pages 527-556, May.
    12. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    13. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    14. Berrocal, Veronica J. & Raftery, Adrian E. & Gneiting, Tilmann & Steed, Richard C., 2010. "Probabilistic Weather Forecasting for Winter Road Maintenance," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 522-537.
    15. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    16. Yanqin Fan & Andrew J. Patton, 2014. "Copulas in Econometrics," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 179-200, August.
    17. Shanika L Wickramasuriya & George Athanasopoulos & Rob J Hyndman, 2015. "Forecasting hierarchical and grouped time series through trace minimization," Monash Econometrics and Business Statistics Working Papers 15/15, Monash University, Department of Econometrics and Business Statistics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    2. Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "Evaluating quantile forecasts in the M5 uncertainty competition," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1531-1545.
    3. Olivares, Kin G. & Meetei, O. Nganba & Ma, Ruijun & Reddy, Rohan & Cao, Mengfei & Dicker, Lee, 2024. "Probabilistic hierarchical forecasting with deep Poisson mixtures," International Journal of Forecasting, Elsevier, vol. 40(2), pages 470-489.
    4. Li, Han & Hyndman, Rob J., 2021. "Assessing mortality inequality in the U.S.: What can be said about the future?," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 152-162.
    5. Nystrup, Peter & Lindström, Erik & Møller, Jan K. & Madsen, Henrik, 2021. "Dimensionality reduction in forecasting with temporal hierarchies," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1127-1146.
    6. Smyl, Slawek & Hua, N. Grace, 2019. "Machine learning methods for GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1424-1431.
    7. Panagiotelis, Anastasios & Athanasopoulos, George & Gamakumara, Puwasala & Hyndman, Rob J., 2021. "Forecast reconciliation: A geometric view with new insights on bias correction," International Journal of Forecasting, Elsevier, vol. 37(1), pages 343-359.
    8. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Panagiotelis, Anastasios, 2024. "Forecast reconciliation: A review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 430-456.
    9. Gary Koop & Stuart McIntyre & James Mitchell & Aubrey Poon, 2020. "Regional output growth in the United Kingdom: More timely and higher frequency estimates from 1970," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(2), pages 176-197, March.
    10. Meira, Erick & Lila, Maurício Franca & Cyrino Oliveira, Fernando Luiz, 2023. "A novel reconciliation approach for hierarchical electricity consumption forecasting based on resistant regression," Energy, Elsevier, vol. 269(C).
    11. Jeon, Jooyoung & Panagiotelis, Anastasios & Petropoulos, Fotios, 2019. "Probabilistic forecast reconciliation with applications to wind power and electric load," European Journal of Operational Research, Elsevier, vol. 279(2), pages 364-379.
    12. Tomokaze Shiratori & Ken Kobayashi & Yuichi Takano, 2020. "Prediction of hierarchical time series using structured regularization and its application to artificial neural networks," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-23, November.
    13. Lila, Maurício Franca & Meira, Erick & Cyrino Oliveira, Fernando Luiz, 2022. "Forecasting unemployment in Brazil: A robust reconciliation approach using hierarchical data," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    14. Brégère, Margaux & Huard, Malo, 2022. "Online hierarchical forecasting for power consumption data," International Journal of Forecasting, Elsevier, vol. 38(1), pages 339-351.
    15. Hong, Tao & Xie, Jingrui & Black, Jonathan, 2019. "Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1389-1399.
    16. Ziel, Florian, 2019. "Quantile regression for the qualifying match of GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1400-1408.
    17. Hollyman, Ross & Petropoulos, Fotios & Tipping, Michael E., 2021. "Understanding forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 294(1), pages 149-160.
    18. Hakeem‐Ur Rehman & Guohua Wan & Raza Rafique, 2023. "A hybrid approach with step‐size aggregation to forecasting hierarchical time series," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(1), pages 176-192, January.
    19. Daniele Girolimetto & George Athanasopoulos & Tommaso Di Fonzo & Rob J Hyndman, 2023. "Cross-temporal Probabilistic Forecast Reconciliation," Monash Econometrics and Business Statistics Working Papers 6/23, Monash University, Department of Econometrics and Business Statistics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    2. Alexander Henzi & Johanna F. Ziegel & Tilmann Gneiting, 2021. "Isotonic distributional regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(5), pages 963-993, November.
    3. Tino Werner, 2022. "Elicitability of Instance and Object Ranking," Decision Analysis, INFORMS, vol. 19(2), pages 123-140, June.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Werner Ehm & Tilmann Gneiting & Alexander Jordan & Fabian Krüger, 2016. "Of quantiles and expectiles: consistent scoring functions, Choquet representations and forecast rankings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 505-562, June.
    6. Lahiri, Kajal & Yang, Liu, 2013. "Forecasting Binary Outcomes," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106, Elsevier.
    7. Ruben Loaiza‐Maya & Gael M. Martin & David T. Frazier, 2021. "Focused Bayesian prediction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 517-543, August.
    8. Hajo Holzmann & Matthias Eulert, 2014. "The role of the information set for forecasting - with applications to risk management," Papers 1404.7653, arXiv.org.
    9. Gensler, André & Sick, Bernhard & Vogt, Stephan, 2018. "A review of uncertainty representations and metaverification of uncertainty assessment techniques for renewable energies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 352-379.
    10. Marc-Oliver Pohle, 2020. "The Murphy Decomposition and the Calibration-Resolution Principle: A New Perspective on Forecast Evaluation," Papers 2005.01835, arXiv.org.
    11. Emilio Zanetti Chini, 2018. "Forecaster’s utility and forecasts coherence," DEM Working Papers Series 145, University of Pavia, Department of Economics and Management.
    12. Tobias Fissler & Hajo Holzmann, 2022. "Measurability of functionals and of ideal point forecasts," Papers 2203.08635, arXiv.org.
    13. Manzan, Sebastiano & Zerom, Dawit, 2013. "Are macroeconomic variables useful for forecasting the distribution of U.S. inflation?," International Journal of Forecasting, Elsevier, vol. 29(3), pages 469-478.
    14. repec:bny:wpaper:0029 is not listed on IDEAS
    15. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    16. Fabian Kruger & Hendrik Plett, 2022. "Prediction intervals for economic fixed-event forecasts," Papers 2210.13562, arXiv.org, revised Mar 2024.
    17. Martin, Gael M. & Loaiza-Maya, Rubén & Maneesoonthorn, Worapree & Frazier, David T. & Ramírez-Hassan, Andrés, 2022. "Optimal probabilistic forecasts: When do they work?," International Journal of Forecasting, Elsevier, vol. 38(1), pages 384-406.
    18. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    19. Smith, Michael Stanley & Maneesoonthorn, Worapree, 2018. "Inversion copulas from nonlinear state space models with an application to inflation forecasting," International Journal of Forecasting, Elsevier, vol. 34(3), pages 389-407.
    20. Jonas R. Brehmer & Tilmann Gneiting, 2020. "Properization: constructing proper scoring rules via Bayes acts," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 659-673, June.
    21. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.

    More about this item

    Keywords

    forecast combination; probabilistic forecast; copula; machine learning.;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2017-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.