IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v40y2024i2p470-489.html
   My bibliography  Save this article

Probabilistic hierarchical forecasting with deep Poisson mixtures

Author

Listed:
  • Olivares, Kin G.
  • Meetei, O. Nganba
  • Ma, Ruijun
  • Reddy, Rohan
  • Cao, Mengfei
  • Dicker, Lee

Abstract

Hierarchical forecasting problems arise when time series have a natural group structure, and predictions at multiple levels of aggregation and disaggregation across the groups are needed. In such problems, it is often desired to satisfy the aggregation constraints in a given hierarchy, referred to as hierarchical coherence in the literature. Maintaining coherence while producing accurate forecasts can be a challenging problem, especially in the case of probabilistic forecasting. We present a novel method capable of accurate and coherent probabilistic forecasts for time series when reliable hierarchical information is present. We call it the deep Poisson mixture network (DPMN). It relies on the combination of neural networks and a statistical model for the joint distribution of the hierarchical multivariate time-series structure. By construction, the model guarantees hierarchical coherence and provides simple rules for aggregation and disaggregation of the predictive distributions. We perform an extensive empirical evaluation comparing the DPMN to other state-of-the-art methods which produce hierarchically coherent probabilistic forecasts on multiple public datasets. Compared to existing coherent probabilistic models, we obtain a relative improvement in the overall continuous ranked probability score (CRPS) of 11.8% on Australian domestic tourism data, and of 8.1% on the Favorita grocery sales dataset, where time series are grouped with geographical hierarchies or travel-intent hierarchies. For San Francisco Bay Area highway traffic, where the series’ hierarchical structure is randomly assigned and their correlations are less informative, our method does not show significant performance differences over statistical baselines.

Suggested Citation

  • Olivares, Kin G. & Meetei, O. Nganba & Ma, Ruijun & Reddy, Rohan & Cao, Mengfei & Dicker, Lee, 2024. "Probabilistic hierarchical forecasting with deep Poisson mixtures," International Journal of Forecasting, Elsevier, vol. 40(2), pages 470-489.
  • Handle: RePEc:eee:intfor:v:40:y:2024:i:2:p:470-489
    DOI: 10.1016/j.ijforecast.2023.04.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207023000432
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2023.04.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James E. Matheson & Robert L. Winkler, 1976. "Scoring Rules for Continuous Probability Distributions," Management Science, INFORMS, vol. 22(10), pages 1087-1096, June.
    2. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    3. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    4. Jeon, Jooyoung & Panagiotelis, Anastasios & Petropoulos, Fotios, 2019. "Probabilistic forecast reconciliation with applications to wind power and electric load," European Journal of Operational Research, Elsevier, vol. 279(2), pages 364-379.
    5. Hong, Tao & Pinson, Pierre & Fan, Shu, 2014. "Global Energy Forecasting Competition 2012," International Journal of Forecasting, Elsevier, vol. 30(2), pages 357-363.
    6. Shanika L. Wickramasuriya & George Athanasopoulos & Rob J. Hyndman, 2019. "Optimal Forecast Reconciliation for Hierarchical and Grouped Time Series Through Trace Minimization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 804-819, April.
    7. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    8. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017. "Forecasting with temporal hierarchies," European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
    9. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    10. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    11. Hollyman, Ross & Petropoulos, Fotios & Tipping, Michael E., 2021. "Understanding forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 294(1), pages 149-160.
    12. Hyndman, Rob J. & Lee, Alan J. & Wang, Earo, 2016. "Fast computation of reconciled forecasts for hierarchical and grouped time series," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 16-32.
    13. Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
    14. Puwasala Gamakumara & Anastasios Panagiotelis & George Athanasopoulos & Rob J Hyndman, 2018. "Probabilisitic forecasts in hierarchical time series," Monash Econometrics and Business Statistics Working Papers 11/18, Monash University, Department of Econometrics and Business Statistics.
    15. Souhaib Ben Taieb & James W. Taylor & Rob J. Hyndman, 2017. "Coherent Probabilistic Forecasts for Hierarchical Time Series," Monash Econometrics and Business Statistics Working Papers 3/17, Monash University, Department of Econometrics and Business Statistics.
    16. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    17. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    18. Anders Brix & Peter J. Diggle, 2001. "Spatiotemporal prediction for log‐Gaussian Cox processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(4), pages 823-841.
    19. Suman Ravuri & Karel Lenc & Matthew Willson & Dmitry Kangin & Remi Lam & Piotr Mirowski & Megan Fitzsimons & Maria Athanassiadou & Sheleem Kashem & Sam Madge & Rachel Prudden & Amol Mandhane & Aidan C, 2021. "Skilful precipitation nowcasting using deep generative models of radar," Nature, Nature, vol. 597(7878), pages 672-677, September.
    20. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    21. Souhaib Ben Taieb & James W. Taylor & Rob J. Hyndman, 2021. "Hierarchical Probabilistic Forecasting of Electricity Demand With Smart Meter Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(533), pages 27-43, March.
    22. Panagiotelis, Anastasios & Gamakumara, Puwasala & Athanasopoulos, George & Hyndman, Rob J., 2023. "Probabilistic forecast reconciliation: Properties, evaluation and score optimisation," European Journal of Operational Research, Elsevier, vol. 306(2), pages 693-706.
    23. Spyros Makridakis & Evangelos Spiliotis & Vassilios Assimakopoulos, 2018. "Statistical and Machine Learning forecasting methods: Concerns and ways forward," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-26, March.
    24. Spiliotis, Evangelos & Petropoulos, Fotios & Kourentzes, Nikolaos & Assimakopoulos, Vassilios, 2020. "Cross-temporal aggregation: Improving the forecast accuracy of hierarchical electricity consumption," Applied Energy, Elsevier, vol. 261(C).
    25. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Panagiotelis, Anastasios, 2024. "Forecast reconciliation: A review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 430-456.
    2. Girolimetto, Daniele & Athanasopoulos, George & Di Fonzo, Tommaso & Hyndman, Rob J., 2024. "Cross-temporal probabilistic forecast reconciliation: Methodological and practical issues," International Journal of Forecasting, Elsevier, vol. 40(3), pages 1134-1151.
    3. Nystrup, Peter & Lindström, Erik & Møller, Jan K. & Madsen, Henrik, 2021. "Dimensionality reduction in forecasting with temporal hierarchies," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1127-1146.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Zhang, Bohan & Kang, Yanfei & Panagiotelis, Anastasios & Li, Feng, 2023. "Optimal reconciliation with immutable forecasts," European Journal of Operational Research, Elsevier, vol. 308(2), pages 650-660.
    6. Mikkel L. Sørensen & Peter Nystrup & Mathias B. Bjerregård & Jan K. Møller & Peder Bacher & Henrik Madsen, 2023. "Recent developments in multivariate wind and solar power forecasting," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 12(2), March.
    7. Hollyman, Ross & Petropoulos, Fotios & Tipping, Michael E., 2021. "Understanding forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 294(1), pages 149-160.
    8. Di Fonzo, Tommaso & Girolimetto, Daniele, 2024. "Forecast combination-based forecast reconciliation: Insights and extensions," International Journal of Forecasting, Elsevier, vol. 40(2), pages 490-514.
    9. Di Fonzo, Tommaso & Girolimetto, Daniele, 2023. "Cross-temporal forecast reconciliation: Optimal combination method and heuristic alternatives," International Journal of Forecasting, Elsevier, vol. 39(1), pages 39-57.
    10. Corani, Giorgio & Azzimonti, Dario & Rubattu, Nicolò, 2024. "Probabilistic reconciliation of count time series," International Journal of Forecasting, Elsevier, vol. 40(2), pages 457-469.
    11. Eckert, Florian & Hyndman, Rob J. & Panagiotelis, Anastasios, 2021. "Forecasting Swiss exports using Bayesian forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 291(2), pages 693-710.
    12. Zhang, Bohan & Panagiotelis, Anastasios & Kang, Yanfei, 2024. "Discrete forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 318(1), pages 143-153.
    13. Bergsteinsson, Hjörleifur G. & Sørensen, Mikkel Lindstrøm & Møller, Jan Kloppenborg & Madsen, Henrik, 2023. "Heat load forecasting using adaptive spatial hierarchies," Applied Energy, Elsevier, vol. 350(C).
    14. Ana Caroline Pinheiro & Paulo Canas Rodrigues, 2024. "Hierarchical Time Series Forecasting of Fire Spots in Brazil: A Comprehensive Approach," Stats, MDPI, vol. 7(3), pages 1-24, June.
    15. Møller, Jan Kloppenborg & Nystrup, Peter & Madsen, Henrik, 2024. "Likelihood-based inference in temporal hierarchies," International Journal of Forecasting, Elsevier, vol. 40(2), pages 515-531.
    16. Hakeem‐Ur Rehman & Guohua Wan & Raza Rafique, 2023. "A hybrid approach with step‐size aggregation to forecasting hierarchical time series," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(1), pages 176-192, January.
    17. Pritularga, Kandrika F. & Svetunkov, Ivan & Kourentzes, Nikolaos, 2021. "Stochastic coherency in forecast reconciliation," International Journal of Production Economics, Elsevier, vol. 240(C).
    18. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    19. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    20. Panagiotelis, Anastasios & Gamakumara, Puwasala & Athanasopoulos, George & Hyndman, Rob J., 2023. "Probabilistic forecast reconciliation: Properties, evaluation and score optimisation," European Journal of Operational Research, Elsevier, vol. 306(2), pages 693-706.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:40:y:2024:i:2:p:470-489. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.