IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v39y2023i2p641-658.html
   My bibliography  Save this article

An accurate and fully-automated ensemble model for weekly time series forecasting

Author

Listed:
  • Godahewa, Rakshitha
  • Bergmeir, Christoph
  • Webb, Geoffrey I.
  • Montero-Manso, Pablo

Abstract

Many businesses and industries require accurate forecasts for weekly time series nowadays. However, the forecasting literature does not currently provide easy-to-use, automatic, reproducible and accurate approaches dedicated to this task. We propose a forecasting method in this domain to fill this gap, leveraging state-of-the-art forecasting techniques, such as forecast combination, meta-learning, and global modelling. We consider different meta-learning architectures, algorithms, and base model pools. Based on all considered model variants, we propose to use a stacking approach with lasso regression which optimally combines the forecasts of four base models: a global Recurrent Neural Network (RNN) model, Theta, Trigonometric Box–Cox ARMA Trend Seasonal (TBATS), and Dynamic Harmonic Regression ARIMA (DHR-ARIMA), as it shows the overall best performance across seven experimental weekly datasets on four evaluation metrics. Our proposed method also consistently outperforms a set of benchmarks and state-of-the-art weekly forecasting models by a considerable margin with statistical significance. Our method can produce the most accurate forecasts, in terms of mean sMAPE, for the M4 weekly dataset among all benchmarks and all original competition participants.

Suggested Citation

  • Godahewa, Rakshitha & Bergmeir, Christoph & Webb, Geoffrey I. & Montero-Manso, Pablo, 2023. "An accurate and fully-automated ensemble model for weekly time series forecasting," International Journal of Forecasting, Elsevier, vol. 39(2), pages 641-658.
  • Handle: RePEc:eee:intfor:v:39:y:2023:i:2:p:641-658
    DOI: 10.1016/j.ijforecast.2022.01.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207022000085
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2022.01.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Smyl, Slawek, 2020. "A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting," International Journal of Forecasting, Elsevier, vol. 36(1), pages 75-85.
    2. Montero-Manso, Pablo & Hyndman, Rob J., 2021. "Principles and algorithms for forecasting groups of time series: Locality and globality," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1632-1653.
    3. Sánchez, Ismael, 2008. "Adaptive combination of forecasts with application to wind energy," International Journal of Forecasting, Elsevier, vol. 24(4), pages 679-693.
    4. de Menezes, Lilian M. & W. Bunn, Derek & Taylor, James W., 2000. "Review of guidelines for the use of combined forecasts," European Journal of Operational Research, Elsevier, vol. 120(1), pages 190-204, January.
    5. Mohammed A. A. Al-qaness & Ahmed A. Ewees & Hong Fan & Mohamed Abd Elaziz, 2020. "Optimized Forecasting Method for Weekly Influenza Confirmed Cases," IJERPH, MDPI, vol. 17(10), pages 1-12, May.
    6. Montero-Manso, Pablo & Athanasopoulos, George & Hyndman, Rob J. & Talagala, Thiyanga S., 2020. "FFORMA: Feature-based forecast model averaging," International Journal of Forecasting, Elsevier, vol. 36(1), pages 86-92.
    7. Darin, Sarah Goodrich & Stellwagen, Eric, 2020. "Forecasting the M4 competition weekly data: Forecast Pro’s winning approach," International Journal of Forecasting, Elsevier, vol. 36(1), pages 135-141.
    8. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    9. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    10. Kolassa, Stephan, 2011. "Combining exponential smoothing forecasts using Akaike weights," International Journal of Forecasting, Elsevier, vol. 27(2), pages 238-251, April.
    11. Unnikrishnan N. & Sankaran G. Paduthol & Nidhi P. Ramesh, 2017. "Multivariate Variance Residual Life in Discrete Time," Statistica, Department of Statistics, University of Bologna, vol. 77(3), pages 181-205.
    12. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    13. Juan R Trapero & Nikolaos Kourentzes & Robert Fildes, 2015. "On the identification of sales forecasting models in the presence of promotions," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(2), pages 299-307, February.
    14. Clifford M. Hurvich & Chih‐Ling Tsai, 1993. "A Corrected Akaike Information Criterion For Vector Autoregressive Model Selection," Journal of Time Series Analysis, Wiley Blackwell, vol. 14(3), pages 271-279, May.
    15. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    16. Hyndman, Rob J. & Billah, Baki, 2003. "Unmasking the Theta method," International Journal of Forecasting, Elsevier, vol. 19(2), pages 287-290.
    17. Mergani A. Khairalla & Xu Ning & Nashat T. AL-Jallad & Musaab O. El-Faroug, 2018. "Short-Term Forecasting for Energy Consumption through Stacking Heterogeneous Ensemble Learning Model," Energies, MDPI, vol. 11(6), pages 1-21, June.
    18. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    19. Pawlikowski, Maciej & Chorowska, Agata, 2020. "Weighted ensemble of statistical models," International Journal of Forecasting, Elsevier, vol. 36(1), pages 93-97.
    20. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    21. S. Mohanty & Madan Jha & S. Raul & R. Panda & K. Sudheer, 2015. "Using Artificial Neural Network Approach for Simultaneous Forecasting of Weekly Groundwater Levels at Multiple Sites," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 29(15), pages 5521-5532, December.
    22. Assimakopoulos, V. & Nikolopoulos, K., 2000. "The theta model: a decomposition approach to forecasting," International Journal of Forecasting, Elsevier, vol. 16(4), pages 521-530.
    23. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    24. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    25. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    26. Federico Divina & Aude Gilson & Francisco Goméz-Vela & Miguel García Torres & José F. Torres, 2018. "Stacking Ensemble Learning for Short-Term Electricity Consumption Forecasting," Energies, MDPI, vol. 11(4), pages 1-31, April.
    27. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    28. Kolassa, Stephan, 2011. "Combining exponential smoothing forecasts using Akaike weights," International Journal of Forecasting, Elsevier, vol. 27(2), pages 238-251.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    3. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    4. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    5. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    6. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    7. Barrow, Devon K. & Kourentzes, Nikolaos, 2016. "Distributions of forecasting errors of forecast combinations: Implications for inventory management," International Journal of Production Economics, Elsevier, vol. 177(C), pages 24-33.
    8. Hewamalage, Hansika & Bergmeir, Christoph & Bandara, Kasun, 2021. "Recurrent Neural Networks for Time Series Forecasting: Current status and future directions," International Journal of Forecasting, Elsevier, vol. 37(1), pages 388-427.
    9. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    10. Meira, Erick & Cyrino Oliveira, Fernando Luiz & Jeon, Jooyoung, 2021. "Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals," International Journal of Forecasting, Elsevier, vol. 37(2), pages 547-568.
    11. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017. "Forecasting with temporal hierarchies," European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
    12. Theodosiou, Marina, 2011. "Forecasting monthly and quarterly time series using STL decomposition," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1178-1195, October.
    13. Rajapaksha, Dilini & Bergmeir, Christoph & Hyndman, Rob J., 2023. "LoMEF: A framework to produce local explanations for global model time series forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1424-1447.
    14. Fotios Petropoulos & Enno Siemsen, 2023. "Forecast Selection and Representativeness," Management Science, INFORMS, vol. 69(5), pages 2672-2690, May.
    15. Li, Li & Kang, Yanfei & Li, Feng, 2023. "Bayesian forecast combination using time-varying features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
    16. Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
    17. Pantelis Agathangelou & Demetris Trihinas & Ioannis Katakis, 2020. "A Multi-Factor Analysis of Forecasting Methods: A Study on the M4 Competition," Data, MDPI, vol. 5(2), pages 1-24, April.
    18. Andrea Kolková & Aleksandr Kljuènikov, 2021. "Demand forecasting: an alternative approach based on technical indicator Pbands," Oeconomia Copernicana, Institute of Economic Research, vol. 12(4), pages 1063-1094, December.
    19. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    20. Nghia Chu & Binh Dao & Nga Pham & Huy Nguyen & Hien Tran, 2022. "Predicting Mutual Funds' Performance using Deep Learning and Ensemble Techniques," Papers 2209.09649, arXiv.org, revised Jul 2023.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:39:y:2023:i:2:p:641-658. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.