IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v34y2018i4p748-761.html
   My bibliography  Save this article

Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing

Author

Listed:
  • Dantas, Tiago Mendes
  • Cyrino Oliveira, Fernando Luiz

Abstract

Some recent papers have demonstrated that combining bagging (bootstrap aggregating) with exponential smoothing methods can produce highly accurate forecasts and improve the forecast accuracy relative to traditional methods. We therefore propose a new approach that combines the bagging, exponential smoothing and clustering methods. The existing methods use bagging to generate and aggregate groups of forecasts in order to reduce the variance. However, none of them consider the effect of covariance among the group of forecasts, even though it could have a dramatic impact on the variance of the group, and therefore on the forecast accuracy. The proposed approach, referred to here as Bagged.Cluster.ETS, aims to reduce the covariance effect by using partitioning around medoids (PAM) to produce clusters of similar forecasts, then selecting several forecasts from each cluster to create a group with a reduced variance. This approach was tested on various different time series sets from the M3 and CIF 2016 competitions. The empirical results have shown a substantial reduction in the forecast error, considering sMAPE and MASE.

Suggested Citation

  • Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz, 2018. "Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing," International Journal of Forecasting, Elsevier, vol. 34(4), pages 748-761.
  • Handle: RePEc:eee:intfor:v:34:y:2018:i:4:p:748-761
    DOI: 10.1016/j.ijforecast.2018.05.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207018300888
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2018.05.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Armstrong, J. Scott, 2007. "Significance tests harm progress in forecasting," International Journal of Forecasting, Elsevier, vol. 23(2), pages 321-327.
    2. David Rapach & Jack Strauss, 2010. "Bagging or Combining (or Both)? An Analysis Based on Forecasting U.S. Employment Growth," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 511-533.
    3. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    4. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    5. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    6. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    7. Bergmeir, Christoph & Hyndman, Rob J. & Benítez, José M., 2016. "Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation," International Journal of Forecasting, Elsevier, vol. 32(2), pages 303-312.
    8. Sainan Jin & Liangjun Su & Aman Ullah, 2014. "Robustify Financial Time Series Forecasting with Bagging," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 575-605, August.
    9. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    10. Lee, Tae-Hwy & Yang, Yang, 2006. "Bagging binary and quantile predictors for time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 465-497.
    11. Petropoulos, Fotios & Hyndman, Rob J. & Bergmeir, Christoph, 2018. "Exploring the sources of uncertainty: Why does bagging for time series forecasting work?," European Journal of Operational Research, Elsevier, vol. 268(2), pages 545-554.
    12. Kilian, Lutz & Inoue, Atsushi, 2004. "Bagging Time Series Models," CEPR Discussion Papers 4333, C.E.P.R. Discussion Papers.
    13. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz & Varela Repolho, Hugo Miguel, 2017. "Air transportation demand forecast through Bagging Holt Winters methods," Journal of Air Transport Management, Elsevier, vol. 59(C), pages 116-123.
    14. Montero, Pablo & Vilar, José A., 2014. "TSclust: An R Package for Time Series Clustering," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 62(i01).
    15. Eric Hillebrand & Marcelo Medeiros, 2010. "The Benefits of Bagging for Forecast Models of Realized Volatility," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 571-593.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    2. Tartakovsky, Alexandre M. & Ma, Tong & Barajas-Solano, David A. & Tipireddy, Ramakrishna, 2023. "Physics-informed Gaussian process regression for states estimation and forecasting in power grids," International Journal of Forecasting, Elsevier, vol. 39(2), pages 967-980.
    3. Fotios Petropoulos & Evangelos Spiliotis, 2021. "The Wisdom of the Data: Getting the Most Out of Univariate Time Series Forecasting," Forecasting, MDPI, vol. 3(3), pages 1-20, June.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Meira, Erick & Cyrino Oliveira, Fernando Luiz & Jeon, Jooyoung, 2021. "Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals," International Journal of Forecasting, Elsevier, vol. 37(2), pages 547-568.
    6. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    7. Li, Chen & Zhu, Zhijie & Yang, Hufang & Li, Ranran, 2019. "An innovative hybrid system for wind speed forecasting based on fuzzy preprocessing scheme and multi-objective optimization," Energy, Elsevier, vol. 174(C), pages 1219-1237.
    8. Badri Toppur & T. C. Thomas, 2023. "Forecasting Commercial Vehicle Production Using Quantitative Techniques," Contemporary Economics, University of Economics and Human Sciences in Warsaw., vol. 17(1), March.
    9. Dunz, Nepomuk & Naqvi, Asjad & Monasterolo, Irene, 2019. "Climate Transition Risk, Climate Sentiments, and Financial Stability in a Stock-Flow Consistent approach," Ecological Economic Papers 23, WU Vienna University of Economics and Business.
    10. Lila, Maurício Franca & Meira, Erick & Cyrino Oliveira, Fernando Luiz, 2022. "Forecasting unemployment in Brazil: A robust reconciliation approach using hierarchical data," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    11. Dunz, Nepomuk & Naqvi, Asjad & Monasterolo, Irene, 2021. "Climate sentiments, transition risk, and financial stability in a stock-flow consistent model," Journal of Financial Stability, Elsevier, vol. 54(C).
    12. Kadir Özen & Dilem Yıldırım, 2021. "Application of Bagging in Day-Ahead Electricity Price Forecasting and Factor Augmentation," ERC Working Papers 2101, ERC - Economic Research Center, Middle East Technical University, revised Apr 2021.
    13. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2021. "Point and interval forecasting of electricity supply via pruned ensembles," Energy, Elsevier, vol. 232(C).
    14. Erol Eğrioğlu & Robert Fildes, 2022. "A New Bootstrapped Hybrid Artificial Neural Network Approach for Time Series Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 59(4), pages 1355-1383, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Meira, Erick & Cyrino Oliveira, Fernando Luiz & Jeon, Jooyoung, 2021. "Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals," International Journal of Forecasting, Elsevier, vol. 37(2), pages 547-568.
    3. Pedro Henrique Melo Albuquerque & Yaohao Peng & João Pedro Fontoura da Silva, 2022. "Making the whole greater than the sum of its parts: A literature review of ensemble methods for financial time series forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1701-1724, December.
    4. Barrow, Devon K. & Crone, Sven F., 2016. "Cross-validation aggregation for combining autoregressive neural network forecasts," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1120-1137.
    5. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    6. Li, Li & Kang, Yanfei & Li, Feng, 2023. "Bayesian forecast combination using time-varying features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
    7. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    8. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    9. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    10. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    11. Lyu, Zhichong & Ma, Feng & Zhang, Jixiang, 2023. "Oil futures volatility prediction: Bagging or combination?," International Review of Economics & Finance, Elsevier, vol. 87(C), pages 457-467.
    12. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    13. Lahiri, Kajal & Yang, Liu, 2013. "Forecasting Binary Outcomes," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106, Elsevier.
    14. Luo, Qin & Bu, Jinfeng & Xu, Weiju & Huang, Dengshi, 2023. "Stock market volatility prediction: Evidence from a new bagging model," International Review of Economics & Finance, Elsevier, vol. 87(C), pages 445-456.
    15. Michael McAleer & Marcelo C. Medeiros, 2009. "Forecasting Realized Volatility with Linear and Nonlinear Models," CARF F-Series CARF-F-189, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    16. Eckert, Florian & Hyndman, Rob J. & Panagiotelis, Anastasios, 2021. "Forecasting Swiss exports using Bayesian forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 291(2), pages 693-710.
    17. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017. "Forecasting with temporal hierarchies," European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
    18. Barrow, Devon K. & Crone, Sven F., 2016. "A comparison of AdaBoost algorithms for time series forecast combination," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1103-1119.
    19. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2021. "Point and interval forecasting of electricity supply via pruned ensembles," Energy, Elsevier, vol. 232(C).
    20. Kourentzes, Nikolaos & Barrow, Devon & Petropoulos, Fotios, 2019. "Another look at forecast selection and combination: Evidence from forecast pooling," International Journal of Production Economics, Elsevier, vol. 209(C), pages 226-235.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:34:y:2018:i:4:p:748-761. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.