IDEAS home Printed from https://ideas.repec.org/p/rim/rimwps/17_12.html
   My bibliography  Save this paper

Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle

Author

Listed:
  • Mehmet Pinar

    (University of Guelph; Fondazione Eni Enrico Mattei)

  • Thanasis Stengos

    (University of Guelph)

  • M. Ege Yazgan

    (Istanbul Bilgi University)

Abstract

The forecast combination puzzle refers to the finding that a simple average forecast combination outperforms more sophisticated weighting schemes and/or the best individual model. The paper derives optimal (worst) forecast combinations based on stochastic dominance (SD) analysis with differential forecast weights. For the optimal (worst) forecast combination, this index will minimize (maximize) forecasts errors by combining time-series model based forecasts at a given probability level. By weighting each forecast differently, we find the optimal (worst) forecast combination that does not rely on arbitrary weights. Using two exchange rate series on weekly data for the Japanese Yen/U.S. Dollar and U.S. Dollar/Great Britain Pound for the period from 1975 to 2010 we find that the simple average forecast combination is neither the worst nor the best forecast combination something that provides partial support for the forecast combination puzzle. In that context, the random walk model is the model that consistently contributes with considerably more than an equal weight to the worst forecast combination for all variables being forecasted and for all forecast horizons, whereas a flexible Neural Network autoregressive model and a self-exciting threshold autoregressive model always enter the best forecast combination with much greater than equal weights.

Suggested Citation

  • Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle," Working Paper series 17_12, Rimini Centre for Economic Analysis.
  • Handle: RePEc:rim:rimwps:17_12
    as

    Download full text from publisher

    File URL: http://www.rcea.org/RePEc/pdf/wp17_12.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Clements, Michael P. & Hendry, David F., 2006. "Forecasting with Breaks," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 12, pages 605-657, Elsevier.
    2. Oliver Linton & Esfandiar Maasoumi & Yoon-Jae Whang, 2005. "Consistent Testing for Stochastic Dominance under General Sampling Schemes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 735-765.
    3. De Gooijer, Jan G. & De Bruin, Paul T., 1998. "On forecasting SETAR processes," Statistics & Probability Letters, Elsevier, vol. 37(1), pages 7-14, January.
    4. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    5. Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
    6. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    7. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    8. Scaillet, Olivier & Topaloglou, Nikolas, 2010. "Testing for Stochastic Dominance Efficiency," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(1), pages 169-180.
    9. Graham Elliott & Allan Timmermann, 2005. "Optimal Forecast Combination Under Regime Switching ," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(4), pages 1081-1102, November.
    10. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    11. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521632423, September.
    12. Russell Davidson & Jean-Yves Duclos, 2000. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Econometrica, Econometric Society, vol. 68(6), pages 1435-1464, November.
    13. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    14. Dick van Dijk & Philip Hans Franses & Michael P. Clements & Jeremy Smith, 2003. "On SETAR non-linearity and forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(5), pages 359-375.
    15. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    16. M. S. Al‐Qassam & J. A. Lane, 1989. "Forecasting Exponential Autoregressive Models Of Order 1," Journal of Time Series Analysis, Wiley Blackwell, vol. 10(2), pages 95-113, March.
    17. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    18. Abadie A., 2002. "Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 284-292, March.
    19. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    20. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    21. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    22. Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, Department of Economics and Business Economics, Aarhus University.
    23. White, Halbert, 2006. "Approximate Nonlinear Forecasting Methods," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 9, pages 459-512, Elsevier.
    24. Charles M. Beach & Russell Davidson, 1983. "Distribution-Free Statistical Inference with Lorenz Curves and Income Shares," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 50(4), pages 723-735.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Benjamin Avanzi & Yanfeng Li & Bernard Wong & Alan Xian, 2022. "Ensemble distributional forecasting for insurance loss reserving," Papers 2206.08541, arXiv.org, revised Jun 2024.
    2. Agliardi, Elettra & Pinar, Mehmet & Stengos, Thanasis, 2014. "A sovereign risk index for the Eurozone based on stochastic dominance," Finance Research Letters, Elsevier, vol. 11(4), pages 375-384.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2018. "Quantile forecast combination using stochastic dominance," Empirical Economics, Springer, vol. 55(4), pages 1717-1755, December.
    2. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    3. Antoine Mandel & Amir Sani, 2016. "Learning Time-Varying Forecast Combinations," Documents de travail du Centre d'Economie de la Sorbonne 16036, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    4. Antoine Mandel & Amir Sani, 2017. "A Machine Learning Approach to the Forecast Combination Puzzle," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01317974, HAL.
    5. Ramazan Gencay & Ege Yazgan, 2017. "When Are Wavelets Useful Forecasters?," Working Papers 1704, The Center for Financial Studies (CEFIS), Istanbul Bilgi University.
    6. Mehmet Pinar & Thanasis Stengos & Nikolas Topaloglou, 2013. "Measuring human development: a stochastic dominance approach," Journal of Economic Growth, Springer, vol. 18(1), pages 69-108, March.
    7. Post, Thierry & Karabatı, Selçuk & Arvanitis, Stelios, 2019. "Robust optimization of forecast combinations," International Journal of Forecasting, Elsevier, vol. 35(3), pages 910-926.
    8. Agliardi, Elettra & Agliardi, Rossella & Pinar, Mehmet & Stengos, Thanasis & Topaloglou, Nikolas, 2012. "A new country risk index for emerging markets: A stochastic dominance approach," Journal of Empirical Finance, Elsevier, vol. 19(5), pages 741-761.
    9. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    10. Harun Özkan & M. Yazgan, 2015. "Is forecasting inflation easier under inflation targeting?," Empirical Economics, Springer, vol. 48(2), pages 609-626, March.
    11. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    12. Bec, Frédérique & Mogliani, Matteo, 2015. "Nowcasting French GDP in real-time with surveys and “blocked” regressions: Combining forecasts or pooling information?," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1021-1042.
    13. Xiaojie Xu, 2020. "Corn Cash Price Forecasting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(4), pages 1297-1320, August.
    14. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    15. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    16. Guidolin, Massimo & Timmermann, Allan, 2009. "Forecasts of US short-term interest rates: A flexible forecast combination approach," Journal of Econometrics, Elsevier, vol. 150(2), pages 297-311, June.
    17. Gibbs, Christopher G. & Vasnev, Andrey L., 2024. "Conditionally optimal weights and forward-looking approaches to combining forecasts," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1734-1751.
    18. Prasad S Bhattacharya & Dimitrios D Thomakos, 2011. "Improving forecasting performance by window and model averaging," CAMA Working Papers 2011-05, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    19. Francesco Andreoli, 2018. "Robust Inference for Inverse Stochastic Dominance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 146-159, January.
    20. Sun, Yuying & Hong, Yongmiao & Wang, Shouyang & Zhang, Xinyu, 2023. "Penalized time-varying model averaging," Journal of Econometrics, Elsevier, vol. 235(2), pages 1355-1377.

    More about this item

    Keywords

    Nonparametric Stochastic Dominance; Mixed Integer Programming; Forecast combinations; Forecast combination puzzle;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • G01 - Financial Economics - - General - - - Financial Crises

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rim:rimwps:17_12. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marco Savioli (email available below). General contact details of provider: https://edirc.repec.org/data/rcfeait.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.