IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/10168.html
   My bibliography  Save this paper

Window Selection for Out-of-Sample Forecasting with Time-Varying Parameters

Author

Listed:
  • Rossi, Barbara
  • Inoue, Atsushi
  • Jin, Lu

Abstract

While forecasting is a common practice in academia, government and business alike, practitioners are often left wondering how to choose the sample for estimating forecasting models. When we forecast inflation in 2014, for example, should we use the last 30 years of data or the last 10 years of data? There is strong evidence of structural changes in economic time series, and the forecasting performance is often quite sensitive to the choice of such window size. In this paper, we develop a novel method for selecting the estimation window size for forecasting. Specifically, we propose to choose the optimal window size that minimizes the forecaster's quadratic loss function, and we prove the asymptotic validity of our approach. Our Monte Carlo experiments show that our method performs quite well under various types of structural changes. When applied to forecasting US real output growth and inflation, the proposed method tends to improve upon conventional methods.

Suggested Citation

  • Rossi, Barbara & Inoue, Atsushi & Jin, Lu, 2014. "Window Selection for Out-of-Sample Forecasting with Time-Varying Parameters," CEPR Discussion Papers 10168, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:10168
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP10168
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    4. Raffaella Giacomini & Barbara Rossi, 2009. "Detecting and Predicting Forecast Breakdowns," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(2), pages 669-705.
    5. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037.
    6. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    7. Domenico Ferraro & Kenneth S. Rogoff & Barbara Rossi, 2011. "Can oil prices forecast exchange rates?," Working Papers 11-34, Federal Reserve Bank of Philadelphia.
    8. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    9. Abadir,Karim M. & Magnus,Jan R., 2005. "Matrix Algebra," Cambridge Books, Cambridge University Press, number 9780521537469, September.
    10. Cai, Zongwu, 2007. "Trending time-varying coefficient time series models with serially correlated errors," Journal of Econometrics, Elsevier, vol. 136(1), pages 163-188, January.
    11. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    12. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    13. Giraitis, Liudas & Kapetanios, George & Price, Simon, 2013. "Adaptive forecasting in the presence of recent and ongoing structural change," Journal of Econometrics, Elsevier, vol. 177(2), pages 153-170.
    14. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    15. Bin Chen & Yongmiao Hong, 2012. "Testing for Smooth Structural Changes in Time Series Models via Nonparametric Regression," Econometrica, Econometric Society, vol. 80(3), pages 1157-1183, May.
    16. Amit Goyal & Ivo Welch, 2003. "Predicting the Equity Premium with Dividend Ratios," Management Science, INFORMS, vol. 49(5), pages 639-654, May.
    17. Schinasi, Garry J. & Swamy, P. A. V. B., 1989. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," Journal of International Money and Finance, Elsevier, vol. 8(3), pages 375-390, September.
    18. Swanson, Norman R., 1998. "Money and output viewed through a rolling window," Journal of Monetary Economics, Elsevier, vol. 41(3), pages 455-474, May.
    19. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    20. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    21. Stock, James H & Watson, Mark W, 1996. "Evidence on Structural Instability in Macroeconomic Time Series Relations," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(1), pages 11-30, January.
    22. Atsushi Inoue & Barbara Rossi, 2011. "Identifying the Sources of Instabilities in Macroeconomic Fluctuations," The Review of Economics and Statistics, MIT Press, vol. 93(4), pages 1186-1204, November.
    23. Pesaran, M. Hashem & Pick, Andreas & Pranovich, Mikhail, 2013. "Optimal forecasts in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 177(2), pages 134-152.
    24. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    25. Molodtsova, Tanya & Papell, David H., 2009. "Out-of-sample exchange rate predictability with Taylor rule fundamentals," Journal of International Economics, Elsevier, vol. 77(2), pages 167-180, April.
    26. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    27. repec:cup:cbooks:9780521822893 is not listed on IDEAS
    28. Marron, James Stephen & Härdle, Wolfgang, 1986. "Random approximations to some measures of accuracy in nonparametric curve estimation," Journal of Multivariate Analysis, Elsevier, vol. 20(1), pages 91-113, October.
    29. Lu, Zudi & Linton, Oliver, 2007. "Local Linear Fitting Under Near Epoch Dependence," Econometric Theory, Cambridge University Press, vol. 23(1), pages 37-70, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiu Xu & Andrija Mihoci & Wolfgang Karl Hardle, 2020. "lCARE -- localizing Conditional AutoRegressive Expectiles," Papers 2009.13215, arXiv.org.
    2. Fernando Fernández-Rodríguez & Marta Gómez-Puig & Simón Sosvilla-Rivero, 2015. "“Financial stress transmission in EMU sovereign bond market volatility: a connectedness analysis”," IREA Working Papers 201508, University of Barcelona, Research Institute of Applied Economics, revised Jan 2015.
    3. Tan, Xueping & Sirichand, Kavita & Vivian, Andrew & Wang, Xinyu, 2020. "How connected is the carbon market to energy and financial markets? A systematic analysis of spillovers and dynamics," Energy Economics, Elsevier, vol. 90(C).
    4. Fernández-Rodríguez, Fernando & Gómez-Puig, Marta & Sosvilla-Rivero, Simón, 2015. "Volatility spillovers in EMU sovereign bond markets," International Review of Economics & Finance, Elsevier, vol. 39(C), pages 337-352.
    5. Xu, Xiu & Mihoci, Andrija & Härdle, Wolfgang Karl, 2018. "lCARE - localizing conditional autoregressive expectiles," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 198-220.
    6. Mehmet Sahiner, 2022. "Forecasting volatility in Asian financial markets: evidence from recursive and rolling window methods," SN Business & Economics, Springer, vol. 2(10), pages 1-74, October.
    7. repec:hum:wpaper:sfb649dp2015-052 is not listed on IDEAS
    8. Mariia Artemova & Francisco Blasques & Siem Jan Koopman & Zhaokun Zhang, 2021. "Forecasting in a changing world: from the great recession to the COVID-19 pandemic," Tinbergen Institute Discussion Papers 21-006/III, Tinbergen Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Inoue, Atsushi & Jin, Lu & Rossi, Barbara, 2017. "Rolling window selection for out-of-sample forecasting with time-varying parameters," Journal of Econometrics, Elsevier, vol. 196(1), pages 55-67.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Mariia Artemova & Francisco Blasques & Siem Jan Koopman & Zhaokun Zhang, 2021. "Forecasting in a changing world: from the great recession to the COVID-19 pandemic," Tinbergen Institute Discussion Papers 21-006/III, Tinbergen Institute.
    4. Yin, Anwen, 2015. "Forecasting and model averaging with structural breaks," ISU General Staff Papers 201501010800005727, Iowa State University, Department of Economics.
    5. Yousuf, Kashif & Ng, Serena, 2021. "Boosting high dimensional predictive regressions with time varying parameters," Journal of Econometrics, Elsevier, vol. 224(1), pages 60-87.
    6. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    7. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    8. Graham Elliott & Allan Timmermann, 2016. "Forecasting in Economics and Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 81-110, October.
    9. Nicolás Magner & Nicolás Hardy, 2022. "Cryptocurrency Forecasting: More Evidence of the Meese-Rogoff Puzzle," Mathematics, MDPI, vol. 10(13), pages 1-27, July.
    10. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    11. Hännikäinen Jari, 2017. "Selection of an Estimation Window in the Presence of Data Revisions and Recent Structural Breaks," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-22, January.
    12. Raffaella Giacomini & Barbara Rossi, 2015. "Forecasting in Nonstationary Environments: What Works and What Doesn't in Reduced-Form and Structural Models," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 207-229, August.
    13. Stephen G. Hall & George S. Tavlas & Yongli Wang, 2023. "Forecasting inflation: The use of dynamic factor analysis and nonlinear combinations," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(3), pages 514-529, April.
    14. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    15. Boot, Tom & Pick, Andreas, 2020. "Does modeling a structural break improve forecast accuracy?," Journal of Econometrics, Elsevier, vol. 215(1), pages 35-59.
    16. Koo, Bonsoo & Seo, Myung Hwan, 2015. "Structural-break models under mis-specification: Implications for forecasting," Journal of Econometrics, Elsevier, vol. 188(1), pages 166-181.
    17. Rossi, Barbara, 2006. "Are Exchange Rates Really Random Walks? Some Evidence Robust To Parameter Instability," Macroeconomic Dynamics, Cambridge University Press, vol. 10(1), pages 20-38, February.
    18. Ahmed, Shamim & Liu, Xiaoquan & Valente, Giorgio, 2016. "Can currency-based risk factors help forecast exchange rates?," International Journal of Forecasting, Elsevier, vol. 32(1), pages 75-97.
    19. Barbara Rossi & Atsushi Inoue, 2012. "Out-of-Sample Forecast Tests Robust to the Choice of Window Size," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 432-453, April.
    20. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.

    More about this item

    Keywords

    Forecasting; Gdp growth; inflation; Instabilities; Structural change;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:10168. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.