IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/11-16.html
   My bibliography  Save this paper

Possibly Nonstationary Cross-Validation

Author

Listed:
  • Federico M Bandi

    (Institute for Fiscal Studies)

  • Valentina Corradi

    (Institute for Fiscal Studies)

  • Daniel Wilhelm

    (Institute for Fiscal Studies and University College London)

Abstract

Cross-validation is the most common data-driven procedure for choosing smoothing parameters in nonparametric regression. For the case of kernel estimators with iid or strong mixing data, it is well-known that the bandwidth chosen by crossvalidation is optimal with respect to the average squared error and other performance measures. In this paper, we show that the cross-validated bandwidth continues to be optimal with respect to the average squared error even when the datagenerating process is a -recurrent Markov chain. This general class of processes covers stationary as well as nonstationary Markov chains. Hence, the proposed procedure adapts to the degree of recurrence, thereby freeing the researcher from the need to assume stationary (or nonstationary) before inference begins. We study finite sample performance in a Monte Carlo study. We conclude by demonstrating the practical usefulness of cross-validation in a highly-persistent environment, namely that of nonlinear predictive systems for market returns.

Suggested Citation

  • Federico M Bandi & Valentina Corradi & Daniel Wilhelm, 2016. "Possibly Nonstationary Cross-Validation," CeMMAP working papers CWP11/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    • Handle: RePEc:ifs:cemmap:11/16
    as

    Download full text from publisher

    File URL: https://www.ifs.org.uk/uploads/cemmap/wps/cwp111616.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yakowitz, Sidney, 1989. "Nonparametric density and regression estimation for Markov sequences without mixing assumptions," Journal of Multivariate Analysis, Elsevier, vol. 30(1), pages 124-136, July.
    2. Kwiatkowski, Denis & Phillips, Peter C. B. & Schmidt, Peter & Shin, Yongcheol, 1992. "Testing the null hypothesis of stationarity against the alternative of a unit root : How sure are we that economic time series have a unit root?," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 159-178.
    3. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," The Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    4. Jeff Fleming & Chris Kirby & Barbara Ostdiek, 2001. "The Economic Value of Volatility Timing," Journal of Finance, American Finance Association, vol. 56(1), pages 329-352, February.
    5. Xia, Yingcun & Li, W. K., 2002. "Asymptotic Behavior of Bandwidth Selected by the Cross-Validation Method for Local Polynomial Fitting," Journal of Multivariate Analysis, Elsevier, vol. 83(2), pages 265-287, November.
    6. Lewellen, Jonathan, 2004. "Predicting returns with financial ratios," Journal of Financial Economics, Elsevier, vol. 74(2), pages 209-235, November.
    7. Gao, Jiti & Kanaya, Shin & Li, Degui & Tjøstheim, Dag, 2015. "Uniform Consistency For Nonparametric Estimators In Null Recurrent Time Series," Econometric Theory, Cambridge University Press, vol. 31(5), pages 911-952, October.
    8. Tae Yoon Kim & Dennis D. Cox, 1996. "Bandwidth Selection In Kernel Smoothing Of Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 17(1), pages 49-63, January.
    9. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    10. Qiying Wang & Peter C. B. Phillips, 2009. "Structural Nonparametric Cointegrating Regression," Econometrica, Econometric Society, vol. 77(6), pages 1901-1948, November.
    11. P. M. Robinson, 1983. "Nonparametric Estimators For Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 4(3), pages 185-207, May.
    12. Wolfgang Härdle & Philippe Vieu, 1992. "Kernel Regression Smoothing Of Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 13(3), pages 209-232, May.
    13. Emmanuel Guerre, 2004. "Design-Adaptive Pointwise Nonparametric Regression Estimation for Recurrent Markov Time Series," Working Papers 2004-22, Center for Research in Economics and Statistics.
    14. Paul D. Feigin & Richard L. Tweedie, 1985. "Random Coefficient Autoregressive Processes:A Markov Chain Analysis Of Stationarity And Finiteness Of Moments," Journal of Time Series Analysis, Wiley Blackwell, vol. 6(1), pages 1-14, January.
    15. Valkanov, Rossen, 2003. "Long-horizon regressions: theoretical results and applications," Journal of Financial Economics, Elsevier, vol. 68(2), pages 201-232, May.
    16. Cavanagh, Christopher L. & Elliott, Graham & Stock, James H., 1995. "Inference in Models with Nearly Integrated Regressors," Econometric Theory, Cambridge University Press, vol. 11(5), pages 1131-1147, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Scholz, Michael & Sperlich, Stefan & Nielsen, Jens Perch, 2016. "Nonparametric long term prediction of stock returns with generated bond yields," Insurance: Mathematics and Economics, Elsevier, vol. 69(C), pages 82-96.
    2. Ioannis Kyriakou & Parastoo Mousavi & Jens Perch Nielsen & Michael Scholz, 2021. "Forecasting benchmarks of long-term stock returns via machine learning," Annals of Operations Research, Springer, vol. 297(1), pages 221-240, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Federico M Bandi & Valentina Corradi & Daniel Wilhelm, 2016. "Possibly Nonstationary Cross-Validation," CeMMAP working papers 11/16, Institute for Fiscal Studies.
    2. Jiang, Xiaoquan & Lee, Bong-Soo, 2007. "Stock returns, dividend yield, and book-to-market ratio," Journal of Banking & Finance, Elsevier, vol. 31(2), pages 455-475, February.
    3. Maynard, Alex & Shimotsu, Katsumi, 2009. "Covariance-Based Orthogonality Tests For Regressors With Unknown Persistence," Econometric Theory, Cambridge University Press, vol. 25(1), pages 63-116, February.
    4. Lawrenz, Jochen & Zorn, Josef, 2017. "Predicting international stock returns with conditional price-to-fundamental ratios," Journal of Empirical Finance, Elsevier, vol. 43(C), pages 159-184.
    5. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    6. John Y. Campbell, 2008. "Viewpoint: Estimating the equity premium," Canadian Journal of Economics, Canadian Economics Association, vol. 41(1), pages 1-21, February.
    7. Andersen, Torben G. & Varneskov, Rasmus T., 2021. "Consistent inference for predictive regressions in persistent economic systems," Journal of Econometrics, Elsevier, vol. 224(1), pages 215-244.
    8. Giot, Pierre & Petitjean, Mikael, 2007. "The information content of the Bond-Equity Yield Ratio: Better than a random walk?," International Journal of Forecasting, Elsevier, vol. 23(2), pages 289-305.
    9. Paulo M.M. Rodrigues & Antonio Rubia, 2011. "A Class of Robust Tests in Augmented Predictive Regressions," Working Papers w201126, Banco de Portugal, Economics and Research Department.
    10. repec:grz:wpaper:2012-02 is not listed on IDEAS
    11. Demetrescu, Matei & Rodrigues, Paulo M.M. & Taylor, A.M. Robert, 2023. "Transformed regression-based long-horizon predictability tests," Journal of Econometrics, Elsevier, vol. 237(2).
    12. Maio, Paulo & Xu, Danielle, 2020. "Cash-flow or return predictability at long horizons? The case of earnings yield," Journal of Empirical Finance, Elsevier, vol. 59(C), pages 172-192.
    13. Michael Frömmel & Robinson Kruse, 2012. "Testing for a rational bubble under long memory," Quantitative Finance, Taylor & Francis Journals, vol. 12(11), pages 1723-1732, November.
    14. Erik Hjalmarsson, 2006. "Inference in Long-Horizon Regressions," International Finance Discussion Papers 853, Board of Governors of the Federal Reserve System (U.S.).
    15. Barnhart, Scott W. & Giannetti, Antoine, 2009. "Negative earnings, positive earnings and stock return predictability: An empirical examination of market timing," Journal of Empirical Finance, Elsevier, vol. 16(1), pages 70-86, January.
    16. Chiquoine, Benjamin & Hjalmarsson, Erik, 2009. "Jackknifing stock return predictions," Journal of Empirical Finance, Elsevier, vol. 16(5), pages 793-803, December.
    17. Fong, Wai Mun, 2012. "Do expected business conditions explain the value premium?," Journal of Financial Markets, Elsevier, vol. 15(2), pages 181-206.
    18. repec:wyi:journl:002108 is not listed on IDEAS
    19. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    20. Maio, Paulo & Santa-Clara, Pedro, 2012. "Multifactor models and their consistency with the ICAPM," Journal of Financial Economics, Elsevier, vol. 106(3), pages 586-613.
    21. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    22. Engsted, Tom & Pedersen, Thomas Q., 2010. "The dividend-price ratio does predict dividend growth: International evidence," Journal of Empirical Finance, Elsevier, vol. 17(4), pages 585-605, September.

    More about this item

    Keywords

    Bandwidth Selection; Recurrence; Predictive Regressions;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:11/16. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.