IDEAS home Printed from https://ideas.repec.org/a/taf/gnstxx/v24y2012i2p269-282.html
   My bibliography  Save this article

Generalised correlated cross-validation

Author

Listed:
  • Patrick Carmack
  • Jeffrey Spence
  • William Schucany

Abstract

Since its introduction by [Stone, M. (1974), ‘Cross-validatory Choice and the Assessment of Statistical Predictions (with discussion)’, Journal of the Royal Statistical Society, B36, 111–133] and [Geisser, S. (1975), ‘The Predictive Sample Reuse Method with Applications’, Journal of the American Statistical Association, 70, 320–328], cross-validation has been studied and improved by several authors including [Burman, P., Chow, E., and Nolan, D. (1994), ‘A Cross-validatory Method for Dependent Data’, Biometrika, 81(2), 351–358], [Hart, J. and Yi, S. (1998), ‘One-sided Cross-validation’, Journal of the American Statistical Association, 93(442), 620–630], [Racine, J. (2000), ‘Consistent Cross-validatory Model-selection for Dependent Data: hv-block Cross-validation’, Journal of Econometrics, 99, 39–61], [Hart, J. and Lee, C. (2005), ‘Robustness of One-sided Cross-validation to Autocorrelation’, Journal of Multivariate Analysis, 92(1), 77–96], and [Carmack, P., Spence, J., Schucany, W., Gunst, R., Lin, Q., and Haley, R. (2009), ‘Far Casting Cross Validation’, Journal of Computational and Graphical Statistics, 18(4), 879–893]. Perhaps the most widely used and best known is generalised cross-validation (GCV) [Craven, P. and Wahba, G. (1979), ‘Smoothing Noisy Data with Spline Functions’, Numerical Mathematics, 31, 377–403], which establishes a single-pass method that penalises the fit by the trace of the smoother matrix assuming independent errors. We propose an extension to GCV in the context of correlated errors, which is motivated by a natural definition for residual degrees of freedom. The efficacy of the new method is investigated with a simulation experiment on a kernel smoother with bandwidth selection in local linear regression. Next, the winning methodology is illustrated by application to spatial modelling of fMRI data using a nonparametric semivariogram. We conclude with remarks about the heteroscedastic case and a potential maximum likelihood framework for Gaussian random processes.

Suggested Citation

  • Patrick Carmack & Jeffrey Spence & William Schucany, 2012. "Generalised correlated cross-validation," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(2), pages 269-282.
    • Handle: RePEc:taf:gnstxx:v:24:y:2012:i:2:p:269-282
    DOI: 10.1080/10485252.2012.655733
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/10485252.2012.655733
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/10485252.2012.655733?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stewart, T. & Strijbosch, L.W.G. & Moors, J.J.A. & van Batenburg, P., 2007. "A Simple Approximation to the Convolution of Gamma Distributions (Revision of DP 2006-27)," Discussion Paper 2007-70, Tilburg University, Center for Economic Research.
    2. Spence, Jeffrey S. & Carmack, Patrick S. & Gunst, Richard F. & Schucany, William R. & Woodward, Wayne A. & Haley, Robert W., 2007. "Accounting for Spatial Dependence in the Analysis of SPECT Brain Imaging Data," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 464-473, June.
    3. Hart, Jeffrey D. & Lee, Cherng-Luen, 2005. "Robustness of one-sided cross-validation to autocorrelation," Journal of Multivariate Analysis, Elsevier, vol. 92(1), pages 77-96, January.
    4. Racine, Jeff, 2000. "Consistent cross-validatory model-selection for dependent data: hv-block cross-validation," Journal of Econometrics, Elsevier, vol. 99(1), pages 39-61, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yoonsuh Jung, 2018. "Multiple predicting K-fold cross-validation for model selection," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 30(1), pages 197-215, January.
    2. Liu, Sisheng & Kong, Xiaoli, 2022. "A generalized correlated Cp criterion for derivative estimation with dependent errors," Computational Statistics & Data Analysis, Elsevier, vol. 171(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gary S. Anderson & Alena Audzeyeva, 2019. "A Coherent Framework for Predicting Emerging Market Credit Spreads with Support Vector Regression," Finance and Economics Discussion Series 2019-074, Board of Governors of the Federal Reserve System (U.S.).
    2. Kock, Anders Bredahl & Teräsvirta, Timo, 2014. "Forecasting performances of three automated modelling techniques during the economic crisis 2007–2009," International Journal of Forecasting, Elsevier, vol. 30(3), pages 616-631.
    3. Čížek, Pavel & Koo, Chao Hui, 2021. "Jump-preserving varying-coefficient models for nonlinear time series," Econometrics and Statistics, Elsevier, vol. 19(C), pages 58-96.
    4. Evangelos Spiliotis & Fotios Petropoulos & Vassilios Assimakopoulos, 2023. "On the Disagreement of Forecasting Model Selection Criteria," Forecasting, MDPI, vol. 5(2), pages 1-12, June.
    5. Benjamin Poignard & Manabu Asai, 2023. "High‐dimensional sparse multivariate stochastic volatility models," Journal of Time Series Analysis, Wiley Blackwell, vol. 44(1), pages 4-22, January.
    6. José-María Montero & Coro Chasco & Beatriz Larraz, 2010. "Building an environmental quality index for a big city: a spatial interpolation approach combined with a distance indicator," Journal of Geographical Systems, Springer, vol. 12(4), pages 435-459, December.
    7. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    8. Cheng, Mingmian & Swanson, Norman R. & Yang, Xiye, 2021. "Forecasting volatility using double shrinkage methods," Journal of Empirical Finance, Elsevier, vol. 62(C), pages 46-61.
    9. Bergmeir, Christoph & Hyndman, Rob J. & Koo, Bonsoo, 2018. "A note on the validity of cross-validation for evaluating autoregressive time series prediction," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 70-83.
    10. González Andrés & Teräsvirta Timo, 2008. "Modelling Autoregressive Processes with a Shifting Mean," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 12(1), pages 1-28, March.
    11. Pinto, Jeronymo Marcondes & Marçal, Emerson Fernandes, 2019. "Cross-validation based forecasting method: a machine learning approach," Textos para discussão 498, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
    12. Scholz, Michael & Nielsen, Jens Perch & Sperlich, Stefan, 2015. "Nonparametric prediction of stock returns based on yearly data: The long-term view," Insurance: Mathematics and Economics, Elsevier, vol. 65(C), pages 143-155.
    13. Olga Y. Savchuk & Jeffrey D. Hart, 2017. "Fully robust one-sided cross-validation for regression functions," Computational Statistics, Springer, vol. 32(3), pages 1003-1025, September.
    14. Kulaksizoglu, Tamer, 2015. "Measuring the Core Inflation in Turkey with the SM-AR Model," MPRA Paper 62653, University Library of Munich, Germany.
    15. Adriano Koshiyama & Nick Firoozye & Philip Treleaven, 2021. "Generative adversarial networks for financial trading strategies fine-tuning and combination," Quantitative Finance, Taylor & Francis Journals, vol. 21(5), pages 797-813, May.
    16. Filip Stanek, 2021. "Optimal Out-of-Sample Forecast Evaluation under Stationarity," CERGE-EI Working Papers wp712, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    17. Gámiz Pérez, M. Luz & Martínez Miranda, María Dolores & Nielsen, Jens Perch, 2013. "Smoothing survival densities in practice," Computational Statistics & Data Analysis, Elsevier, vol. 58(C), pages 368-382.
    18. Deng, Ai, 2023. "Time series cross validation: A theoretical result and finite sample performance," Economics Letters, Elsevier, vol. 233(C).
    19. Carmack, Patrick S. & Spence, Jeffrey S. & Schucany, William R. & Gunst, Richard F. & Lin, Qihua & Haley, Robert W., 2012. "A new class of semiparametric semivariogram and nugget estimators," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1737-1747.
    20. Benjamin Poignard & Manabu Asaiz, 2020. "A Penalised OLS Framework for High-Dimensional Multivariate Stochastic Volatility Models," Discussion Papers in Economics and Business 20-02, Osaka University, Graduate School of Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:gnstxx:v:24:y:2012:i:2:p:269-282. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/GNST20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.