IDEAS home Printed from https://ideas.repec.org/a/taf/gnstxx/v24y2012i2p269-282.html
   My bibliography  Save this article

Generalised correlated cross-validation

Author

Listed:
  • Patrick Carmack
  • Jeffrey Spence
  • William Schucany

Abstract

Since its introduction by [Stone, M. (1974), ‘Cross-validatory Choice and the Assessment of Statistical Predictions (with discussion)’, Journal of the Royal Statistical Society, B36, 111–133] and [Geisser, S. (1975), ‘The Predictive Sample Reuse Method with Applications’, Journal of the American Statistical Association, 70, 320–328], cross-validation has been studied and improved by several authors including [Burman, P., Chow, E., and Nolan, D. (1994), ‘A Cross-validatory Method for Dependent Data’, Biometrika, 81(2), 351–358], [Hart, J. and Yi, S. (1998), ‘One-sided Cross-validation’, Journal of the American Statistical Association, 93(442), 620–630], [Racine, J. (2000), ‘Consistent Cross-validatory Model-selection for Dependent Data: hv-block Cross-validation’, Journal of Econometrics, 99, 39–61], [Hart, J. and Lee, C. (2005), ‘Robustness of One-sided Cross-validation to Autocorrelation’, Journal of Multivariate Analysis, 92(1), 77–96], and [Carmack, P., Spence, J., Schucany, W., Gunst, R., Lin, Q., and Haley, R. (2009), ‘Far Casting Cross Validation’, Journal of Computational and Graphical Statistics, 18(4), 879–893]. Perhaps the most widely used and best known is generalised cross-validation (GCV) [Craven, P. and Wahba, G. (1979), ‘Smoothing Noisy Data with Spline Functions’, Numerical Mathematics, 31, 377–403], which establishes a single-pass method that penalises the fit by the trace of the smoother matrix assuming independent errors. We propose an extension to GCV in the context of correlated errors, which is motivated by a natural definition for residual degrees of freedom. The efficacy of the new method is investigated with a simulation experiment on a kernel smoother with bandwidth selection in local linear regression. Next, the winning methodology is illustrated by application to spatial modelling of fMRI data using a nonparametric semivariogram. We conclude with remarks about the heteroscedastic case and a potential maximum likelihood framework for Gaussian random processes.

Suggested Citation

  • Patrick Carmack & Jeffrey Spence & William Schucany, 2012. "Generalised correlated cross-validation," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(2), pages 269-282.
    • Handle: RePEc:taf:gnstxx:v:24:y:2012:i:2:p:269-282
    DOI: 10.1080/10485252.2012.655733
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/10485252.2012.655733
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/10485252.2012.655733?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Spence, Jeffrey S. & Carmack, Patrick S. & Gunst, Richard F. & Schucany, William R. & Woodward, Wayne A. & Haley, Robert W., 2007. "Accounting for Spatial Dependence in the Analysis of SPECT Brain Imaging Data," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 464-473, June.
    2. Hart, Jeffrey D. & Lee, Cherng-Luen, 2005. "Robustness of one-sided cross-validation to autocorrelation," Journal of Multivariate Analysis, Elsevier, vol. 92(1), pages 77-96, January.
    3. Stewart, T. & Strijbosch, L.W.G. & Moors, J.J.A. & van Batenburg, P., 2007. "A Simple Approximation to the Convolution of Gamma Distributions (Revision of DP 2006-27)," Discussion Paper 2007-70, Tilburg University, Center for Economic Research.
    4. Racine, Jeff, 2000. "Consistent cross-validatory model-selection for dependent data: hv-block cross-validation," Journal of Econometrics, Elsevier, vol. 99(1), pages 39-61, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yoonsuh Jung, 2018. "Multiple predicting K-fold cross-validation for model selection," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 30(1), pages 197-215, January.
    2. Liu, Sisheng & Kong, Xiaoli, 2022. "A generalized correlated Cp criterion for derivative estimation with dependent errors," Computational Statistics & Data Analysis, Elsevier, vol. 171(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mariana Oliveira & Luís Torgo & Vítor Santos Costa, 2021. "Evaluation Procedures for Forecasting with Spatiotemporal Data," Mathematics, MDPI, vol. 9(6), pages 1-27, March.
    2. Gary S. Anderson & Alena Audzeyeva, 2019. "A Coherent Framework for Predicting Emerging Market Credit Spreads with Support Vector Regression," Finance and Economics Discussion Series 2019-074, Board of Governors of the Federal Reserve System (U.S.).
    3. Rama K. Malladi, 2024. "Benchmark Analysis of Machine Learning Methods to Forecast the U.S. Annual Inflation Rate During a High-Decile Inflation Period," Computational Economics, Springer;Society for Computational Economics, vol. 64(1), pages 335-375, July.
    4. Čížek, Pavel & Koo, Chao Hui, 2021. "Jump-preserving varying-coefficient models for nonlinear time series," Econometrics and Statistics, Elsevier, vol. 19(C), pages 58-96.
    5. Benjamin Poignard & Manabu Asai, 2023. "Estimation of high-dimensional vector autoregression via sparse precision matrix," The Econometrics Journal, Royal Economic Society, vol. 26(2), pages 307-326.
    6. Pierre Masselot & Fateh Chebana & Taha B. M. J. Ouarda & Diane Bélanger & Pierre Gosselin, 2022. "Data-Enhancement Strategies in Weather-Related Health Studies," IJERPH, MDPI, vol. 19(2), pages 1-13, January.
    7. Kock, Anders Bredahl & Teräsvirta, Timo, 2014. "Forecasting performances of three automated modelling techniques during the economic crisis 2007–2009," International Journal of Forecasting, Elsevier, vol. 30(3), pages 616-631.
    8. Bergmeir, Christoph & Costantini, Mauro & Benítez, José M., 2014. "On the usefulness of cross-validation for directional forecast evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 132-143.
    9. Benjamin Poignard, 2020. "Asymptotic theory of the adaptive Sparse Group Lasso," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(1), pages 297-328, February.
    10. Evangelos Spiliotis & Fotios Petropoulos & Vassilios Assimakopoulos, 2023. "On the Disagreement of Forecasting Model Selection Criteria," Forecasting, MDPI, vol. 5(2), pages 1-12, June.
    11. Exterkate, Peter & Groenen, Patrick J.F. & Heij, Christiaan & van Dijk, Dick, 2016. "Nonlinear forecasting with many predictors using kernel ridge regression," International Journal of Forecasting, Elsevier, vol. 32(3), pages 736-753.
    12. Massimiliano Caporin & Francesco Poli, 2017. "Building News Measures from Textual Data and an Application to Volatility Forecasting," Econometrics, MDPI, vol. 5(3), pages 1-46, August.
    13. Tibor Szendrei & Arnab Bhattacharjee & Mark E. Schaffer, 2024. "MIDAS-QR with 2-Dimensional Structure," Papers 2406.15157, arXiv.org.
    14. Nadja Bodner & Laura Bringmann & Francis Tuerlinckx & Peter Jonge & Eva Ceulemans, 2022. "ConNEcT: A Novel Network Approach for Investigating the Co-occurrence of Binary Psychopathological Symptoms Over Time," Psychometrika, Springer;The Psychometric Society, vol. 87(1), pages 107-132, March.
    15. Xiaolu Wei & Hongbing Ouyang, 2023. "Forecasting Carbon Price Using Double Shrinkage Methods," IJERPH, MDPI, vol. 20(2), pages 1-20, January.
    16. María Luz Gámiz & Enno Mammen & María Dolores Martínez Miranda & Jens Perch Nielsen, 2016. "Double one-sided cross-validation of local linear hazards," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(4), pages 755-779, September.
    17. Benjamin Poignard & Manabu Asai, 2023. "High‐dimensional sparse multivariate stochastic volatility models," Journal of Time Series Analysis, Wiley Blackwell, vol. 44(1), pages 4-22, January.
    18. José-María Montero & Coro Chasco & Beatriz Larraz, 2010. "Building an environmental quality index for a big city: a spatial interpolation approach combined with a distance indicator," Journal of Geographical Systems, Springer, vol. 12(4), pages 435-459, December.
    19. Brownlees, Christian T. & Gallo, Giampiero M., 2011. "Shrinkage estimation of semiparametric multiplicative error models," International Journal of Forecasting, Elsevier, vol. 27(2), pages 365-378.
    20. González Andrés & Teräsvirta Timo, 2008. "Modelling Autoregressive Processes with a Shifting Mean," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 12(1), pages 1-28, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:gnstxx:v:24:y:2012:i:2:p:269-282. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/GNST20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.