A Note on the Validity of Cross-Validation for Evaluating Time Series Prediction
Author
Abstract
Suggested Citation
Download full text from publisher
References listed on IDEAS
- Borra, Simone & Di Ciaccio, Agostino, 2010. "Measuring the prediction error. A comparison of cross-validation, bootstrap and covariance penalty methods," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 2976-2989, December.
- Bergmeir, Christoph & Costantini, Mauro & Benítez, José M., 2014. "On the usefulness of cross-validation for directional forecast evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 132-143.
- Racine, Jeff, 2000. "Consistent cross-validatory model-selection for dependent data: hv-block cross-validation," Journal of Econometrics, Elsevier, vol. 99(1), pages 39-61, November.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Alain Hecq & Luca Margaritella & Stephan Smeekes, 2023.
"Granger Causality Testing in High-Dimensional VARs: A Post-Double-Selection Procedure,"
Journal of Financial Econometrics, Oxford University Press, vol. 21(3), pages 915-958.
- Alain Hecq & Luca Margaritella & Stephan Smeekes, 2019. "Granger Causality Testing in High-Dimensional VARs: a Post-Double-Selection Procedure," Papers 1902.10991, arXiv.org, revised Dec 2020.
- Pinto, Jeronymo Marcondes & Marçal, Emerson Fernandes, 2019. "Cross-validation based forecasting method: a machine learning approach," Textos para discussão 498, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
- Thierry Moudiki & Frédéric Planchet & Areski Cousin, 2018.
"Multiple Time Series Forecasting Using Quasi-Randomized Functional Link Neural Networks,"
Risks, MDPI, vol. 6(1), pages 1-20, March.
- Thierry Moudiki & Frédéric Planchet & Areski Cousin, 2018. "Multiple Time Series Forecasting Using Quasi-Randomized Functional Link Neural Networks," Post-Print hal-02055155, HAL.
- Paolo Maranzano & Alessandro Fassò & Matteo Pelagatti & Manfred Mudelsee, 2020. "Statistical Modeling of the Early-Stage Impact of a New Traffic Policy in Milan, Italy," IJERPH, MDPI, vol. 17(3), pages 1-22, February.
- Ferlito, S. & Adinolfi, G. & Graditi, G., 2017. "Comparative analysis of data-driven methods online and offline trained to the forecasting of grid-connected photovoltaic plant production," Applied Energy, Elsevier, vol. 205(C), pages 116-129.
- Fischer, Thomas & Krauss, Christopher & Treichel, Alex, 2018. "Machine learning for time series forecasting - a simulation study," FAU Discussion Papers in Economics 02/2018, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics.
- Mirakyan, Atom & Meyer-Renschhausen, Martin & Koch, Andreas, 2017. "Composite forecasting approach, application for next-day electricity price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 228-237.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Bergmeir, Christoph & Hyndman, Rob J. & Koo, Bonsoo, 2018. "A note on the validity of cross-validation for evaluating autoregressive time series prediction," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 70-83.
- Mariana Oliveira & Luís Torgo & Vítor Santos Costa, 2021. "Evaluation Procedures for Forecasting with Spatiotemporal Data," Mathematics, MDPI, vol. 9(6), pages 1-27, March.
- Bergmeir, Christoph & Costantini, Mauro & Benítez, José M., 2014. "On the usefulness of cross-validation for directional forecast evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 132-143.
- Pinto, Jeronymo Marcondes & Marçal, Emerson Fernandes, 2019. "Cross-validation based forecasting method: a machine learning approach," Textos para discussão 498, FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil).
- Filip Stanek, 2021. "Optimal Out-of-Sample Forecast Evaluation under Stationarity," CERGE-EI Working Papers wp712, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
- Gary S. Anderson & Alena Audzeyeva, 2019. "A Coherent Framework for Predicting Emerging Market Credit Spreads with Support Vector Regression," Finance and Economics Discussion Series 2019-074, Board of Governors of the Federal Reserve System (U.S.).
- Rama K. Malladi, 2024. "Benchmark Analysis of Machine Learning Methods to Forecast the U.S. Annual Inflation Rate During a High-Decile Inflation Period," Computational Economics, Springer;Society for Computational Economics, vol. 64(1), pages 335-375, July.
- Čížek, Pavel & Koo, Chao Hui, 2021.
"Jump-preserving varying-coefficient models for nonlinear time series,"
Econometrics and Statistics, Elsevier, vol. 19(C), pages 58-96.
- Cizek, Pavel & Koo, Chao, 2017. "Jump-Preserving Varying-Coefficient Models for Nonlinear Time Series," Discussion Paper 2017-017, Tilburg University, Center for Economic Research.
- Cizek, Pavel & Koo, Chao, 2017. "Jump-Preserving Varying-Coefficient Models for Nonlinear Time Series," Other publications TiSEM c849e96f-3ad1-461e-96c6-f, Tilburg University, School of Economics and Management.
- Benjamin Poignard & Manabu Asai, 2023.
"Estimation of high-dimensional vector autoregression via sparse precision matrix,"
The Econometrics Journal, Royal Economic Society, vol. 26(2), pages 307-326.
- Benjamin Poignard & Manabu Asai, 2021. "Estimation of High Dimensional Vector Autoregression via Sparse Precision Matrix," Discussion Papers in Economics and Business 21-03, Osaka University, Graduate School of Economics.
- Pierre Masselot & Fateh Chebana & Taha B. M. J. Ouarda & Diane Bélanger & Pierre Gosselin, 2022. "Data-Enhancement Strategies in Weather-Related Health Studies," IJERPH, MDPI, vol. 19(2), pages 1-13, January.
- Kock, Anders Bredahl & Teräsvirta, Timo, 2014.
"Forecasting performances of three automated modelling techniques during the economic crisis 2007–2009,"
International Journal of Forecasting, Elsevier, vol. 30(3), pages 616-631.
- Anders Bredahl Kock & Timo Teräsvirta, 2011. "Forecasting performance of three automated modelling techniques during the economic crisis 2007-2009," CREATES Research Papers 2011-28, Department of Economics and Business Economics, Aarhus University.
- Abbasabadi, Narjes & Ashayeri, Mehdi & Azari, Rahman & Stephens, Brent & Heidarinejad, Mohammad, 2019. "An integrated data-driven framework for urban energy use modeling (UEUM)," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
- Benjamin Poignard, 2020. "Asymptotic theory of the adaptive Sparse Group Lasso," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(1), pages 297-328, February.
- Costantini, Mauro & Cuaresma, Jesus Crespo & Hlouskova, Jaroslava, 2014.
"Can Macroeconomists Get Rich Forecasting Exchange Rates?,"
Economics Series
305, Institute for Advanced Studies.
- Costantini, Mauro & Crespo Cuaresma, Jesus & Hlouskova, Jaroslava, 2014. "Can Macroeconomists Get Rich Forecasting Exchange Rates?," Department of Economics Working Paper Series 176, WU Vienna University of Economics and Business.
- Jesus Crespo Cuaresma & Mauro Costantini & Jaroslava Hlouskova, 2014. "Can Macroeconomists Get Rich Forecasting Exchange Rates?," Department of Economics Working Papers wuwp176, Vienna University of Economics and Business, Department of Economics.
- Evangelos Spiliotis & Fotios Petropoulos & Vassilios Assimakopoulos, 2023. "On the Disagreement of Forecasting Model Selection Criteria," Forecasting, MDPI, vol. 5(2), pages 1-12, June.
- Exterkate, Peter & Groenen, Patrick J.F. & Heij, Christiaan & van Dijk, Dick, 2016.
"Nonlinear forecasting with many predictors using kernel ridge regression,"
International Journal of Forecasting, Elsevier, vol. 32(3), pages 736-753.
- Peter Exterkate & Patrick J.F. Groenen & Christiaan Heij & Dick van Dijk, 2011. "Nonlinear Forecasting with Many Predictors using Kernel Ridge Regression," Tinbergen Institute Discussion Papers 11-007/4, Tinbergen Institute.
- Peter Exterkate & Patrick J.F. Groenen & Christiaan Heij & Dick van Dijk, 2013. "Nonlinear Forecasting With Many Predictors Using Kernel Ridge Regression," CREATES Research Papers 2013-16, Department of Economics and Business Economics, Aarhus University.
- Vrontos, Spyridon D. & Galakis, John & Vrontos, Ioannis D., 2021. "Modeling and predicting U.S. recessions using machine learning techniques," International Journal of Forecasting, Elsevier, vol. 37(2), pages 647-671.
- Massimiliano Caporin & Francesco Poli, 2017. "Building News Measures from Textual Data and an Application to Volatility Forecasting," Econometrics, MDPI, vol. 5(3), pages 1-46, August.
- Tibor Szendrei & Arnab Bhattacharjee & Mark E. Schaffer, 2024. "MIDAS-QR with 2-Dimensional Structure," Papers 2406.15157, arXiv.org.
- Liu, Yang & Swanson, Norman R., 2024. "An assessment of the marginal predictive content of economic uncertainty indexes and business conditions predictors," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1391-1409.
More about this item
Keywords
cross-validation; time series; auto regression.;All these keywords.
JEL classification:
- C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
NEP fields
This paper has been announced in the following NEP Reports:- NEP-ECM-2015-05-02 (Econometrics)
- NEP-ETS-2015-05-02 (Econometric Time Series)
- NEP-FOR-2015-05-02 (Forecasting)
- NEP-ORE-2015-05-02 (Operations Research)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2015-10. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.