IDEAS home Printed from https://ideas.repec.org/a/bla/stanee/v69y2015i4p510-540.html
   My bibliography  Save this article

Estimating the Kullback–Liebler risk based on multifold cross-validation

Author

Listed:
  • Paolo Vidoni

Abstract

type="main" xml:id="stan12070-abs-0001"> This paper concerns a class of model selection criteria based on cross-validation techniques and estimative predictive densities. Both the simple or leave-one-out and the multifold or leave-m-out cross-validation procedures are considered. These cross-validation criteria define suitable estimators for the expected Kullback–Liebler risk, which measures the expected discrepancy between the fitted candidate model and the true one. In particular, we shall investigate the potential bias of these estimators, under alternative asymptotic regimes for m. The results are obtained within the general context of independent, but not necessarily identically distributed, observations and by assuming that the candidate model may not contain the true distribution. An application to the class of normal regression models is also presented, and simulation results are obtained in order to gain some further understanding on the behavior of the estimators.

Suggested Citation

  • Paolo Vidoni, 2015. "Estimating the Kullback–Liebler risk based on multifold cross-validation," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 69(4), pages 510-540, November.
    • Handle: RePEc:bla:stanee:v:69:y:2015:i:4:p:510-540
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/stan.12070
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yuhong Yang, 2005. "Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation," Biometrika, Biometrika Trust, vol. 92(4), pages 937-950, December.
    2. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464, September.
    3. Yasunori Fujikoshi & Takafumi Noguchi & Megu Ohtaki & Hirokazu Yanagihara, 2003. "Corrected versions of cross-validation criteria for selecting multivariate regression and growth curve models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 55(3), pages 537-553, September.
    4. Yanagihara, Hirokazu & Tonda, Tetsuji & Matsumoto, Chieko, 2006. "Bias correction of cross-validation criterion based on Kullback-Leibler information under a general condition," Journal of Multivariate Analysis, Elsevier, vol. 97(9), pages 1965-1975, October.
    5. Hirokazu Yanagihara & Hironori Fujisawa, 2012. "Iterative Bias Correction of the Cross‐Validation Criterion," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 39(1), pages 116-130, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tindara Addabbo & Anna Maccagnan & Carmen Llorca-Rodríguez & Rosa García-Fernández, 2010. "Income distribution and the effect of the financial crisis on the Italian and Spanish labour markets," Department of Economics 0639, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
    2. Walter Beckert, 2015. "Choice in the Presence of Experts," Birkbeck Working Papers in Economics and Finance 1503, Birkbeck, Department of Economics, Mathematics & Statistics.
    3. Ai, Chunrong & Chen, Xiaohong, 2007. "Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables," Journal of Econometrics, Elsevier, vol. 141(1), pages 5-43, November.
    4. Okhrin, Ostap & Ristig, Alexander & Sheen, Jeffrey R. & Trück, Stefan, 2015. "Conditional systemic risk with penalized copula," SFB 649 Discussion Papers 2015-038, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    5. Xiaohong Chen & Roger Koenker & Zhijie Xiao, 2009. "Copula-based nonlinear quantile autoregression," Econometrics Journal, Royal Economic Society, vol. 12(s1), pages 50-67, January.
    6. Magnus, Jan R., 2007. "The Asymptotic Variance Of The Pseudo Maximum Likelihood Estimator," Econometric Theory, Cambridge University Press, vol. 23(5), pages 1022-1032, October.
    7. Chor-Yiu Sin, 2014. "Qmle Of A Standard Exponential Acd Model: Asymptotic Distribution And Residual Correlation," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 9(02), pages 1-10.
    8. Chirwa, Themba G. & Odhiambo, Nicholas M., 2016. "What Drives Long-Run Economic Growth? Empirical Evidence from South Africa," Economia Internazionale / International Economics, Camera di Commercio Industria Artigianato Agricoltura di Genova, vol. 69(4), pages 429-456.
    9. Wongsa-art, Pipat & Kim, Namhyun & Xia, Yingcun & Moscone, Francesco, 2024. "Varying coefficient panel data models and methods under correlated error components: Application to disparities in mental health services in England," Regional Science and Urban Economics, Elsevier, vol. 106(C).
    10. Coenen, Gunter & Wieland, Volker, 2005. "A small estimated euro area model with rational expectations and nominal rigidities," European Economic Review, Elsevier, vol. 49(5), pages 1081-1104, July.
    11. Chen, Xiaohong & Liao, Zhipeng & Sun, Yixiao, 2014. "Sieve inference on possibly misspecified semi-nonparametric time series models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 639-658.
    12. Manuel Gebetsberger & Jakob W. Messner & Georg J. Mayr & Achim Zeileis, 2017. "Estimation methods for non-homogeneous regression models: Minimum continuous ranked probability score vs. maximum likelihood," Working Papers 2017-23, Faculty of Economics and Statistics, Universität Innsbruck.
    13. David T. Frazier & Bonsoo Koo, 2020. "Indirect Inference for Locally Stationary Models," Monash Econometrics and Business Statistics Working Papers 30/20, Monash University, Department of Econometrics and Business Statistics.
    14. Arie Preminger & Uri Ben-zion & David Wettstein, 2007. "The extended switching regression model: allowing for multiple latent state variables," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(7), pages 457-473.
    15. Guido M. Kuersteiner & Ingmar R. Prucha, 2020. "Dynamic Spatial Panel Models: Networks, Common Shocks, and Sequential Exogeneity," Econometrica, Econometric Society, vol. 88(5), pages 2109-2146, September.
    16. Blasques, Francisco & van Brummelen, Janneke & Gorgi, Paolo & Koopman, Siem Jan, 2024. "Maximum Likelihood Estimation for Non-Stationary Location Models with Mixture of Normal Distributions," Journal of Econometrics, Elsevier, vol. 238(1).
    17. Dimitriadis, Timo & Schnaitmann, Julie, 2021. "Forecast encompassing tests for the expected shortfall," International Journal of Forecasting, Elsevier, vol. 37(2), pages 604-621.
    18. Hommes, Cars & Zhu, Mei, 2014. "Behavioral learning equilibria," Journal of Economic Theory, Elsevier, vol. 150(C), pages 778-814.
    19. Takagi, Shingo, 1999. "Bias in maximum likelihood estimator of disequilibrium and sample selection model with error-ridden observations," Economics Letters, Elsevier, vol. 64(2), pages 161-165, August.
    20. Hannes Böhm & Julia Schaumburg & Lena Tonzer, 2022. "Financial Linkages and Sectoral Business Cycle Synchronization: Evidence from Europe," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 70(4), pages 698-734, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:stanee:v:69:y:2015:i:4:p:510-540. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0039-0402 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.