IDEAS home Printed from https://ideas.repec.org/p/hal/wpaper/halshs-00472750.html
   My bibliography  Save this paper

Explicit Solutions For The Asymptotically-Optimal Bandwidth In Cross Validation

Author

Listed:
  • Karim Abadir

    (Imperial College London)

  • Michel Lubrano

    (GREQAM - Groupement de Recherche en Économie Quantitative d'Aix-Marseille - EHESS - École des hautes études en sciences sociales - AMU - Aix Marseille Université - ECM - École Centrale de Marseille - CNRS - Centre National de la Recherche Scientifique)

Abstract

Least squares cross-validation (CV) methods are often used for automated bandwidth selection. We show that they share a common structure which has an explicit asymptotic solution. Using the framework of density estimation, we consider unbiased, biased, and smoothed CV methods. We show that, with a Student t(nu) kernel which includes the Gaussian as a special case, the CV criterion becomes asymptotically equivalent to a simple polynomial. This leads to optimal-bandwidth solutions that dominate the usual CV methods, definitely in terms of simplicity and speed of calculation, but also often in terms of integrated squared error because of the robustness of our asymptotic solution. We present simulations to illustrate these features and to give practical guidance on the choice of nu.

Suggested Citation

  • Karim Abadir & Michel Lubrano, 2010. "Explicit Solutions For The Asymptotically-Optimal Bandwidth In Cross Validation," Working Papers halshs-00472750, HAL.
  • Handle: RePEc:hal:wpaper:halshs-00472750
    Note: View the original document on HAL open archive server: https://shs.hal.science/halshs-00472750
    as

    Download full text from publisher

    File URL: https://shs.hal.science/halshs-00472750/document
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mammen, Enno & Martínez Miranda, María Dolores & Nielsen, Jens Perch & Sperlich, Stefan, 2011. "Do-Validation for Kernel Density Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 651-660.
    2. Savchuk, Olga Y. & Hart, Jeffrey D. & Sheather, Simon J., 2010. "Indirect Cross-Validation for Density Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 415-423.
    3. Karim Abadir, 1999. "An introduction to hypergeometric functions for economists," Econometric Reviews, Taylor & Francis Journals, vol. 18(3), pages 287-330.
    4. Tarn Duong & Martin L. Hazelton, 2005. "Cross‐validation Bandwidth Matrices for Multivariate Kernel Density Estimation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 32(3), pages 485-506, September.
    5. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    6. Hall, Peter & Marron, J. S., 1987. "Estimation of integrated squared density derivatives," Statistics & Probability Letters, Elsevier, vol. 6(2), pages 109-115, November.
    7. Kim, W. C. & Park, B. U. & Marron, J. S., 1994. "Asymptotically best bandwidth selectors in kernel density estimation," Statistics & Probability Letters, Elsevier, vol. 19(2), pages 119-127, January.
    8. Qi Li & Jeffrey Scott Racine, 2006. "Density Estimation, from Nonparametric Econometrics: Theory and Practice," Introductory Chapters, in: Nonparametric Econometrics: Theory and Practice, Princeton University Press.
    9. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    10. Robinson, P.M., 2005. "Robust Covariance Matrix Estimation: Hac Estimates With Long Memory/Antipersistence Correction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 171-180, February.
    11. Duong, Tarn, 2007. "ks: Kernel Density Estimation and Kernel Discriminant Analysis for Multivariate Data in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 21(i07).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nils-Bastian Heidenreich & Anja Schindler & Stefan Sperlich, 2013. "Bandwidth selection for kernel density estimation: a review of fully automatic selectors," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 97(4), pages 403-433, October.
    2. Gregory Connor & Lisa R. Goldberg & Robert A. Korajczyk, 2010. "Portfolio Risk Analysis," Economics Books, Princeton University Press, edition 1, number 9224.
    3. Jianqing Fan & Weining Wang & Yue Zhao, 2024. "Conditional nonparametric variable screening by neural factor regression," Papers 2408.10825, arXiv.org.
    4. Chaohua Dong & Jiti Gao & Oliver Linton & Bin peng, 2020. "On Time Trend of COVID-19: A Panel Data Study," Monash Econometrics and Business Statistics Working Papers 22/20, Monash University, Department of Econometrics and Business Statistics.
    5. Walter Sosa-Escudero & Sergio Petralia, 2011. "Anatomy of Distributive Changes in Argentina," Chapters, in: Werner Baer & David Fleischer (ed.), The Economies of Argentina and Brazil, chapter 10, Edward Elgar Publishing.
    6. Eduardo Fé & Bruce Hollingsworth, 2016. "Short- and long-run estimates of the local effects of retirement on health," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(4), pages 1051-1067, October.
    7. Camelia Minoiu & Sanjay Reddy, 2014. "Kernel density estimation on grouped data: the case of poverty assessment," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 12(2), pages 163-189, June.
    8. Kai Wenger & Christian Leschinski & Philipp Sibbertsen, 2019. "Change-in-mean tests in long-memory time series: a review of recent developments," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 103(2), pages 237-256, June.
    9. repec:hal:spmain:info:hdl:2441/4hgajj9cf48dladkd9pn9jcj4p is not listed on IDEAS
    10. Manabu Asai & Michael McAleer, 2017. "A fractionally integrated Wishart stochastic volatility model," Econometric Reviews, Taylor & Francis Journals, vol. 36(1-3), pages 42-59, March.
    11. Xiaohong Chen & Zhipeng Liao & Yixiao Sun, 2012. "Sieve Inference on Semi-nonparametric Time Series Models," Cowles Foundation Discussion Papers 1849, Cowles Foundation for Research in Economics, Yale University.
    12. Filipe Campante & Quoc-Anh Do & Bernardo Guimaraes, 2014. "Capital Cities, Conflict, and Misgovernance: Theory and Evidence," Working Papers hal-03460226, HAL.
    13. Eduardo Fé Rodríguez, 2009. "Adaptive Instrumental Variable Estimation of Heteroskedastic Error Component Models," Economics Discussion Paper Series 0921, Economics, The University of Manchester.
    14. Quoc-Anh Do & Kieu-Trang Nguyen & Anh N. Tran, 2017. "One Mandarin Benefits the Whole Clan: Hometown Favoritism in an Authoritarian Regime," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 1-29, October.
    15. Peter H. Egger & Katharina Erhardt, 2024. "Heterogeneous effects of tariff and nontariff trade‐policy barriers in quantitative general equilibrium," Quantitative Economics, Econometric Society, vol. 15(2), pages 453-487, May.
    16. Richard Blundell & Dennis Kristensen & Rosa Matzkin, 2017. "Individual counterfactuals with multidimensional unobserved heterogeneity," CeMMAP working papers 60/17, Institute for Fiscal Studies.
    17. Gupta, Abhimanyu, 2018. "Autoregressive spatial spectral estimates," Journal of Econometrics, Elsevier, vol. 203(1), pages 80-95.
    18. Hirukawa, Masayuki, 2023. "Robust Covariance Matrix Estimation in Time Series: A Review," Econometrics and Statistics, Elsevier, vol. 27(C), pages 36-61.
    19. Alberto Gude & Inmaculada Álvarez & Luis Orea, 2018. "Heterogeneous spillovers among Spanish provinces: a generalized spatial stochastic frontier model," Journal of Productivity Analysis, Springer, vol. 50(3), pages 155-173, December.
    20. Marc Aliana & Diego Prior & Emili Tortosa-Ausina, 2024. "Assessing the impact of environmental factors on emergency healthcare quality: Implications for budget allocation," Working Papers 2024/04, Economics Department, Universitat Jaume I, Castellón (Spain).
    21. Campante, Filipe R. & Do, Quoc-Anh & Guimaraes, Bernardo, 2012. "Isolated Capital Cities and Misgovernance: Theory and Evidence," Working Paper Series rwp12-058, Harvard University, John F. Kennedy School of Government.

    More about this item

    Keywords

    bandwidth choice; cross validation; nonparametric density es- timation; analytical solution;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • J31 - Labor and Demographic Economics - - Wages, Compensation, and Labor Costs - - - Wage Level and Structure; Wage Differentials

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:wpaper:halshs-00472750. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.