IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v6y2022i1p3-49d1016627.html
   My bibliography  Save this article

Estimating Smoothness and Optimal Bandwidth for Probability Density Functions

Author

Listed:
  • Dimitris N. Politis

    (Department of Mathematics and Halicioglu Data Science Institute, University of California, San Diego, CA 92093-0112, USA)

  • Peter F. Tarassenko

    (Institute of Applied Mathematics and Computer Science, Tomsk State University, 36 Lenin Ave., 634050 Tomsk, Russia)

  • Vyacheslav A. Vasiliev

    (Institute of Applied Mathematics and Computer Science, Tomsk State University, 36 Lenin Ave., 634050 Tomsk, Russia)

Abstract

The properties of non-parametric kernel estimators for probability density function from two special classes are investigated. Each class is parametrized with distribution smoothness parameter. One of the classes was introduced by Rosenblatt, another one is introduced in this paper. For the case of the known smoothness parameter, the rates of mean square convergence of optimal (on the bandwidth) density estimators are found. For the case of unknown smoothness parameter, the estimation procedure of the parameter is developed and almost surely convergency is proved. The convergence rates in the almost sure sense of these estimators are obtained. Adaptive estimators of densities from the given class on the basis of the constructed smoothness parameter estimators are presented. It is shown in examples how parameters of the adaptive density estimation procedures can be chosen. Non-asymptotic and asymptotic properties of these estimators are investigated. Specifically, the upper bounds for the mean square error of the adaptive density estimators for a fixed sample size are found and their strong consistency is proved. The convergence of these estimators in the almost sure sense is established. Simulation results illustrate the realization of the asymptotic behavior when the sample size grows large.

Suggested Citation

  • Dimitris N. Politis & Peter F. Tarassenko & Vyacheslav A. Vasiliev, 2022. "Estimating Smoothness and Optimal Bandwidth for Probability Density Functions," Stats, MDPI, vol. 6(1), pages 1-20, December.
    • Handle: RePEc:gam:jstats:v:6:y:2022:i:1:p:3-49:d:1016627
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/6/1/3/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2571-905X/6/1/3/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Claire Lacour & Pascal Massart & Vincent Rivoirard, 2017. "Estimator Selection: a New Method with Applications to Kernel Density Estimation," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 79(2), pages 298-335, August.
    2. Marc Hallin & Lanh T. Tran, 1996. "Kernel density estimation for linear processes: asymptotic normality and bandwidth selection," ULB Institutional Repository 2013/2055, ULB -- Universite Libre de Bruxelles.
    3. Marc Hallin & Lanh Tran, 1996. "Kernel density estimation for linear processes: Asymptotic normality and optimal bandwidth derivation," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 48(3), pages 429-449, September.
    4. Zudi Lu, 2001. "Asymptotic Normality of Kernel Density Estimators under Dependence," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 53(3), pages 447-468, September.
    5. Politis, Dimitris N. & Romano, Joseph P., 1999. "Multivariate Density Estimation with General Flat-Top Kernels of Infinite Order," Journal of Multivariate Analysis, Elsevier, vol. 68(1), pages 1-25, January.
    6. Vyacheslav Vasiliev, 2014. "A truncated estimation method with guaranteed accuracy," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 141-163, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Müller, Ursula U. & Schick, Anton & Wefelmeyer, Wolfgang, 2015. "Estimators in step regression models," Statistics & Probability Letters, Elsevier, vol. 100(C), pages 124-129.
    2. Schick, Anton & Wefelmeyer, Wolfgang, 2006. "Pointwise convergence rates and central limit theorems for kernel density estimators in linear processes," Statistics & Probability Letters, Elsevier, vol. 76(16), pages 1756-1760, October.
    3. Zudi Lu, 2001. "Asymptotic Normality of Kernel Density Estimators under Dependence," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 53(3), pages 447-468, September.
    4. Tang Qingguo & Cheng Longsheng, 2010. "B-spline estimation for spatial data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(2), pages 197-217.
    5. Toshio Honda, 2009. "Nonparametric density estimation for linear processes with infinite variance," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 61(2), pages 413-439, June.
    6. Hwang, Eunju & Shin, Dong Wan, 2012. "Stationary bootstrap for kernel density estimators under ψ-weak dependence," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1581-1593.
    7. Horváth, Lajos & Rice, Gregory & Whipple, Stephen, 2016. "Adaptive bandwidth selection in the long run covariance estimator of functional time series," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 676-693.
    8. Van Ha Hoang & Thanh Mai Pham Ngoc & Vincent Rivoirard & Viet Chi Tran, 2022. "Nonparametric estimation of the fragmentation kernel based on a partial differential equation stationary distribution approximation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(1), pages 4-43, March.
    9. Bissantz, Nicolai & Holzmann, Hajo, 2007. "Statistical inference for inverse problems," Technical Reports 2007,40, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    10. Degui Li & Oliver Linton & Zudi Lu, 2012. "A Flexible Semiparametric Model for Time Series," Monash Econometrics and Business Statistics Working Papers 17/12, Monash University, Department of Econometrics and Business Statistics.
    11. Schennach, Susanne & White, Halbert & Chalak, Karim, 2012. "Local indirect least squares and average marginal effects in nonseparable structural systems," Journal of Econometrics, Elsevier, vol. 166(2), pages 282-302.
    12. Hassan Doosti & Peter Hall, 2016. "Making a non-parametric density estimator more attractive, and more accurate, by data perturbation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(2), pages 445-462, March.
    13. José E. Chacón & Carlos Tenreiro, 2012. "Exact and Asymptotically Optimal Bandwidths for Kernel Estimation of Density Functionals," Methodology and Computing in Applied Probability, Springer, vol. 14(3), pages 523-548, September.
    14. Ammous, Sinda & Dedecker, Jérôme & Duval, Céline, 2024. "Adaptive directional estimator of the density in Rd for independent and mixing sequences," Journal of Multivariate Analysis, Elsevier, vol. 203(C).
    15. Holzmann, Hajo & Bissantz, Nicolai & Munk, Axel, 2007. "Density testing in a contaminated sample," Journal of Multivariate Analysis, Elsevier, vol. 98(1), pages 57-75, January.
    16. Li, Degui & Linton, Oliver & Lu, Zudi, 2015. "A flexible semiparametric forecasting model for time series," Journal of Econometrics, Elsevier, vol. 187(1), pages 345-357.
    17. Hong, Seok Young & Linton, Oliver, 2020. "Nonparametric estimation of infinite order regression and its application to the risk-return tradeoff," Journal of Econometrics, Elsevier, vol. 219(2), pages 389-424.
    18. Li, Degui & Lu, Zudi & Linton, Oliver, 2012. "Local Linear Fitting Under Near Epoch Dependence: Uniform Consistency With Convergence Rates," Econometric Theory, Cambridge University Press, vol. 28(5), pages 935-958, October.
    19. Gao, Min & Yang, Wenzhi & Wu, Shipeng & Yu, Wei, 2022. "Asymptotic normality of residual density estimator in stationary and explosive autoregressive models," Computational Statistics & Data Analysis, Elsevier, vol. 175(C).
    20. Saif Eddin Jabari & Nikolaos M. Freris & Deepthi Mary Dilip, 2020. "Sparse Travel Time Estimation from Streaming Data," Transportation Science, INFORMS, vol. 54(1), pages 1-20, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:6:y:2022:i:1:p:3-49:d:1016627. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.