IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v67y2013icp282-298.html
   My bibliography  Save this article

Least-squares estimation of a convex discrete distribution

Author

Listed:
  • Durot, Cécile
  • Huet, Sylvie
  • Koladjo, François
  • Robin, Stéphane

Abstract

The least squares estimator of a discrete distribution under the constraint of convexity is introduced. Its existence and uniqueness are shown and consistency and rate of convergence are established. Moreover it is shown that it always outperforms the classical empirical estimator in terms of the Euclidean distance. Results are given both in the well- and the mis-specified cases. The performance of the estimator is checked throughout a simulation study. An algorithm, based on the support reduction algorithm, is provided. Application to the estimation of species abundance distribution is discussed.

Suggested Citation

  • Durot, Cécile & Huet, Sylvie & Koladjo, François & Robin, Stéphane, 2013. "Least-squares estimation of a convex discrete distribution," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 282-298.
    • Handle: RePEc:eee:csdana:v:67:y:2013:i:c:p:282-298
    DOI: 10.1016/j.csda.2013.04.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016794731300162X
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2013.04.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dankmar Böhning & Ronny Kuhnert, 2006. "Equivalence of Truncated Count Mixture Distributions and Mixtures of Truncated Count Distributions," Biometrics, The International Biometric Society, vol. 62(4), pages 1207-1215, December.
    2. Madeleine Cule & Richard Samworth & Michael Stewart, 2010. "Maximum likelihood estimation of a multi‐dimensional log‐concave density," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(5), pages 545-607, November.
    3. Piet Groeneboom & Geurt Jongbloed & Jon A. Wellner, 2008. "The Support Reduction Algorithm for Computing Non‐Parametric Function Estimates in Mixture Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 35(3), pages 385-399, September.
    4. Walther G., 2002. "Detecting the Presence of Mixing with Multiscale Maximum Likelihood," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 508-513, June.
    5. Wang, Ji-Ping, 2011. "SPECIES: An R Package for Species Richness Estimation," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 40(i09).
    6. repec:dau:papers:123456789/11474 is not listed on IDEAS
    7. Lanumteang, K. & Böhning, D., 2011. "An extension of Chao's estimator of population size based on the first three capture frequency counts," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2302-2311, July.
    8. Dümbgen, Lutz & Rufibach, Kaspar, 2011. "logcondens: Computations Related to Univariate Log-Concave Density Estimation," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 39(i06).
    9. Fadoua Balabdaoui & Hanna Jankowski & Kaspar Rufibach & Marios Pavlides, 2013. "Asymptotics of the discrete log-concave maximum likelihood estimator and related applications," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 769-790, September.
    10. Wang, Ji-Ping Z. & Lindsay, Bruce G., 2005. "A Penalized Nonparametric Maximum Likelihood Approach to Species Richness Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 942-959, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Giguelay, J. & Huet, S., 2018. "Testing k-monotonicity of a discrete distribution. Application to the estimation of the number of classes in a population," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 96-115.
    2. Sanku Dey & Tanmay Kayal & Yogesh Mani Tripathi, 2018. "Evaluation and Comparison of Estimators in the Gompertz Distribution," Annals of Data Science, Springer, vol. 5(2), pages 235-258, June.
    3. Balabdaoui, Fadoua & Kulagina, Yulia, 2020. "Completely monotone distributions: Mixing, approximation and estimation of number of species," Computational Statistics & Data Analysis, Elsevier, vol. 150(C).
    4. Yogesh Mani Tripathi & Amulya Kumar Mahto & Sanku Dey, 2017. "Efficient Estimation of the PDF and the CDF of a Generalized Logistic Distribution," Annals of Data Science, Springer, vol. 4(1), pages 63-81, March.
    5. Balabdaoui, Fadoua & Durot, Cécile & Koladjo, Babagnidé François, 2018. "Testing convexity of a discrete distribution," Statistics & Probability Letters, Elsevier, vol. 137(C), pages 8-13.
    6. Balabdaoui, Fadoua & Durot, Cécile, 2015. "Marshall lemma in discrete convex estimation," Statistics & Probability Letters, Elsevier, vol. 99(C), pages 143-148.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Balabdaoui, Fadoua & Kulagina, Yulia, 2020. "Completely monotone distributions: Mixing, approximation and estimation of number of species," Computational Statistics & Data Analysis, Elsevier, vol. 150(C).
    2. Dümbgen, Lutz & Mösching, Alexandre & Strähl, Christof, 2021. "Active set algorithms for estimating shape-constrained density ratios," Computational Statistics & Data Analysis, Elsevier, vol. 163(C).
    3. Azadbakhsh, Mahdis & Jankowski, Hanna & Gao, Xin, 2014. "Computing confidence intervals for log-concave densities," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 248-264.
    4. Chee, Chew-Seng & Wang, Yong, 2016. "Nonparametric estimation of species richness using discrete k-monotone distributions," Computational Statistics & Data Analysis, Elsevier, vol. 93(C), pages 107-118.
    5. Seungchul Baek & Junyong Park, 2022. "A computationally efficient approach to estimating species richness and rarefaction curve," Computational Statistics, Springer, vol. 37(4), pages 1919-1941, September.
    6. Feng, Oliver Y. & Chen, Yining & Han, Qiyang & Carroll, Raymond J & Samworth, Richard J., 2022. "Nonparametric, tuning-free estimation of S-shaped functions," LSE Research Online Documents on Economics 111889, London School of Economics and Political Science, LSE Library.
    7. Yang Liu & Rong Kuang & Guanfu Liu, 2024. "Penalized likelihood inference for the finite mixture of Poisson distributions from capture-recapture data," Statistical Papers, Springer, vol. 65(5), pages 2751-2773, July.
    8. Yining Chen & Richard J. Samworth, 2016. "Generalized additive and index models with shape constraints," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(4), pages 729-754, September.
    9. repec:jss:jstsof:40:i09 is not listed on IDEAS
    10. Madeleine Cule & Richard Samworth & Michael Stewart, 2010. "Maximum likelihood estimation of a multi‐dimensional log‐concave density," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(5), pages 545-607, November.
    11. Farcomeni, Alessio & Dotto, Francesco, 2021. "A correction to make Chao estimator conservative when the number of sampling occasions is finite," Statistics & Probability Letters, Elsevier, vol. 176(C).
    12. Yining Chen, 2015. "Semiparametric Time Series Models with Log-concave Innovations: Maximum Likelihood Estimation and its Consistency," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(1), pages 1-31, March.
    13. Chang, George T. & Walther, Guenther, 2007. "Clustering with mixtures of log-concave distributions," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6242-6251, August.
    14. Giguelay, J. & Huet, S., 2018. "Testing k-monotonicity of a discrete distribution. Application to the estimation of the number of classes in a population," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 96-115.
    15. Chun-Huo Chiu & Yi-Ting Wang & Bruno A. Walther & Anne Chao, 2014. "An improved nonparametric lower bound of species richness via a modified good–turing frequency formula," Biometrics, The International Biometric Society, vol. 70(3), pages 671-682, September.
    16. Rufibach Kaspar, 2012. "A Smooth ROC Curve Estimator Based on Log-Concave Density Estimates," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-29, April.
    17. Hazelton, Martin L., 2011. "Assessing log-concavity of multivariate densities," Statistics & Probability Letters, Elsevier, vol. 81(1), pages 121-125, January.
    18. Henry Lam & Clementine Mottet, 2017. "Tail Analysis Without Parametric Models: A Worst-Case Perspective," Operations Research, INFORMS, vol. 65(6), pages 1696-1711, December.
    19. Stefano Favaro & Antonio Lijoi & Ramsés H. Mena & Igor Prünster, 2009. "Bayesian non‐parametric inference for species variety with a two‐parameter Poisson–Dirichlet process prior," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(5), pages 993-1008, November.
    20. Cyril Bachelard & Apostolos Chalkis & Vissarion Fisikopoulos & Elias Tsigaridas, 2022. "Randomized geometric tools for anomaly detection in stock markets," Papers 2205.03852, arXiv.org, revised May 2022.
    21. Battey, Heather & Linton, Oliver, 2014. "Nonparametric estimation of multivariate elliptic densities via finite mixture sieves," Journal of Multivariate Analysis, Elsevier, vol. 123(C), pages 43-67.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:67:y:2013:i:c:p:282-298. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.