IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v101y2010i9p1981-1994.html
   My bibliography  Save this article

Statistical inference for the [epsilon]-entropy and the quadratic Rényi entropy

Author

Listed:
  • Leonenko, Nikolaj
  • Seleznjev, Oleg

Abstract

Entropy and its various generalizations are widely used in mathematical statistics, communication theory, physical and computer sciences for characterizing the amount of information in a probability distribution. We consider estimators of the quadratic Rényi entropy and some related characteristics of discrete and continuous probability distributions based on the number of coincident (or [epsilon]-close) vector observations in the corresponding independent and identically distributed sample. We show some asymptotic properties of these estimators (e.g., consistency and asymptotic normality). These estimators can be used in various problems in mathematical statistics and computer science (e.g., distribution identification problems, average case analysis for random databases, approximate pattern matching in bioinformatics, cryptography).

Suggested Citation

  • Leonenko, Nikolaj & Seleznjev, Oleg, 2010. "Statistical inference for the [epsilon]-entropy and the quadratic Rényi entropy," Journal of Multivariate Analysis, Elsevier, vol. 101(9), pages 1981-1994, October.
    • Handle: RePEc:eee:jmvana:v:101:y:2010:i:9:p:1981-1994
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(10)00118-1
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Redmond, C. & Yukich, J. E., 1996. "Asymptotics for Euclidean functionals with power-weighted edges," Stochastic Processes and their Applications, Elsevier, vol. 61(2), pages 289-304, February.
    2. Zografos, K. & Nadarajah, S., 2005. "Expressions for Rényi and Shannon entropies for multivariate distributions," Statistics & Probability Letters, Elsevier, vol. 71(1), pages 71-84, January.
    3. Zografos, K., 2008. "On Mardia's and Song's measures of kurtosis in elliptical distributions," Journal of Multivariate Analysis, Elsevier, vol. 99(5), pages 858-879, May.
    4. Oleg Seleznjev & Bernhard Thalheim, 2003. "Average Case Analysis in Database Problems," Methodology and Computing in Applied Probability, Springer, vol. 5(4), pages 395-418, December.
    5. Zografos, K., 1999. "On Maximum Entropy Characterization of Pearson's Type II and VII Multivariate Distributions," Journal of Multivariate Analysis, Elsevier, vol. 71(1), pages 67-75, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Yali & Shang, Pengjian & Sun, Zhenghui, 2018. "Diversity analysis based on ordered patterns," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 506(C), pages 1126-1133.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carol Alexander & José María Sarabia, 2012. "Quantile Uncertainty and Value‐at‐Risk Model Risk," Risk Analysis, John Wiley & Sons, vol. 32(8), pages 1293-1308, August.
    2. Bhattacharya, Bhaskar, 2006. "Maximum entropy characterizations of the multivariate Liouville distributions," Journal of Multivariate Analysis, Elsevier, vol. 97(6), pages 1272-1283, July.
    3. Daya K. Nagar & Saralees Nadarajah & Idika E. Okorie, 2017. "A New Bivariate Distribution with One Marginal Defined on the Unit Interval," Annals of Data Science, Springer, vol. 4(3), pages 405-420, September.
    4. Contreras-Reyes, Javier E., 2014. "Asymptotic form of the Kullback–Leibler divergence for multivariate asymmetric heavy-tailed distributions," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 395(C), pages 200-208.
    5. Iwashita, Toshiya & Klar, Bernhard, 2014. "The joint distribution of Studentized residuals under elliptical distributions," Journal of Multivariate Analysis, Elsevier, vol. 128(C), pages 203-209.
    6. Ebrahimi, Nader & Kirmani, S.N.U.A. & Soofi, Ehsan S., 2007. "Multivariate dynamic information," Journal of Multivariate Analysis, Elsevier, vol. 98(2), pages 328-349, February.
    7. Loperfido, Nicola, 2020. "Some remarks on Koziol’s kurtosis," Journal of Multivariate Analysis, Elsevier, vol. 175(C).
    8. Yooyoung Koo & Sungchul Lee, 2007. "Rates of Convergence of Means of Euclidean Functionals," Journal of Theoretical Probability, Springer, vol. 20(4), pages 821-841, December.
    9. Nathan Lassance & Frédéric Vrins, 2021. "Minimum Rényi entropy portfolios," Annals of Operations Research, Springer, vol. 299(1), pages 23-46, April.
    10. Oleg Seleznjev & Bernhard Thalheim, 2010. "Random Databases with Approximate Record Matching," Methodology and Computing in Applied Probability, Springer, vol. 12(1), pages 63-89, March.
    11. Burkschat Marco & Kamps Udo & Kateri Maria, 2013. "Estimating scale parameters under an order statistics prior," Statistics & Risk Modeling, De Gruyter, vol. 30(3), pages 205-219, August.
    12. Vuong, Q.N. & Bedbur, S. & Kamps, U., 2013. "Distances between models of generalized order statistics," Journal of Multivariate Analysis, Elsevier, vol. 118(C), pages 24-36.
    13. Lee, Sungchul, 1999. "Asymptotics of power-weighted Euclidean functionals," Stochastic Processes and their Applications, Elsevier, vol. 79(1), pages 109-116, January.
    14. Baishuai Zuo & Chuancun Yin & Jing Yao, 2023. "Multivariate range Value-at-Risk and covariance risk measures for elliptical and log-elliptical distributions," Papers 2305.09097, arXiv.org.
    15. Andai, Attila, 2009. "On the geometry of generalized Gaussian distributions," Journal of Multivariate Analysis, Elsevier, vol. 100(4), pages 777-793, April.
    16. Villa, Cristiano & Rubio, Francisco J., 2018. "Objective priors for the number of degrees of freedom of a multivariate t distribution and the t-copula," Computational Statistics & Data Analysis, Elsevier, vol. 124(C), pages 197-219.
    17. Burkschat, M. & Kamps, U. & Kateri, M., 2010. "Sequential order statistics with an order statistics prior," Journal of Multivariate Analysis, Elsevier, vol. 101(8), pages 1826-1836, September.
    18. McGivney, K. & Yukich, J. E., 1999. "Asymptotics for Voronoi tessellations on random samples," Stochastic Processes and their Applications, Elsevier, vol. 83(2), pages 273-288, October.
    19. Withers, Christopher S. & Nadarajah, Saralees, 2011. "Estimates of low bias for the multivariate normal," Statistics & Probability Letters, Elsevier, vol. 81(11), pages 1635-1647, November.
    20. Zografos, K. & Nadarajah, S., 2005. "Expressions for Rényi and Shannon entropies for multivariate distributions," Statistics & Probability Letters, Elsevier, vol. 71(1), pages 71-84, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:101:y:2010:i:9:p:1981-1994. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.