IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v65y2024i7d10.1007_s00362-024-01563-z.html
   My bibliography  Save this article

A non-classical parameterization for density estimation using sample moments

Author

Listed:
  • Guangyu Wu

    (Shanghai Jiao Tong University)

  • Anders Lindquist

    (Shanghai Jiao Tong University
    Shanghai Jiao Tong University)

Abstract

Probability density estimation is a core problem in statistics and data science. Moment methods are an important means of density estimation, but they are generally strongly dependent on the choice of feasible functions, which severely affects the performance. In this paper, we propose a non-classical parametrization for density estimation using sample moments, which does not require the choice of such functions. The parametrization is induced by the squared Hellinger distance, and the solution minimizing it, which is proved to exist and be unique subject to a simple prior that does not depend on data, and which can be obtained by convex optimization. Statistical properties of the density estimator, together with an asymptotic error upper bound, are proposed for the estimator by power moments. Simulation results validate the performance of the estimator by a comparison to several prevailing methods. The convergence rate of the proposed estimator is proved to be $$m^{-1/2}$$ m - 1 / 2 (m being the number of data samples), which is the optimal convergence rate for parametric estimators and exceeds that of the nonparametric estimators. To the best of our knowledge, the proposed estimator is the first one in the literature for which the power moments up to an arbitrary even order exactly match the sample moments, while the true density is not assumed to fall within specific function classes.

Suggested Citation

  • Guangyu Wu & Anders Lindquist, 2024. "A non-classical parameterization for density estimation using sample moments," Statistical Papers, Springer, vol. 65(7), pages 4489-4513, September.
    • Handle: RePEc:spr:stpapr:v:65:y:2024:i:7:d:10.1007_s00362-024-01563-z
    DOI: 10.1007/s00362-024-01563-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-024-01563-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00362-024-01563-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gordon, Louis & Olshen, Richard A., 1984. "Almost surely consistent nonparametric regression from recursive partitioning schemes," Journal of Multivariate Analysis, Elsevier, vol. 15(2), pages 147-163, October.
    2. Zudi Lu & Yer Van Hui & Andy H. Lee, 2003. "Minimum Hellinger Distance Estimation for Finite Mixtures of Poisson Regression Models and Its Applications," Biometrics, The International Biometric Society, vol. 59(4), pages 1016-1026, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gábor Lugosi & Andrew B. Nobel, 1998. "Adaptive model selection using empirical complexities," Economics Working Papers 323, Department of Economics and Business, Universitat Pompeu Fabra.
    2. Abhinandan Dalal & Patrick Blobaum & Shiva Kasiviswanathan & Aaditya Ramdas, 2024. "Anytime-Valid Inference for Double/Debiased Machine Learning of Causal Parameters," Papers 2408.09598, arXiv.org, revised Sep 2024.
    3. Qingguo Tang & R. J. Karunamuni, 2018. "Robust variable selection for finite mixture regression models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(3), pages 489-521, June.
    4. Yunus Emre Ayözen & Hakan İnaç & Abdulkadir Atalan & Cem Çağrı Dönmez, 2022. "E-Scooter Micro-Mobility Application for Postal Service: The Case of Turkey for Energy, Environment, and Economy Perspectives," Energies, MDPI, vol. 15(20), pages 1-22, October.
    5. Hua Jin & Ying Lu & Kaite Stone & Dennis M. Black, 2004. "Alternative Tree-Structured Survival Analysis Based on Variance of Survival Time," Medical Decision Making, , vol. 24(6), pages 670-680, November.
    6. Zhang, Heping, 2004. "Recursive Partitioning and Tree-based Methods," Papers 2004,30, Humboldt University of Berlin, Center for Applied Statistics and Economics (CASE).
    7. Takada, Teruko, 2009. "Simulated minimum Hellinger distance estimation of stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2390-2403, April.
    8. Chee, Chew-Seng, 2017. "A mixture model-based nonparametric approach to estimating a count distribution," Computational Statistics & Data Analysis, Elsevier, vol. 109(C), pages 34-44.
    9. Wu, Jingjing & Karunamuni, Rohana J., 2012. "Efficient Hellinger distance estimates for semiparametric models," Journal of Multivariate Analysis, Elsevier, vol. 107(C), pages 1-23.
    10. Jingjing Wu & Tasnima Abedin & Qiang Zhao, 2023. "Semiparametric modelling of two-component mixtures with stochastic dominance," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(1), pages 39-70, February.
    11. Borislava Mihaylova & Andrew Briggs & Anthony O'Hagan & Simon G. Thompson, 2011. "Review of statistical methods for analysing healthcare resources and costs," Health Economics, John Wiley & Sons, Ltd., vol. 20(8), pages 897-916, August.
    12. Daniel B. Hall & Jing Shen, 2010. "Robust Estimation for Zero‐Inflated Poisson Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 37(2), pages 237-252, June.
    13. Luca Greco, 2022. "Robust fitting of mixtures of GLMs by weighted likelihood," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 106(1), pages 25-48, March.
    14. Giet, Ludovic & Lubrano, Michel, 2008. "A minimum Hellinger distance estimator for stochastic differential equations: An application to statistical inference for continuous time interest rate models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2945-2965, February.
    15. Bilton, Penny & Jones, Geoff & Ganesh, Siva & Haslett, Steve, 2017. "Classification trees for poverty mapping," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 53-66.
    16. Liming Xiang & Kelvin K. W. Yau & Yer Van Hui & Andy H. Lee, 2008. "Minimum Hellinger Distance Estimation for k-Component Poisson Mixture with Random Effects," Biometrics, The International Biometric Society, vol. 64(2), pages 508-518, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:65:y:2024:i:7:d:10.1007_s00362-024-01563-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.