IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v76y2024i5d10.1007_s10463-024-00906-9.html
   My bibliography  Save this article

Minimizing robust density power-based divergences for general parametric density models

Author

Listed:
  • Akifumi Okuno

    (Institute of Statistical Mathematics
    RIKEN Center for Advanced Intelligence Project)

Abstract

Density power divergence (DPD) is designed to robustly estimate the underlying distribution of observations, in the presence of outliers. However, DPD involves an integral of the power of the parametric density models to be estimated; the explicit form of the integral term can be derived only for specific densities, such as normal and exponential densities. While we may perform a numerical integration for each iteration of the optimization algorithms, the computational complexity has hindered the practical application of DPD-based estimation to more general parametric densities. To address the issue, this study introduces a stochastic approach to minimize DPD for general parametric density models. The proposed approach can also be employed to minimize other density power-based $$\gamma$$ γ -divergences, by leveraging unnormalized models. We provide R package for implementation of the proposed approach in https://github.com/oknakfm/sgdpd .

Suggested Citation

  • Akifumi Okuno, 2024. "Minimizing robust density power-based divergences for general parametric density models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 76(5), pages 851-875, October.
    • Handle: RePEc:spr:aistmt:v:76:y:2024:i:5:d:10.1007_s10463-024-00906-9
    DOI: 10.1007/s10463-024-00906-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10463-024-00906-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10463-024-00906-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jack Jewson & David Rossell, 2022. "General Bayesian loss function selection and the use of improper models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1640-1665, November.
    2. Abhik Ghosh & Ayanendranath Basu, 2016. "Robust Bayes estimation using the density power divergence," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 68(2), pages 413-437, April.
    3. Takafumi Kanamori & Hironori Fujisawa, 2015. "Robust estimation under heavy contamination using unnormalized models," Biometrika, Biometrika Trust, vol. 102(3), pages 559-572.
    4. Fujisawa, Hironori & Eguchi, Shinto, 2008. "Robust parameter estimation with a small bias against heavy contamination," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 2053-2081, October.
    5. A. Philip Dawid & Monica Musio & Laura Ventura, 2016. "Minimum Scoring Rule Inference," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 123-138, March.
    6. Amarnath Nandy & Ayanendranath Basu & Abhik Ghosh, 2022. "Robust inference for skewed data in health sciences," Journal of Applied Statistics, Taylor & Francis Journals, vol. 49(8), pages 2093-2123, June.
    7. Hirose, Kei & Fujisawa, Hironori & Sese, Jun, 2017. "Robust sparse Gaussian graphical modeling," Journal of Multivariate Analysis, Elsevier, vol. 161(C), pages 172-190.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. F. Giummolè & V. Mameli & E. Ruli & L. Ventura, 2019. "Objective Bayesian inference with proper scoring rules," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(3), pages 728-755, September.
    2. Hirose, Kei & Fujisawa, Hironori & Sese, Jun, 2017. "Robust sparse Gaussian graphical modeling," Journal of Multivariate Analysis, Elsevier, vol. 161(C), pages 172-190.
    3. Catania, Leopoldo & Luati, Alessandra, 2020. "Robust estimation of a location parameter with the integrated Hogg function," Statistics & Probability Letters, Elsevier, vol. 164(C).
    4. Takayuki Kawashima & Hironori Fujisawa, 2023. "Robust regression against heavy heterogeneous contamination," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(4), pages 421-442, May.
    5. Paola Stolfi & Mauro Bernardi & Davide Vergni, 2022. "Robust estimation of time-dependent precision matrix with application to the cryptocurrency market," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-25, December.
    6. Hung Hung & Zhi†Yu Jou & Su†Yun Huang, 2018. "Robust mislabel logistic regression without modeling mislabel probabilities," Biometrics, The International Biometric Society, vol. 74(1), pages 145-154, March.
    7. Onno Kleen, 2024. "Scaling and measurement error sensitivity of scoring rules for distribution forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(5), pages 833-849, August.
    8. R de Fondeville & A C Davison, 2018. "High-dimensional peaks-over-threshold inference," Biometrika, Biometrika Trust, vol. 105(3), pages 575-592.
    9. Arun Kumar Kuchibhotla & Somabha Mukherjee & Ayanendranath Basu, 2019. "Statistical inference based on bridge divergences," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(3), pages 627-656, June.
    10. Abhijit Mandal & Beste Hamiye Beyaztas & Soutir Bandyopadhyay, 2023. "Robust density power divergence estimates for panel data models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(5), pages 773-798, October.
    11. Raphaël de Fondeville & Anthony C. Davison, 2022. "Functional peaks‐over‐threshold analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1392-1422, September.
    12. Christis Katsouris, 2023. "High Dimensional Time Series Regression Models: Applications to Statistical Learning Methods," Papers 2308.16192, arXiv.org.
    13. Jack Jewson & David Rossell, 2022. "General Bayesian loss function selection and the use of improper models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1640-1665, November.
    14. Paolo Vidoni, 2021. "Boosting multiplicative model combination," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(3), pages 761-789, September.
    15. Shogo Kato & Shinto Eguchi, 2016. "Robust estimation of location and concentration parameters for the von Mises–Fisher distribution," Statistical Papers, Springer, vol. 57(1), pages 205-234, March.
    16. Tsionas, Mike G., 2023. "Joint production in stochastic non-parametric envelopment of data with firm-specific directions," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1336-1347.
    17. Takuo Matsubara & Jeremias Knoblauch & François‐Xavier Briol & Chris J. Oates, 2022. "Robust generalised Bayesian inference for intractable likelihoods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(3), pages 997-1022, July.
    18. Chen, Ting-Li & Fujisawa, Hironori & Huang, Su-Yun & Hwang, Chii-Ruey, 2016. "On the weak convergence and Central Limit Theorem of blurring and nonblurring processes with application to robust location estimation," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 165-184.
    19. Claudio Heinrich‐Mertsching & Thordis L. Thorarinsdottir & Peter Guttorp & Max Schneider, 2024. "Validation of point process predictions with proper scoring rules," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 51(4), pages 1533-1566, December.
    20. Mingyang Ren & Sanguo Zhang & Qingzhao Zhang, 2021. "Robust high-dimensional regression for data with anomalous responses," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(4), pages 703-736, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:76:y:2024:i:5:d:10.1007_s10463-024-00906-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.