IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v76y2024i5d10.1007_s10463-024-00906-9.html
   My bibliography  Save this article

Minimizing robust density power-based divergences for general parametric density models

Author

Listed:
  • Akifumi Okuno

    (Institute of Statistical Mathematics
    RIKEN Center for Advanced Intelligence Project)

Abstract

Density power divergence (DPD) is designed to robustly estimate the underlying distribution of observations, in the presence of outliers. However, DPD involves an integral of the power of the parametric density models to be estimated; the explicit form of the integral term can be derived only for specific densities, such as normal and exponential densities. While we may perform a numerical integration for each iteration of the optimization algorithms, the computational complexity has hindered the practical application of DPD-based estimation to more general parametric densities. To address the issue, this study introduces a stochastic approach to minimize DPD for general parametric density models. The proposed approach can also be employed to minimize other density power-based $$\gamma$$ γ -divergences, by leveraging unnormalized models. We provide R package for implementation of the proposed approach in https://github.com/oknakfm/sgdpd .

Suggested Citation

  • Akifumi Okuno, 2024. "Minimizing robust density power-based divergences for general parametric density models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 76(5), pages 851-875, October.
    • Handle: RePEc:spr:aistmt:v:76:y:2024:i:5:d:10.1007_s10463-024-00906-9
    DOI: 10.1007/s10463-024-00906-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10463-024-00906-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10463-024-00906-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jack Jewson & David Rossell, 2022. "General Bayesian loss function selection and the use of improper models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1640-1665, November.
    2. Abhik Ghosh & Ayanendranath Basu, 2016. "Robust Bayes estimation using the density power divergence," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 68(2), pages 413-437, April.
    3. Fujisawa, Hironori & Eguchi, Shinto, 2008. "Robust parameter estimation with a small bias against heavy contamination," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 2053-2081, October.
    4. A. Philip Dawid & Monica Musio & Laura Ventura, 2016. "Minimum Scoring Rule Inference," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 123-138, March.
    5. Amarnath Nandy & Ayanendranath Basu & Abhik Ghosh, 2022. "Robust inference for skewed data in health sciences," Journal of Applied Statistics, Taylor & Francis Journals, vol. 49(8), pages 2093-2123, June.
    6. Hirose, Kei & Fujisawa, Hironori & Sese, Jun, 2017. "Robust sparse Gaussian graphical modeling," Journal of Multivariate Analysis, Elsevier, vol. 161(C), pages 172-190.
    7. Takafumi Kanamori & Hironori Fujisawa, 2015. "Robust estimation under heavy contamination using unnormalized models," Biometrika, Biometrika Trust, vol. 102(3), pages 559-572.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paola Stolfi & Mauro Bernardi & Davide Vergni, 2022. "Robust estimation of time-dependent precision matrix with application to the cryptocurrency market," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-25, December.
    2. F. Giummolè & V. Mameli & E. Ruli & L. Ventura, 2019. "Objective Bayesian inference with proper scoring rules," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(3), pages 728-755, September.
    3. Hirose, Kei & Fujisawa, Hironori & Sese, Jun, 2017. "Robust sparse Gaussian graphical modeling," Journal of Multivariate Analysis, Elsevier, vol. 161(C), pages 172-190.
    4. Catania, Leopoldo & Luati, Alessandra, 2020. "Robust estimation of a location parameter with the integrated Hogg function," Statistics & Probability Letters, Elsevier, vol. 164(C).
    5. Hung Hung & Zhi†Yu Jou & Su†Yun Huang, 2018. "Robust mislabel logistic regression without modeling mislabel probabilities," Biometrics, The International Biometric Society, vol. 74(1), pages 145-154, March.
    6. Onno Kleen, 2024. "Scaling and measurement error sensitivity of scoring rules for distribution forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(5), pages 833-849, August.
    7. Takayuki Kawashima & Hironori Fujisawa, 2023. "Robust regression against heavy heterogeneous contamination," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 86(4), pages 421-442, May.
    8. R de Fondeville & A C Davison, 2018. "High-dimensional peaks-over-threshold inference," Biometrika, Biometrika Trust, vol. 105(3), pages 575-592.
    9. Arun Kumar Kuchibhotla & Somabha Mukherjee & Ayanendranath Basu, 2019. "Statistical inference based on bridge divergences," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(3), pages 627-656, June.
    10. Julien Hambuckers & Marie Kratz & Antoine Usseglio-Carleve, 2023. "Efficient Estimation In Extreme Value Regression Models Of Hedge Fund Tail Risks," Working Papers hal-04090916, HAL.
    11. Gayen, Atin & Kumar, M. Ashok, 2021. "Projection theorems and estimating equations for power-law models," Journal of Multivariate Analysis, Elsevier, vol. 184(C).
    12. Liu, Yan, 2017. "Robust parameter estimation for stationary processes by an exotic disparity from prediction problem," Statistics & Probability Letters, Elsevier, vol. 129(C), pages 120-130.
    13. A. Philip Dawid & Monica Musio & Laura Ventura, 2016. "Minimum Scoring Rule Inference," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 123-138, March.
    14. Abhijit Mandal & Beste Hamiye Beyaztas & Soutir Bandyopadhyay, 2023. "Robust density power divergence estimates for panel data models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(5), pages 773-798, October.
    15. Raphaël de Fondeville & Anthony C. Davison, 2022. "Functional peaks‐over‐threshold analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(4), pages 1392-1422, September.
    16. Dries Cornilly & Lise Tubex & Stefan Van Aelst & Tim Verdonck, 2024. "Robust and sparse logistic regression," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 18(3), pages 663-679, September.
    17. Christis Katsouris, 2023. "High Dimensional Time Series Regression Models: Applications to Statistical Learning Methods," Papers 2308.16192, arXiv.org.
    18. Jack Jewson & David Rossell, 2022. "General Bayesian loss function selection and the use of improper models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1640-1665, November.
    19. A. Basu & A. Mandal & N. Martin & L. Pardo, 2015. "Robust tests for the equality of two normal means based on the density power divergence," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(5), pages 611-634, July.
    20. Avijit Maji & Abhik Ghosh & Ayanendranath Basu & Leandro Pardo, 2019. "Robust statistical inference based on the C-divergence family," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(5), pages 1289-1322, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:76:y:2024:i:5:d:10.1007_s10463-024-00906-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.