IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v109y2017icp64-75.html
   My bibliography  Save this article

Robust and efficient estimation of multivariate scatter and location

Author

Listed:
  • Maronna, Ricardo A.
  • Yohai, Victor J.

Abstract

Several equivariant estimators of multivariate location and scatter are studied, which are highly robust, have a controllable finite-sample efficiency and are computationally feasible in large dimensions. The most frequently employed estimators are not quite satisfactory in this respect. The Minimum Volume Ellipsoid (MVE) and the Minimum Covariance Determinant (MCD) estimators are known to have a very low efficiency. S-estimators with a monotonic weight function like the bisquare have a low efficiency when the dimension p is small, and their efficiency tends to one with increasing p. Unfortunately, this advantage is outweighed by a serious loss in robustness for large p. Four families of estimators with controllable efficiencies whose performance for moderate to large p has not been explored to date are studied: S-estimators with a non-monotonic weight function, MM-estimators, τ-estimators, and the Stahel–Donoho estimator. Two types of starting estimators are employed: the MVE computed through subsampling, and a semi-deterministic procedure previously proposed for outlier detection, based on the projections with maximum and minimum kurtosis. A simulation study shows that an S-estimator with non-monotonic weight function can simultaneously attain high efficiency and high robustness for p≥15, while an MM-estimator with a particular weight function can be recommended for p<15. For both recommended estimators, the initial values are given by the semi-deterministic procedure mentioned above.

Suggested Citation

  • Maronna, Ricardo A. & Yohai, Victor J., 2017. "Robust and efficient estimation of multivariate scatter and location," Computational Statistics & Data Analysis, Elsevier, vol. 109(C), pages 64-75.
  • Handle: RePEc:eee:csdana:v:109:y:2017:i:c:p:64-75
    DOI: 10.1016/j.csda.2016.11.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947316302705
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2016.11.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. N. Locantore & J. Marron & D. Simpson & N. Tripoli & J. Zhang & K. Cohen & Graciela Boente & Ricardo Fraiman & Babette Brumback & Christophe Croux & Jianqing Fan & Alois Kneip & John Marden & Daniel P, 1999. "Robust principal component analysis for functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 8(1), pages 1-73, June.
    2. Claudio Agostinelli & Andy Leung & Victor Yohai & Ruben Zamar, 2015. "Rejoinder on: Robust estimation of multivariate location and scatter in the presence of cellwise and casewise contamination," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 484-488, September.
    3. Paindaveine, Davy & Van Bever, Germain, 2014. "Inference on the shape of elliptical distributions based on the MCD," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 125-144.
    4. Claudio Agostinelli & Andy Leung & Victor Yohai & Ruben Zamar, 2015. "Robust estimation of multivariate location and scatter in the presence of cellwise and casewise contamination," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 441-461, September.
    5. Croux, Christophe & Haesbroeck, Gentiane, 1999. "Influence Function and Efficiency of the Minimum Covariance Determinant Scatter Matrix Estimator," Journal of Multivariate Analysis, Elsevier, vol. 71(2), pages 161-190, November.
    6. Nora Muler & Victor J. Yohai, 2002. "Robust estimates for arch processes," Journal of Time Series Analysis, Wiley Blackwell, vol. 23(3), pages 341-375, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Luca Greco & Giovanni Saraceno & Claudio Agostinelli, 2021. "Robust Fitting of a Wrapped Normal Model to Multivariate Circular Data and Outlier Detection," Stats, MDPI, vol. 4(2), pages 1-18, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Archimbaud, Aurore & Nordhausen, Klaus & Ruiz-Gazen, Anne, 2018. "ICS for multivariate outlier detection with application to quality control," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 184-199.
    2. Christophe Croux & Viktoria Öllerer, 2015. "Comments on: Robust estimation of multivariate location and scatter in the presence of cellwise and casewise contamination," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 462-466, September.
    3. Jan Kalina & Jan Tichavský, 2022. "The minimum weighted covariance determinant estimator for high-dimensional data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(4), pages 977-999, December.
    4. Todorov, Valentin & Filzmoser, Peter, 2009. "An Object-Oriented Framework for Robust Multivariate Analysis," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 32(i03).
    5. Anahita Nodehi & Mousa Golalizadeh & Mehdi Maadooliat & Claudio Agostinelli, 2021. "Estimation of parameters in multivariate wrapped models for data on a p-torus," Computational Statistics, Springer, vol. 36(1), pages 193-215, March.
    6. Rousseeuw, Peter & Perrotta, Domenico & Riani, Marco & Hubert, Mia, 2019. "Robust Monitoring of Time Series with Application to Fraud Detection," Econometrics and Statistics, Elsevier, vol. 9(C), pages 108-121.
    7. Stephane Heritier & Maria-Pia Victoria-Feser, 2018. "Discussion of “The power of monitoring: how to make the most of a contaminated multivariate sample” by Andrea Cerioli, Marco Riani, Anthony C. Atkinson and Aldo Corbellini," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(4), pages 595-602, December.
    8. Nikola Štefelová & Andreas Alfons & Javier Palarea-Albaladejo & Peter Filzmoser & Karel Hron, 2021. "Robust regression with compositional covariates including cellwise outliers," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(4), pages 869-909, December.
    9. Giovanni Saraceno & Claudio Agostinelli & Luca Greco, 2021. "Robust estimation for multivariate wrapped models," METRON, Springer;Sapienza Università di Roma, vol. 79(2), pages 225-240, August.
    10. Stefan Aelst & Ruben H. Zamar, 2019. "Comments on: Data science, big data and statistics," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(2), pages 360-362, June.
    11. Luca Sartore & Lu Chen & Valbona Bejleri, 2024. "Empirical Inferences Under Bayesian Framework to Identify Cellwise Outliers," Stats, MDPI, vol. 7(4), pages 1-15, October.
    12. Leung, Andy & Yohai, Victor & Zamar, Ruben, 2017. "Multivariate location and scatter matrix estimation under cellwise and casewise contamination," Computational Statistics & Data Analysis, Elsevier, vol. 111(C), pages 59-76.
    13. Henry Velasco & Henry Laniado & Mauricio Toro & Víctor Leiva & Yuhlong Lio, 2020. "Robust Three-Step Regression Based on Comedian and Its Performance in Cell-Wise and Case-Wise Outliers," Mathematics, MDPI, vol. 8(8), pages 1-18, August.
    14. David J. Hand, 2018. "Statistical challenges of administrative and transaction data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(3), pages 555-605, June.
    15. Dürre, Alexander & Vogel, Daniel & Fried, Roland, 2015. "Spatial sign correlation," Journal of Multivariate Analysis, Elsevier, vol. 135(C), pages 89-105.
    16. Md. Matiur Rahaman & Md. Nurul Haque Mollah, 2019. "Robustification of Gaussian Bayes Classifier by the Minimum β-Divergence Method," Journal of Classification, Springer;The Classification Society, vol. 36(1), pages 113-139, April.
    17. Leung, Andy & Zhang, Hongyang & Zamar, Ruben, 2016. "Robust regression estimation and inference in the presence of cellwise and casewise contamination," Computational Statistics & Data Analysis, Elsevier, vol. 99(C), pages 1-11.
    18. Guangxing Wang & Sisheng Liu & Fang Han & Chong‐Zhi Di, 2023. "Robust functional principal component analysis via a functional pairwise spatial sign operator," Biometrics, The International Biometric Society, vol. 79(2), pages 1239-1253, June.
    19. Carnero, María Ángeles, 2004. "Spurious and hidden volatility," DES - Working Papers. Statistics and Econometrics. WS ws042007, Universidad Carlos III de Madrid. Departamento de Estadística.
    20. Italo R. Lima & Guanqun Cao & Nedret Billor, 2019. "M-based simultaneous inference for the mean function of functional data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(3), pages 577-598, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:109:y:2017:i:c:p:64-75. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.