IDEAS home Printed from https://ideas.repec.org/p/eca/wpaper/2009_013.html
   My bibliography  Save this paper

Optimal rank-based testing for principal component

Author

Listed:
  • Marc Hallin
  • Davy Paindaveine
  • Thomas Verdebout

Abstract

This paper provides parametric and rank-based optimal tests for eigenvectors and eigenvalues of covariance or scatter matrices in elliptical families. The parametric tests extend the Gaussian likelihood ratio tests of Anderson (1963) and their pseudo-Gaussian robustifications by Tyler (1981, 1983) and Davis (1977), with which their Gaussian versions are shown to coincide,symptotically, under Gaussian or finite fourth-order moment assumptions, respectively. Such assumptions however restrict the scope to covariance-based principal component analysis. The rank-based tests we are proposing remain valid without such assumptions. Hence, they address a much broader class of problems, where covariance matrices need not exist and principal components are associated with more general scatter matrices. Asymptotic relative efficiencies moreover show that those rank-based tests are quite powerful; when based on van der Waerden or normal scores, they even uniformly dominate the pseudo-Gaussian versions of Anderson’s procedures. The tests we are proposing thus outperform daily practice both from the point of view of validity as from the point of view of efficiency. The main methodological tool throughout is Le Cam’s theory of locally asymptotically normal experiments, in the nonstandard context, however, of a curved parametrization. The results we derive for curved experiments are of independent interest,and likely to apply in other setups.

Suggested Citation

  • Marc Hallin & Davy Paindaveine & Thomas Verdebout, 2009. "Optimal rank-based testing for principal component," Working Papers ECARES 2009_013, ULB -- Universite Libre de Bruxelles.
  • Handle: RePEc:eca:wpaper:2009_013
    as

    Download full text from publisher

    File URL: https://dipot.ulb.ac.be/dspace/bitstream/2013/57551/1/RePEc_eca_wpaper_2009_013.pdf
    File Function: RePEc_eca_wpaper_2009_013
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marc Hallin & Madan Lal Puri, 1994. "Aligned rank tests for linear models with autocorrelated errors," ULB Institutional Repository 2013/2045, ULB -- Universite Libre de Bruxelles.
    2. Hallin Marc & Paindaveine Davy, 2006. "Parametric and semiparametric inference for shape: the role of the scale functional," Statistics & Risk Modeling, De Gruyter, vol. 24(3), pages 327-350, December.
    3. Hallin, Marc & Paindaveine, Davy, 2005. "Affine-invariant aligned rank tests for the multivariate general linear model with VARMA errors," Journal of Multivariate Analysis, Elsevier, vol. 93(1), pages 122-163, March.
    4. Wilfrid Van Pelt & Jan Van Rijckevorsel, 1986. "Non‐linear principal component analysis of maximum expiratory flow‐volume curves," Applied Stochastic Models and Data Analysis, John Wiley & Sons, vol. 2(1‐2), pages 1-12.
    5. Kollo, T. & Neudecker, H., 1993. "Asymptotics of Eigenvalues and Unit-Length Eigenvectors of Sample Variance and Correlation Matrices," Journal of Multivariate Analysis, Elsevier, vol. 47(2), pages 283-300, November.
    6. Salibian-Barrera, Matias & Van Aelst, Stefan & Willems, Gert, 2006. "Principal Components Analysis Based on Multivariate MM Estimators With Fast and Robust Bootstrap," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1198-1211, September.
    7. Marc Hallin & Bas Werker, 2003. "Semiparametric efficiency, distribution-freeness, and invariance," ULB Institutional Repository 2013/2119, ULB -- Universite Libre de Bruxelles.
    8. Yanagihara, Hirokazu & Tonda, Tetsuji & Matsumoto, Chieko, 2005. "The effects of nonnormality on asymptotic distributions of some likelihood ratio criteria for testing covariance structures under normal assumption," Journal of Multivariate Analysis, Elsevier, vol. 96(2), pages 237-264, October.
    9. Paindaveine, Davy, 2006. "A Chernoff-Savage result for shape:On the non-admissibility of pseudo-Gaussian methods," Journal of Multivariate Analysis, Elsevier, vol. 97(10), pages 2206-2220, November.
    10. Paindaveine, Davy, 2008. "A canonical definition of shape," Statistics & Probability Letters, Elsevier, vol. 78(14), pages 2240-2247, October.
    11. Hallin, Marc & Paindaveine, Davy, 2009. "Optimal tests for homogeneity of covariance, scale, and shape," Journal of Multivariate Analysis, Elsevier, vol. 100(3), pages 422-444, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hallin, M. & van den Akker, R. & Werker, B.J.M., 2012. "Rank-based Tests of the Cointegrating Rank in Semiparametric Error Correction Models," Other publications TiSEM bc68a2f2-3ca3-443c-b3ac-f, Tilburg University, School of Economics and Management.
    2. Eustasio Del Barrio & Alberto Gonzalez-Sanz & Marc Hallin, 2019. "A Note on the Regularity of Center-Outward Distribution and Quantile Functions," Working Papers ECARES 2019-33, ULB -- Universite Libre de Bruxelles.
    3. Christophe Ley & Yvik Swan & Thomas Verdebout, 2013. "Efficient ANOVA for Directional Data," Working Papers ECARES ECARES 2012-48, ULB -- Universite Libre de Bruxelles.
    4. Hallin, M. & Werker, B.J.M. & van den Akker, R., 2015. "Optimal Pseudo-Gaussian and Rank-based Tests of the Cointegration Rank in Semiparametric Error-correction Models," Other publications TiSEM d1b040c9-db57-4e55-846f-4, Tilburg University, School of Economics and Management.
    5. Davy Paindaveine & Julien Remy & Thomas Verdebout, 2019. "Sign Tests for Weak Principal Directions," Working Papers ECARES 2019-01, ULB -- Universite Libre de Bruxelles.
    6. Sladana Babic & Laetitia Gelbgras & Marc Hallin & Christophe Ley, 2019. "Optimal tests for elliptical symmetry: specified and unspecified location," Working Papers ECARES 2019-26, ULB -- Universite Libre de Bruxelles.
    7. Davy Paindaveine & Julien Remy & Thomas Verdebout, 2017. "Testing for Principal Component Directions under Weak Identifiability," Working Papers ECARES ECARES 2017-37, ULB -- Universite Libre de Bruxelles.
    8. Christophe Ley & Yvik Swan & Thomas Verdebout, 2017. "Efficient ANOVA for directional data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(1), pages 39-62, February.
    9. Paindaveine, Davy & Rasoafaraniaina, Rondrotiana Joséa & Verdebout, Thomas, 2017. "Preliminary test estimation for multi-sample principal components," Econometrics and Statistics, Elsevier, vol. 2(C), pages 106-116.
    10. Marc Hallin & Davy Paindaveine & Thomas Verdebout, 2014. "Efficient R-Estimation of Principal and Common Principal Components," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1071-1083, September.
    11. Davy Paindaveine & Thomas Verdebout, 2011. "Rank Tests for Elliptical Graphical Modeling," Working Papers ECARES ECARES 2011-039, ULB -- Universite Libre de Bruxelles.
    12. Hallin, Marc & van den Akker, Ramon & Werker, Bas J.M., 2016. "Semiparametric error-correction models for cointegration with trends: Pseudo-Gaussian and optimal rank-based tests of the cointegration rank," Journal of Econometrics, Elsevier, vol. 190(1), pages 46-61.
    13. Davy Paindaveine & Thomas Verdebout, 2013. "Optimal Rank-Based Tests for the Location Parameter of a Rotationally Symmetric Distribution on the Hypersphere," Working Papers ECARES ECARES 2013-36, ULB -- Universite Libre de Bruxelles.
    14. Marc Hallin & Davy Paindaveine & Thomas Verdebout, 2011. "Optimal Rank-Based Tests for Common Principal Components," Working Papers ECARES ECARES 2011-032, ULB -- Universite Libre de Bruxelles.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marc Hallin & Davy Paindaveine & Thomas Verdebout, 2011. "Optimal Rank-Based Tests for Common Principal Components," Working Papers ECARES ECARES 2011-032, ULB -- Universite Libre de Bruxelles.
    2. Frahm, Gabriel, 2009. "Asymptotic distributions of robust shape matrices and scales," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1329-1337, August.
    3. Marc Hallin, 2008. "On the Non Gaussian Asymptotics of the Likelihood Ratio Test Statistic for Homogeneity of Covariance," Working Papers ECARES 2008_039, ULB -- Universite Libre de Bruxelles.
    4. Hallin, Marc & La Vecchia, Davide, 2020. "A Simple R-estimation method for semiparametric duration models," Journal of Econometrics, Elsevier, vol. 218(2), pages 736-749.
    5. Bernard, Gaspard & Verdebout, Thomas, 2024. "On testing the equality of latent roots of scatter matrices under ellipticity," Journal of Multivariate Analysis, Elsevier, vol. 199(C).
    6. Hallin Marc & Paindaveine Davy, 2006. "Parametric and semiparametric inference for shape: the role of the scale functional," Statistics & Risk Modeling, De Gruyter, vol. 24(3), pages 327-350, December.
    7. Paindaveine, Davy, 2008. "A canonical definition of shape," Statistics & Probability Letters, Elsevier, vol. 78(14), pages 2240-2247, October.
    8. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    9. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    10. M. Hallin & D. La Vecchia & H. Liu, 2022. "Center-Outward R-Estimation for Semiparametric VARMA Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 925-938, April.
    11. Sladana Babic & Laetitia Gelbgras & Marc Hallin & Christophe Ley, 2019. "Optimal tests for elliptical symmetry: specified and unspecified location," Working Papers ECARES 2019-26, ULB -- Universite Libre de Bruxelles.
    12. Marc Hallin & Catherine Vermandele & Bas J. M. Werker, 2008. "Semiparametrically efficient inference based on signs and ranks for median‐restricted models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(2), pages 389-412, April.
    13. Hallin, M. & Vermandele, C. & Werker, B.J.M., 2003. "Serial and Nonserial Sign-and-Rank Statistics : Asymptotic Representation and Asymptotic Normality," Discussion Paper 2003-23, Tilburg University, Center for Economic Research.
    14. Hallin, M. & van den Akker, R. & Werker, B.J.M., 2012. "Rank-based Tests of the Cointegrating Rank in Semiparametric Error Correction Models," Other publications TiSEM bc68a2f2-3ca3-443c-b3ac-f, Tilburg University, School of Economics and Management.
    15. Davy Paindaveine & Germain Van Bever, 2017. "Tyler Shape Depth," Working Papers ECARES ECARES 2017-29, ULB -- Universite Libre de Bruxelles.
    16. Marc Hallin & Davy Paindaveine & Thomas Verdebout, 2014. "Efficient R-Estimation of Principal and Common Principal Components," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1071-1083, September.
    17. Hallin, M. & Werker, B.J.M. & van den Akker, R., 2015. "Optimal Pseudo-Gaussian and Rank-based Tests of the Cointegration Rank in Semiparametric Error-correction Models," Discussion Paper 2015-001, Tilburg University, Center for Economic Research.
    18. Aaron Fisher & Brian Caffo & Brian Schwartz & Vadim Zipunnikov, 2016. "Fast, Exact Bootstrap Principal Component Analysis for > 1 Million," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 846-860, April.
    19. Francq, C. & Jiménez-Gamero, M.D. & Meintanis, S.G., 2017. "Tests for conditional ellipticity in multivariate GARCH models," Journal of Econometrics, Elsevier, vol. 196(2), pages 305-319.
    20. Hallin, Marc & Paindaveine, Davy, 2009. "Optimal tests for homogeneity of covariance, scale, and shape," Journal of Multivariate Analysis, Elsevier, vol. 100(3), pages 422-444, March.

    More about this item

    Keywords

    Principal components; Tests for eigenvectors;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eca:wpaper:2009_013. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benoit Pauwels (email available below). General contact details of provider: https://edirc.repec.org/data/arulbbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.