IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v139y2015icp79-91.html
   My bibliography  Save this article

High-dimensional tests for spherical location and spiked covariance

Author

Listed:
  • Ley, Christophe
  • Paindaveine, Davy
  • Verdebout, Thomas

Abstract

This paper mainly focuses on one of the most classical testing problems in directional statistics, namely the spherical location problem that consists in testing the null hypothesis H0:θ=θ0 under which the (rotational) symmetry center θ is equal to a given value θ0. The most classical procedure for this problem is the so-called Watson test, which is based on the sample mean of the observations. This test enjoys many desirable properties, but its asymptotic theory requires the sample size n to be large compared to the dimension p. This is a severe limitation, since more and more problems nowadays involve high-dimensional directional data (e.g., in genetics or text mining). In the present work, we derive the asymptotic null distribution of the Watson statistic as both n and p go to infinity. This reveals that (i) the Watson test is robust against high dimensionality, and that (ii) it allows for (n,p)-asymptotic results that are universal, in the sense that p may go to infinity arbitrarily fast (or slowly) as a function of n. Turning to Euclidean data, we show that our results also lead to a test for the null that the covariance matrix of a high-dimensional multinormal distribution has a “θ0-spiked” structure. Finally, Monte Carlo studies corroborate our asymptotic results and briefly explore non-null rejection frequencies.

Suggested Citation

  • Ley, Christophe & Paindaveine, Davy & Verdebout, Thomas, 2015. "High-dimensional tests for spherical location and spiked covariance," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 79-91.
    • Handle: RePEc:eee:jmvana:v:139:y:2015:i:c:p:79-91
    DOI: 10.1016/j.jmva.2015.02.019
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X15000664
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2015.02.019?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tony Cai, T. & Jiang, Tiefeng, 2012. "Phase transition in limiting distributions of coherence of high-dimensional random matrices," Journal of Multivariate Analysis, Elsevier, vol. 107(C), pages 24-39.
    2. Chen, Song Xi & Zhang, Li-Xin & Zhong, Ping-Shou, 2010. "Tests for High-Dimensional Covariance Matrices," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 810-819.
    3. Schott, James R., 2007. "Some high-dimensional tests for a one-way MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 98(9), pages 1825-1839, October.
    4. Srivastava, Muni S. & Fujikoshi, Yasunori, 2006. "Multivariate analysis of variance with fewer observations than the dimension," Journal of Multivariate Analysis, Elsevier, vol. 97(9), pages 1927-1940, October.
    5. Chen, Songxi, 2012. "Two Sample Tests for High Dimensional Covariance Matrices," MPRA Paper 46026, University Library of Munich, Germany.
    6. Davy Paindaveine & Thomas Verdebout, 2013. "Optimal Rank-Based Tests for the Location Parameter of a Rotationally Symmetric Distribution on the Hypersphere," Working Papers ECARES ECARES 2013-36, ULB -- Universite Libre de Bruxelles.
    7. Srivastava, Muni S. & Kubokawa, Tatsuya, 2013. "Tests for multivariate analysis of variance in high dimension under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 204-216.
    8. Chen, Song Xi & Qin, Yingli, 2010. "A Two Sample Test for High Dimensional Data with Applications to Gene-set Testing," MPRA Paper 59642, University Library of Munich, Germany.
    9. Srivastava, Muni S. & Katayama, Shota & Kano, Yutaka, 2013. "A two sample test in high dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 114(C), pages 349-358.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Feng, Long & Sun, Fasheng, 2015. "A note on high-dimensional two-sample test," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 29-36.
    2. Christine Cutting & Davy Paindaveine & Thomas Verdebout, 2015. "Tests of Concentration for Low-Dimensional and High-Dimensional Directional Data," Working Papers ECARES ECARES 2015-05, ULB -- Universite Libre de Bruxelles.
    3. Christine Cutting & Davy Paindaveine & Thomas Verdebout, 2015. "Testing Uniformity on High-Dimensional Spheres against Contiguous Rotationally Symmetric Alternatives," Working Papers ECARES ECARES 2015-04, ULB -- Universite Libre de Bruxelles.
    4. Anders Bredahl Kock & David Preinerstorfer, 2019. "Power in High‐Dimensional Testing Problems," Econometrica, Econometric Society, vol. 87(3), pages 1055-1069, May.
    5. Arthur Pewsey & Eduardo García-Portugués, 2021. "Recent advances in directional statistics," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(1), pages 1-58, March.
    6. Davy Paindaveine & Thomas Verdebout, 2017. "Detecting the Direction of a Signal on High-dimensional Spheres: Non-null and Le Cam Optimality Results," Working Papers ECARES ECARES 2017-40, ULB -- Universite Libre de Bruxelles.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davy Paindaveine & Thomas Verdebout, 2013. "Universal Asymptotics for High-Dimensional Sign Tests," Working Papers ECARES ECARES 2013-40, ULB -- Universite Libre de Bruxelles.
    2. Jiang Hu & Zhidong Bai & Chen Wang & Wei Wang, 2017. "On testing the equality of high dimensional mean vectors with unequal covariance matrices," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(2), pages 365-387, April.
    3. Huiqin Li & Jiang Hu & Zhidong Bai & Yanqing Yin & Kexin Zou, 2017. "Test on the linear combinations of mean vectors in high-dimensional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(1), pages 188-208, March.
    4. Harrar, Solomon W. & Kong, Xiaoli, 2022. "Recent developments in high-dimensional inference for multivariate data: Parametric, semiparametric and nonparametric approaches," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    5. Zhang, Jin-Ting & Guo, Jia & Zhou, Bu, 2017. "Linear hypothesis testing in high-dimensional one-way MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 200-216.
    6. Zhang, Jin-Ting & Zhou, Bu & Guo, Jia, 2022. "Linear hypothesis testing in high-dimensional heteroscedastic one-way MANOVA: A normal reference L2-norm based test," Journal of Multivariate Analysis, Elsevier, vol. 187(C).
    7. Jamshid Namdari & Debashis Paul & Lili Wang, 2021. "High-Dimensional Linear Models: A Random Matrix Perspective," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(2), pages 645-695, August.
    8. Muni S. Srivastava & Hirokazu Yanagihara & Tatsuya Kubokawa, 2014. "Tests for Covariance Matrices in High Dimension with Less Sample Size," CIRJE F-Series CIRJE-F-933, CIRJE, Faculty of Economics, University of Tokyo.
    9. Zhang, Jin-Ting & Zhu, Tianming, 2022. "A new normal reference test for linear hypothesis testing in high-dimensional heteroscedastic one-way MANOVA," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    10. Watanabe, Hiroki & Hyodo, Masashi & Nakagawa, Shigekazu, 2020. "Two-way MANOVA with unequal cell sizes and unequal cell covariance matrices in high-dimensional settings," Journal of Multivariate Analysis, Elsevier, vol. 179(C).
    11. Tianming Zhu & Jin-Ting Zhang, 2022. "Linear hypothesis testing in high-dimensional one-way MANOVA: a new normal reference approach," Computational Statistics, Springer, vol. 37(1), pages 1-27, March.
    12. Feng, Long & Sun, Fasheng, 2015. "A note on high-dimensional two-sample test," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 29-36.
    13. Bin Guo & Song Xi Chen, 2016. "Tests for high dimensional generalized linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(5), pages 1079-1102, November.
    14. Yin, Yanqing, 2021. "Test for high-dimensional mean vector under missing observations," Journal of Multivariate Analysis, Elsevier, vol. 186(C).
    15. Pini, Alessia & Stamm, Aymeric & Vantini, Simone, 2018. "Hotelling’s T2 in separable Hilbert spaces," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 284-305.
    16. Xu, Kai & Tian, Yan & He, Daojiang, 2021. "A high dimensional nonparametric test for proportional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 184(C).
    17. Zhang, Qiuyan & Wang, Chen & Zhang, Baoxue & Yang, Hu, 2024. "An RIHT statistic for testing the equality of several high-dimensional mean vectors under homoskedasticity," Computational Statistics & Data Analysis, Elsevier, vol. 190(C).
    18. Zhao, Junguang & Xu, Xingzhong, 2016. "A generalized likelihood ratio test for normal mean when p is greater than n," Computational Statistics & Data Analysis, Elsevier, vol. 99(C), pages 91-104.
    19. Jin-Ting Zhang & Bu Zhou & Jia Guo, 2022. "Testing high-dimensional mean vector with applications," Statistical Papers, Springer, vol. 63(4), pages 1105-1137, August.
    20. Long Feng & Changliang Zou & Zhaojun Wang, 2016. "Multivariate-Sign-Based High-Dimensional Tests for the Two-Sample Location Problem," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 721-735, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:139:y:2015:i:c:p:79-91. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.