IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v112y2012icp156-171.html
   My bibliography  Save this article

Testing the structure of the covariance matrix with fewer observations than the dimension

Author

Listed:
  • Srivastava, Muni S.
  • Reid, N.

Abstract

We consider two hypothesis testing problems with N independent observations on a single m-vector, when m>N, and the N observations on the random m-vector are independently and identically distributed as multivariate normal with mean vector μ and covariance matrix Σ, both unknown. In the first problem, the m-vector is partitioned into two sub-vectors of dimensions m1 and m2, respectively, and we propose two tests for the independence of the two sub-vectors that are valid as (m,N)→∞. The asymptotic distribution of the test statistics under the hypothesis of independence is shown to be standard normal, and the power examined by simulations. The proposed tests perform better than the likelihood ratio test, although the latter can only be used when m is smaller than N. The second problem addressed is that of testing the hypothesis that the covariance matrix Σ is of the intraclass correlation structure. A statistic for testing this is proposed, and assessed via simulations; again the proposed test statistic compares favorably with the likelihood ratio test.

Suggested Citation

  • Srivastava, Muni S. & Reid, N., 2012. "Testing the structure of the covariance matrix with fewer observations than the dimension," Journal of Multivariate Analysis, Elsevier, vol. 112(C), pages 156-171.
    • Handle: RePEc:eee:jmvana:v:112:y:2012:i:c:p:156-171
    DOI: 10.1016/j.jmva.2012.06.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X12001509
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2012.06.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dudoit S. & Fridlyand J. & Speed T. P, 2002. "Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 77-87, March.
    2. James R. Schott, 2005. "Testing for complete independence in high dimensions," Biometrika, Biometrika Trust, vol. 92(4), pages 951-956, December.
    3. Srivastava, Muni S. & Yanagihara, Hirokazu, 2010. "Testing the equality of several covariance matrices with fewer observations than the dimension," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1319-1329, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yongshuai Chen & Wenwen Guo & Hengjian Cui, 2024. "On the test of covariance between two high-dimensional random vectors," Statistical Papers, Springer, vol. 65(5), pages 2687-2717, July.
    2. Masashi Hyodo & Nobumichi Shutoh & Takahiro Nishiyama & Tatjana Pavlenko, 2015. "Testing block-diagonal covariance structure for high-dimensional data," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 69(4), pages 460-482, November.
    3. Yamada, Yuki & Hyodo, Masashi & Nishiyama, Takahiro, 2017. "Testing block-diagonal covariance structure for high-dimensional data under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 305-316.
    4. Xu, Kai & Hao, Xinxin, 2019. "A nonparametric test for block-diagonal covariance structure in high dimension and small samples," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 551-567.
    5. Hyodo, Masashi & Nishiyama, Takahiro & Pavlenko, Tatjana, 2020. "Testing for independence of high-dimensional variables: ρV-coefficient based approach," Journal of Multivariate Analysis, Elsevier, vol. 178(C).
    6. Yata, Kazuyoshi & Aoshima, Makoto, 2016. "High-dimensional inference on covariance structures via the extended cross-data-matrix methodology," Journal of Multivariate Analysis, Elsevier, vol. 151(C), pages 151-166.
    7. Feng, Long & Zhang, Xiaoxu & Liu, Binghui, 2020. "Multivariate tests of independence and their application in correlation analysis between financial markets," Journal of Multivariate Analysis, Elsevier, vol. 179(C).
    8. Yongcheng Qi & Fang Wang & Lin Zhang, 2019. "Limiting distributions of likelihood ratio test for independence of components for high-dimensional normal vectors," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(4), pages 911-946, August.
    9. Jiayu Lai & Xiaoyi Wang & Kaige Zhao & Shurong Zheng, 2023. "Block-diagonal test for high-dimensional covariance matrices," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(1), pages 447-466, March.
    10. Aki Ishii & Kazuyoshi Yata & Makoto Aoshima, 2021. "Hypothesis tests for high-dimensional covariance structures," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 599-622, June.
    11. Peng, Liuhua & Chen, Song Xi & Zhou, Wen, 2016. "More powerful tests for sparse high-dimensional covariances matrices," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 124-143.
    12. Mingyue Hu & Yongcheng Qi, 2023. "Limiting distributions of the likelihood ratio test statistics for independence of normal random vectors," Statistical Papers, Springer, vol. 64(3), pages 923-954, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peng, Liuhua & Chen, Song Xi & Zhou, Wen, 2016. "More powerful tests for sparse high-dimensional covariances matrices," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 124-143.
    2. Fisher, Thomas J. & Sun, Xiaoqian & Gallagher, Colin M., 2010. "A new test for sphericity of the covariance matrix for high dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 101(10), pages 2554-2570, November.
    3. Xu, Kai & Hao, Xinxin, 2019. "A nonparametric test for block-diagonal covariance structure in high dimension and small samples," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 551-567.
    4. Long Feng & Changliang Zou & Zhaojun Wang, 2016. "Multivariate-Sign-Based High-Dimensional Tests for the Two-Sample Location Problem," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 721-735, April.
    5. Jiayu Lai & Xiaoyi Wang & Kaige Zhao & Shurong Zheng, 2023. "Block-diagonal test for high-dimensional covariance matrices," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(1), pages 447-466, March.
    6. Kubokawa, Tatsuya & Srivastava, Muni S., 2008. "Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 99(9), pages 1906-1928, October.
    7. Hossain, Ahmed & Beyene, Joseph & Willan, Andrew R. & Hu, Pingzhao, 2009. "A flexible approximate likelihood ratio test for detecting differential expression in microarray data," Computational Statistics & Data Analysis, Elsevier, vol. 53(10), pages 3685-3695, August.
    8. Bilin Zeng & Xuerong Meggie Wen & Lixing Zhu, 2017. "A link-free sparse group variable selection method for single-index model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(13), pages 2388-2400, October.
    9. Chen, Song Xi & Guo, Bin & Qiu, Yumou, 2023. "Testing and signal identification for two-sample high-dimensional covariances via multi-level thresholding," Journal of Econometrics, Elsevier, vol. 235(2), pages 1337-1354.
    10. Márton Gosztonyi & Csákné Filep Judit, 2022. "Profiling (Non-)Nascent Entrepreneurs in Hungary Based on Machine Learning Approaches," Sustainability, MDPI, vol. 14(6), pages 1-20, March.
    11. Wang, Tao & Xu, Pei-Rong & Zhu, Li-Xing, 2012. "Non-convex penalized estimation in high-dimensional models with single-index structure," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 221-235.
    12. Zhao, Jianhua & Yu, Philip L.H. & Shi, Lei & Li, Shulan, 2012. "Separable linear discriminant analysis," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 4290-4300.
    13. Shaheena Bashir & Edward Carter, 2010. "Penalized multinomial mixture logit model," Computational Statistics, Springer, vol. 25(1), pages 121-141, March.
    14. Qiu, Yumou & Chen, Songxi, 2012. "Test for Bandedness of High Dimensional Covariance Matrices with Bandwidth Estimation," MPRA Paper 46242, University Library of Munich, Germany.
    15. Park, Junyong & Park, DoHwan, 2015. "Stein’s method in high dimensional classification and applications," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 110-125.
    16. Chakraborty, Sounak, 2009. "Bayesian binary kernel probit model for microarray based cancer classification and gene selection," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4198-4209, October.
    17. Kasim Adetayo & Lin Dan & Van Sanden Suzy & Clevert Djork-Arné & Bijnens Luc & Göhlmann Hinrich & Amaratunga Dhammika & Hochreiter Sepp & Shkedy Ziv & Talloen Willem, 2010. "Informative or Noninformative Calls for Gene Expression: A Latent Variable Approach," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 9(1), pages 1-31, January.
    18. Yukun Liu & Changliang Zou & Zhaojun Wang, 2013. "Calibration of the empirical likelihood for high-dimensional data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(3), pages 529-550, June.
    19. Mao, Guangyu, 2018. "Testing independence in high dimensions using Kendall’s tau," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 128-137.
    20. Ke-Hai Yuan & Yubin Tian & Hirokazu Yanagihara, 2015. "Empirical Correction to the Likelihood Ratio Statistic for Structural Equation Modeling with Many Variables," Psychometrika, Springer;The Psychometric Society, vol. 80(2), pages 379-405, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:112:y:2012:i:c:p:156-171. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.