IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v115y2020i530p1011-1027.html
   My bibliography  Save this article

A Simple Two-Sample Test in High Dimensions Based on L2-Norm

Author

Listed:
  • Jin-Ting Zhang
  • Jia Guo
  • Bu Zhou
  • Ming-Yen Cheng

Abstract

Testing the equality of two means is a fundamental inference problem. For high-dimensional data, the Hotelling’s T2-test either performs poorly or becomes inapplicable. Several modifications have been proposed to address this issue. However, most of them are based on asymptotic normality of the null distributions of their test statistics which inevitably requires strong assumptions on the covariance. We study this problem thoroughly and propose an L2-norm based test that works under mild conditions and even when there are fewer observations than the dimension. Specially, to cope with general nonnormality of the null distribution we employ the Welch–Satterthwaite χ2-approximation. We derive a sharp upper bound on the approximation error and use it to justify that χ2-approximation is preferred to normal approximation. Simple ratio-consistent estimators for the parameters in the χ2-approximation are given. Importantly, our test can cope with singularity or near singularity of the covariance which is commonly seen in high dimensions and is the main cause of nonnormality. The power of the proposed test is also investigated. Extensive simulation studies and an application show that our test is at least comparable to and often outperforms several competitors in terms of size control, and the powers are comparable when their sizes are. Supplementary materials for this article are available online.

Suggested Citation

  • Jin-Ting Zhang & Jia Guo & Bu Zhou & Ming-Yen Cheng, 2020. "A Simple Two-Sample Test in High Dimensions Based on L2-Norm," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 1011-1027, April.
  • Handle: RePEc:taf:jnlasa:v:115:y:2020:i:530:p:1011-1027
    DOI: 10.1080/01621459.2019.1604366
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2019.1604366
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/01621459.2019.1604366?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Jin-Ting & Zhou, Bu & Guo, Jia, 2022. "Linear hypothesis testing in high-dimensional heteroscedastic one-way MANOVA: A normal reference L2-norm based test," Journal of Multivariate Analysis, Elsevier, vol. 187(C).
    2. Mingxiang Cao & Ziyang Cheng & Kai Xu & Daojiang He, 2024. "A scale-invariant test for linear hypothesis of means in high dimensions," Statistical Papers, Springer, vol. 65(6), pages 3477-3497, August.
    3. Zhang, Jin-Ting & Guo, Jia & Zhou, Bu, 2024. "Testing equality of several distributions in separable metric spaces: A maximum mean discrepancy based approach," Journal of Econometrics, Elsevier, vol. 239(2).
    4. Shu, Lei & Chen, Yu & Zhang, Weiping & Wang, Xueqin, 2022. "Spatial rank-based high-dimensional change point detection via random integration," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    5. Tianming Zhu & Pengfei Wang & Jin-Ting Zhang, 2024. "Two-sample Behrens–Fisher problems for high-dimensional data: a normal reference F-type test," Computational Statistics, Springer, vol. 39(6), pages 3207-3230, September.
    6. Zhang, Jin-Ting & Zhu, Tianming, 2022. "A new normal reference test for linear hypothesis testing in high-dimensional heteroscedastic one-way MANOVA," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    7. Mingxiang Cao & Yuanjing He, 2022. "A high-dimensional test on linear hypothesis of means under a low-dimensional factor model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(5), pages 557-572, July.
    8. Yuanyuan Jiang & Xingzhong Xu, 2022. "A Two-Sample Test of High Dimensional Means Based on Posterior Bayes Factor," Mathematics, MDPI, vol. 10(10), pages 1-23, May.
    9. Huang, Yuan & Li, Changcheng & Li, Runze & Yang, Songshan, 2022. "An overview of tests on high-dimensional means," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    10. Jin-Ting Zhang & Bu Zhou & Jia Guo, 2022. "Testing high-dimensional mean vector with applications," Statistical Papers, Springer, vol. 63(4), pages 1105-1137, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:115:y:2020:i:530:p:1011-1027. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.