IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v26y2017i1d10.1007_s11749-016-0499-x.html
   My bibliography  Save this article

Distribution-free tests for sparse heterogeneous mixtures

Author

Listed:
  • Ery Arias-Castro

    (University of California, San Diego)

  • Meng Wang

    (Stanford University)

Abstract

We consider the problem of detecting sparse heterogeneous mixtures from a nonparametric perspective. Specifically, we assume that the null distribution is symmetric about zero, while the true effects have positive median. We then suggest two new tests for this purpose. The main one is a form of Anderson–Darling test for symmetry and is closely related to the higher criticism. It is shown to achieve the detection boundary for the normal mixture model and, more generally, for asymptotically generalized Gaussian mixture models, in all sparsity regimes. The other test is a form of longest run test and specifically designed for the very sparse situation.

Suggested Citation

  • Ery Arias-Castro & Meng Wang, 2017. "Distribution-free tests for sparse heterogeneous mixtures," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(1), pages 71-94, March.
    • Handle: RePEc:spr:testjl:v:26:y:2017:i:1:d:10.1007_s11749-016-0499-x
    DOI: 10.1007/s11749-016-0499-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11749-016-0499-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11749-016-0499-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yu I. Ingster & Alexandre B. Tsybakov & N. Verzelzn, 2010. "Detection Boundary in Sparse Regression," Working Papers 2010-28, Center for Research in Economics and Statistics.
    2. Aurore Delaigle & Peter Hall & Jiashun Jin, 2011. "Robustness and accuracy of methods for high dimensional data analysis based on Student's t‐statistic," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(3), pages 283-301, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Sihai Dave & Cai, T. Tony & Li, Hongzhe, 2017. "Optimal detection of weak positive latent dependence between two sequences of multiple tests," Journal of Multivariate Analysis, Elsevier, vol. 160(C), pages 169-184.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chang, Meng-Shiuh & Wu, Ximing, 2015. "Transformation-based nonparametric estimation of multivariate densities," Journal of Multivariate Analysis, Elsevier, vol. 135(C), pages 71-88.
    2. Ian W. McKeague & Min Qian, 2015. "An Adaptive Resampling Test for Detecting the Presence of Significant Predictors," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1422-1433, December.
    3. Chen, Song Xi & Guo, Bin & Qiu, Yumou, 2023. "Testing and signal identification for two-sample high-dimensional covariances via multi-level thresholding," Journal of Econometrics, Elsevier, vol. 235(2), pages 1337-1354.
    4. Ian Barnett & Rajarshi Mukherjee & Xihong Lin, 2017. "The Generalized Higher Criticism for Testing SNP-Set Effects in Genetic Association Studies," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 64-76, January.
    5. Dennis Dobler & Markus Pauly, 2018. "Bootstrap- and permutation-based inference for the Mann–Whitney effect for right-censored and tied data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(3), pages 639-658, September.
    6. Rui Wang & Xingzhong Xu, 2021. "A Bayesian-motivated test for high-dimensional linear regression models with fixed design matrix," Statistical Papers, Springer, vol. 62(4), pages 1821-1852, August.
    7. Bailey, Natalia & Pesaran, M. Hashem & Smith, L. Vanessa, 2019. "A multiple testing approach to the regularisation of large sample correlation matrices," Journal of Econometrics, Elsevier, vol. 208(2), pages 507-534.
    8. Sardy, Sylvain & Diaz-Rodriguez, Jairo & Giacobino, Caroline, 2022. "Thresholding tests based on affine LASSO to achieve non-asymptotic nominal level and high power under sparse and dense alternatives in high dimension," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    9. Matthias Löffler & Richard Nickl, 2017. "Comments on: High-dimensional simultaneous inference with the bootstrap," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(4), pages 731-733, December.
    10. Andrew Harvey & Alessandra Luati, 2014. "Filtering With Heavy Tails," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1112-1122, September.
    11. He, Yi & Jaidee, Sombut & Gao, Jiti, 2023. "Most powerful test against a sequence of high dimensional local alternatives," Journal of Econometrics, Elsevier, vol. 234(1), pages 151-177.
    12. Zhao, Sihai Dave & Cai, T. Tony & Li, Hongzhe, 2017. "Optimal detection of weak positive latent dependence between two sequences of multiple tests," Journal of Multivariate Analysis, Elsevier, vol. 160(C), pages 169-184.
    13. He, Yong & Zhang, Mingjuan & Zhang, Xinsheng & Zhou, Wang, 2020. "High-dimensional two-sample mean vectors test and support recovery with factor adjustment," Computational Statistics & Data Analysis, Elsevier, vol. 151(C).
    14. Kimihiro Noguchi & Fernando Marmolejo-Ramos, 2016. "Assessing Equality of Means Using the Overlap of Range-Preserving Confidence Intervals," The American Statistician, Taylor & Francis Journals, vol. 70(4), pages 325-334, October.
    15. Chen, Song Xi & Li, Jun & Zhong, Pingshou, 2014. "Two-Sample Tests for High Dimensional Means with Thresholding and Data Transformation," MPRA Paper 59815, University Library of Munich, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:26:y:2017:i:1:d:10.1007_s11749-016-0499-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.