IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v56y2012i6p1935-1943.html
   My bibliography  Save this article

Adaptive combination of dependent tests

Author

Listed:
  • Sexton, Joseph
  • Blomhoff, Rune
  • Karlsen, Anette
  • Laake, Petter

Abstract

The construction of a multivariate two sample test is considered. An attractive approach to this problem, for instance when the data contain missing values or the number of variables is large, is to form an overall test by combining the componentwise test statistics. This can be done via their p-values or some other transformation. An important problem is how to perform the combination, as the relative power of a given combination will depend on the unknown true alternative. Recently, an approach has been proposed that makes use of the data to identify an appropriate combination. The method forms a pool of potential combinations of the componentwise p-values, setting the overall test statistic to the minimum p-value across the pool. One drawback of the approach, however, is that it does not utilize dependence between the componentwise tests, and thus potentially ignores valuable information. This issue is addressed, and two approaches are described that make use of the data to (1) determine which tests to combine; and (2) how best to utilize the between test statistic dependence. Simulations show that the proposed methods can lead to a substantial increase in power. An application to a dietary intervention study is given.

Suggested Citation

  • Sexton, Joseph & Blomhoff, Rune & Karlsen, Anette & Laake, Petter, 2012. "Adaptive combination of dependent tests," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1935-1943.
    • Handle: RePEc:eee:csdana:v:56:y:2012:i:6:p:1935-1943
    DOI: 10.1016/j.csda.2011.11.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947311004166
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2011.11.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yujun Wu & Marc G. Genton & Leonard A. Stefanski, 2006. "A Multivariate Two-Sample Mean Test for Small Sample Size and Missing Data," Biometrics, The International Biometric Society, vol. 62(3), pages 877-885, September.
    2. Loughin, Thomas M., 2004. "A systematic comparison of methods for combining p-values from independent tests," Computational Statistics & Data Analysis, Elsevier, vol. 47(3), pages 467-485, October.
    3. Salmaso, Luigi & Solari, Aldo, 2006. "Nonparametric iterated combined tests for genetic differentiation," Computational Statistics & Data Analysis, Elsevier, vol. 50(4), pages 1105-1112, February.
    4. Baringhaus, L. & Franz, C., 2004. "On a new multivariate two-sample test," Journal of Multivariate Analysis, Elsevier, vol. 88(1), pages 190-206, January.
    5. Marozzi, Marco, 2004. "A bi-aspect nonparametric test for the two-sample location problem," Computational Statistics & Data Analysis, Elsevier, vol. 44(4), pages 639-648, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Marozzi, 2012. "A combined test for differences in scale based on the interquantile range," Statistical Papers, Springer, vol. 53(1), pages 61-72, February.
    2. Masato Okamoto, 2009. "Decomposition of gini and multivariate gini indices," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 7(2), pages 153-177, June.
    3. Alexander Kaever & Manuel Landesfeind & Kirstin Feussner & Burkhard Morgenstern & Ivo Feussner & Peter Meinicke, 2014. "Meta-Analysis of Pathway Enrichment: Combining Independent and Dependent Omics Data Sets," PLOS ONE, Public Library of Science, vol. 9(2), pages 1-12, February.
    4. Qiu, Tao & Zhang, Qintong & Fang, Yuanyuan & Xu, Wangli, 2024. "Testing homogeneity in high dimensional data through random projections," Journal of Multivariate Analysis, Elsevier, vol. 200(C).
    5. Lan Cheng & Xuguang Simon Sheng, 2017. "Combination of “combinations of p values”," Empirical Economics, Springer, vol. 53(1), pages 329-350, August.
    6. Doyle, John R. & Chen, Catherine H., 2013. "Patterns in stock market movements tested as random number generators," European Journal of Operational Research, Elsevier, vol. 227(1), pages 122-132.
    7. Xuguang Sheng & Jingyun Yang, 2013. "Truncated Product Methods for Panel Unit Root Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(4), pages 624-636, August.
    8. Mondal, Pronoy K. & Biswas, Munmun & Ghosh, Anil K., 2015. "On high dimensional two-sample tests based on nearest neighbors," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 168-178.
    9. V. Alba Fernández & D. Barrera Rosillo & M. Ibáñez Pérez & M. Jiménez Gamero, 2009. "A homogeneity test for bivariate random variables," Computational Statistics, Springer, vol. 24(3), pages 513-531, August.
    10. Yoav Benjamini & Ruth Heller, 2008. "Screening for Partial Conjunction Hypotheses," Biometrics, The International Biometric Society, vol. 64(4), pages 1215-1222, December.
    11. Sunil Mathur, 2009. "A new nonparametric bivariate test for two sample location problem," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 18(3), pages 375-388, August.
    12. Dominika Polko-Zając, 2019. "On Permutation Location–Scale Tests," Statistics in Transition New Series, Polish Statistical Association, vol. 20(4), pages 153-166, December.
    13. Polko-Zając Dominika, 2019. "On Permutation Location–Scale Tests," Statistics in Transition New Series, Statistics Poland, vol. 20(4), pages 153-166, December.
    14. Xianzheng Huang, 2009. "Diagnosis of Random-Effect Model Misspecification in Generalized Linear Mixed Models for Binary Response," Biometrics, The International Biometric Society, vol. 65(2), pages 361-368, June.
    15. Zhang, Jin-Ting & Zhu, Tianming, 2022. "A new normal reference test for linear hypothesis testing in high-dimensional heteroscedastic one-way MANOVA," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    16. Kechris Katerina J & Biehs Brian & Kornberg Thomas B, 2010. "Generalizing Moving Averages for Tiling Arrays Using Combined P-Value Statistics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 9(1), pages 1-31, August.
    17. Chen, Zhongxue & Nadarajah, Saralees, 2014. "On the optimally weighted z-test for combining probabilities from independent studies," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 387-394.
    18. Paul, Biplab & De, Shyamal K. & Ghosh, Anil K., 2022. "Some clustering-based exact distribution-free k-sample tests applicable to high dimension, low sample size data," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    19. Alba Fernández, V. & Jiménez Gamero, M.D. & Muñoz Garcia, J., 2008. "A test for the two-sample problem based on empirical characteristic functions," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3730-3748, March.
    20. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian density forecasting of intraday electricity prices using multivariate skew t distributions," International Journal of Forecasting, Elsevier, vol. 24(4), pages 710-727.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:56:y:2012:i:6:p:1935-1943. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.