IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v79y2023i2p1159-1172.html
   My bibliography  Save this article

The generalized Fisher's combination and accurate p‐value calculation under dependence

Author

Listed:
  • Hong Zhang
  • Zheyang Wu

Abstract

Combining dependent tests of significance has broad applications but the related p‐value calculation is challenging. For Fisher's combination test, current p‐value calculation methods (eg, Brown's approximation) tend to inflate the type I error rate when the desired significance level is substantially less than 0.05. The problem could lead to significant false discoveries in big data analyses. This paper provides two main contributions. First, it presents a general family of Fisher type statistics, referred to as the GFisher, which covers many classic statistics, such as Fisher's combination, Good's statistic, Lancaster's statistic, weighted Z‐score combination, and so forth. The GFisher allows a flexible weighting scheme, as well as an omnibus procedure that automatically adapts proper weights and the statistic‐defining parameters to a given data. Second, the paper presents several new p‐value calculation methods based on two novel ideas: moment‐ratio matching and joint‐distribution surrogating. Systematic simulations show that the new calculation methods are more accurate under multivariate Gaussian, and more robust under the generalized linear model and the multivariate t‐distribution. The applications of the GFisher and the new p‐value calculation methods are demonstrated by a gene‐based single nucleotide polymorphism (SNP)‐set association study. Relevant computation has been implemented to an R package GFisher available on the Comprehensive R Archive Network.

Suggested Citation

  • Hong Zhang & Zheyang Wu, 2023. "The generalized Fisher's combination and accurate p‐value calculation under dependence," Biometrics, The International Biometric Society, vol. 79(2), pages 1159-1172, June.
    • Handle: RePEc:bla:biomet:v:79:y:2023:i:2:p:1159-1172
    DOI: 10.1111/biom.13634
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13634
    Download Restriction: no
    File URL: https://libkey.io/10.1111/biom.13634?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hou‐Feng Zheng & Vincenzo Forgetta & Yi‐Hsiang Hsu & Karol Estrada & Alberto Rosello‐Diez & Paul J. Leo & Chitra L. Dahia & Kyung Hyun Park‐Min & Jonathan H. Tobias & Charles Kooperberg & Aaron Kleinm, 2015. "Whole‐genome sequencing identifies EN1 as a determinant of bone density and fracture," Nature, Nature, vol. 526(7571), pages 112-117, October.
    2. Ian Barnett & Rajarshi Mukherjee & Xihong Lin, 2017. "The Generalized Higher Criticism for Testing SNP-Set Effects in Genetic Association Studies," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 64-76, January.
    3. Yaowu Liu & Jun Xie, 2020. "Cauchy Combination Test: A Powerful Test With Analytic p-Value Calculation Under Arbitrary Dependency Structures," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 393-402, January.
    4. Hou, Chia-Ding, 2005. "A simple approximation for the distribution of the weighted combination of non-independent or independent probabilities," Statistics & Probability Letters, Elsevier, vol. 73(2), pages 179-187, June.
    5. Robert B. Davies, 1980. "The Distribution of a Linear Combination of χ2 Random Variables," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 29(3), pages 323-333, November.
    6. Hongying Dai & Guodong Wu & Michael Wu & Degui Zhi, 2016. "An Optimal Bahadur-Efficient Method in Detection of Sparse Signals with Applications to Pathway Analysis in Sequencing Association Studies," PLOS ONE, Public Library of Science, vol. 11(7), pages 1-18, July.
    7. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    8. Chen, Zhongxue & Nadarajah, Saralees, 2014. "On the optimally weighted z-test for combining probabilities from independent studies," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 387-394.
    9. D. Y. Lin & D. Zeng, 2010. "On the relative efficiency of using summary statistics versus individual-level data in meta-analysis," Biometrika, Biometrika Trust, vol. 97(2), pages 321-332.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Hong & Wu, Zheyang, 2022. "The general goodness-of-fit tests for correlated data," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    2. Remo Monti & Pia Rautenstrauch & Mahsa Ghanbari & Alva Rani James & Matthias Kirchler & Uwe Ohler & Stefan Konigorski & Christoph Lippert, 2022. "Identifying interpretable gene-biomarker associations with functionally informed kernel-based tests in 190,000 exomes," Nature Communications, Nature, vol. 13(1), pages 1-16, December.
    3. Haque Md Rejuan & Kubatko Laura, 2024. "A global test of hybrid ancestry from genome-scale data," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 23(1), pages 1-18, January.
    4. Bierens, H.J. & Broersma, L., 1991. "The relation between unemployment and interest rate : some international evidence," Serie Research Memoranda 0112, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    5. Juncal Cunado & David Gabauer & Rangan Gupta, 2024. "Realized volatility spillovers between energy and metal markets: a time-varying connectedness approach," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-17, December.
    6. Elie Bouri & Georges Azzi, 2014. "On the Dynamic Transmission of Mean and Volatility across the Arab Stock Markets," Journal of Emerging Market Finance, Institute for Financial Management and Research, vol. 13(3), pages 279-304, December.
    7. Eric Fur, 2023. "Risk and return of classic car market prices: passion or financial investment?," Journal of Asset Management, Palgrave Macmillan, vol. 24(1), pages 59-68, February.
    8. Georgiev, Iliyan, 2010. "Model-based asymptotic inference on the effect of infrequent large shocks on cointegrated variables," Journal of Econometrics, Elsevier, vol. 158(1), pages 37-50, September.
    9. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    10. Jin, Xiaoye, 2015. "Volatility transmission and volatility impulse response functions among the Greater China stock markets," Journal of Asian Economics, Elsevier, vol. 39(C), pages 43-58.
    11. Chen, Zhongxue & Huang, Hanwen & Ng, Hon Keung Tony, 2014. "An improved robust association test for GWAS with multiple diseases," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 153-161.
    12. G. D. Gettinby & C. D. Sinclair & D. M. Power & R. A. Brown, 2004. "An Analysis of the Distribution of Extreme Share Returns in the UK from 1975 to 2000," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 31(5‐6), pages 607-646, June.
    13. Damian Jelito & Marcin Pitera, 2018. "New fat-tail normality test based on conditional second moments with applications to finance," Papers 1811.05464, arXiv.org, revised Apr 2020.
    14. Ilham Haouas & Naceur Kheraief & Arusha Cooray & Syed Jawad Hussain Shahzad, 2019. "Time-Varying Casual Nexuses Between Remittances and Financial Development in Some MENA Countries," Working Papers 1294, Economic Research Forum, revised 2019.
    15. Lenten, Liam J.A. & Geerling, Wayne & Kónya, László, 2012. "A hedonic model of player wage determination from the Indian Premier League auction: Further evidence," Sport Management Review, Elsevier, vol. 15(1), pages 60-71.
    16. Stephen Keef & Melvin Roush, 2005. "Day-of-the-week effects in the pre-holiday returns of the Standard & Poor's 500 stock index," Applied Financial Economics, Taylor & Francis Journals, vol. 15(2), pages 107-119.
    17. Martha Misas A. & Carlos Esteban Posada P & Diego Mauricio Vásquez E, 2003. "¿Está determinado el nivel de precios por las expectativas de dinero y producto en Colombia?," Revista ESPE - Ensayos Sobre Política Económica, Banco de la República, vol. 21(43), pages 8-31, June.
    18. Yuan, Di & Li, Sufang & Li, Rong & Zhang, Feipeng, 2022. "Economic policy uncertainty, oil and stock markets in BRIC: Evidence from quantiles analysis," Energy Economics, Elsevier, vol. 110(C).
    19. Benedikt Gasser & Joel Stouder, 2022. "Rescue Emergencies Due to High-Altitude Illnesses Are Rare in Switzerland," IJERPH, MDPI, vol. 19(2), pages 1-7, January.
    20. Bouri, Elie & Gabauer, David & Gupta, Rangan & Tiwari, Aviral Kumar, 2021. "Volatility connectedness of major cryptocurrencies: The role of investor happiness," Journal of Behavioral and Experimental Finance, Elsevier, vol. 30(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:79:y:2023:i:2:p:1159-1172. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.