IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v79y2023i2p1159-1172.html
   My bibliography  Save this article

The generalized Fisher's combination and accurate p‐value calculation under dependence

Author

Listed:
  • Hong Zhang
  • Zheyang Wu

Abstract

Combining dependent tests of significance has broad applications but the related p‐value calculation is challenging. For Fisher's combination test, current p‐value calculation methods (eg, Brown's approximation) tend to inflate the type I error rate when the desired significance level is substantially less than 0.05. The problem could lead to significant false discoveries in big data analyses. This paper provides two main contributions. First, it presents a general family of Fisher type statistics, referred to as the GFisher, which covers many classic statistics, such as Fisher's combination, Good's statistic, Lancaster's statistic, weighted Z‐score combination, and so forth. The GFisher allows a flexible weighting scheme, as well as an omnibus procedure that automatically adapts proper weights and the statistic‐defining parameters to a given data. Second, the paper presents several new p‐value calculation methods based on two novel ideas: moment‐ratio matching and joint‐distribution surrogating. Systematic simulations show that the new calculation methods are more accurate under multivariate Gaussian, and more robust under the generalized linear model and the multivariate t‐distribution. The applications of the GFisher and the new p‐value calculation methods are demonstrated by a gene‐based single nucleotide polymorphism (SNP)‐set association study. Relevant computation has been implemented to an R package GFisher available on the Comprehensive R Archive Network.

Suggested Citation

  • Hong Zhang & Zheyang Wu, 2023. "The generalized Fisher's combination and accurate p‐value calculation under dependence," Biometrics, The International Biometric Society, vol. 79(2), pages 1159-1172, June.
    • Handle: RePEc:bla:biomet:v:79:y:2023:i:2:p:1159-1172
    DOI: 10.1111/biom.13634
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13634
    Download Restriction: no
    File URL: https://libkey.io/10.1111/biom.13634?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hou‐Feng Zheng & Vincenzo Forgetta & Yi‐Hsiang Hsu & Karol Estrada & Alberto Rosello‐Diez & Paul J. Leo & Chitra L. Dahia & Kyung Hyun Park‐Min & Jonathan H. Tobias & Charles Kooperberg & Aaron Kleinm, 2015. "Whole‐genome sequencing identifies EN1 as a determinant of bone density and fracture," Nature, Nature, vol. 526(7571), pages 112-117, October.
    2. Ian Barnett & Rajarshi Mukherjee & Xihong Lin, 2017. "The Generalized Higher Criticism for Testing SNP-Set Effects in Genetic Association Studies," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 64-76, January.
    3. Yaowu Liu & Jun Xie, 2020. "Cauchy Combination Test: A Powerful Test With Analytic p-Value Calculation Under Arbitrary Dependency Structures," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(529), pages 393-402, January.
    4. Hou, Chia-Ding, 2005. "A simple approximation for the distribution of the weighted combination of non-independent or independent probabilities," Statistics & Probability Letters, Elsevier, vol. 73(2), pages 179-187, June.
    5. Robert B. Davies, 1980. "The Distribution of a Linear Combination of χ2 Random Variables," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 29(3), pages 323-333, November.
    6. Hongying Dai & Guodong Wu & Michael Wu & Degui Zhi, 2016. "An Optimal Bahadur-Efficient Method in Detection of Sparse Signals with Applications to Pathway Analysis in Sequencing Association Studies," PLOS ONE, Public Library of Science, vol. 11(7), pages 1-18, July.
    7. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    8. Chen, Zhongxue & Nadarajah, Saralees, 2014. "On the optimally weighted z-test for combining probabilities from independent studies," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 387-394.
    9. D. Y. Lin & D. Zeng, 2010. "On the relative efficiency of using summary statistics versus individual-level data in meta-analysis," Biometrika, Biometrika Trust, vol. 97(2), pages 321-332.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Hong & Wu, Zheyang, 2022. "The general goodness-of-fit tests for correlated data," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    2. Haque Md Rejuan & Kubatko Laura, 2024. "A global test of hybrid ancestry from genome-scale data," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 23(1), pages 1-18, January.
    3. Remo Monti & Pia Rautenstrauch & Mahsa Ghanbari & Alva Rani James & Matthias Kirchler & Uwe Ohler & Stefan Konigorski & Christoph Lippert, 2022. "Identifying interpretable gene-biomarker associations with functionally informed kernel-based tests in 190,000 exomes," Nature Communications, Nature, vol. 13(1), pages 1-16, December.
    4. Jinan Liu & Apostolos Serletis, 2023. "Volatility and dependence in energy markets," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 47(1), pages 15-37, March.
    5. Bierens, H.J. & Broersma, L., 1991. "The relation between unemployment and interest rate : some international evidence," Serie Research Memoranda 0112, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    6. Gourieroux, C. & Laurent, J. P. & Scaillet, O., 2000. "Sensitivity analysis of Values at Risk," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 225-245, November.
    7. Juncal Cunado & David Gabauer & Rangan Gupta, 2024. "Realized volatility spillovers between energy and metal markets: a time-varying connectedness approach," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-17, December.
    8. Amendola, Alessandra & Niglio, Marcella & Vitale, Cosimo, 2006. "The moments of SETARMA models," Statistics & Probability Letters, Elsevier, vol. 76(6), pages 625-633, March.
    9. Elie Bouri & Georges Azzi, 2014. "On the Dynamic Transmission of Mean and Volatility across the Arab Stock Markets," Journal of Emerging Market Finance, Institute for Financial Management and Research, vol. 13(3), pages 279-304, December.
    10. Raul Anibal Feliz & John H. Welch, 1992. "Cointegration and tests of a classical model of inflation in Argentina, Bolivia, Brazil, Mexico, And Peru," Working Papers 9210, Federal Reserve Bank of Dallas.
    11. Alolo, Mutaka & Azevedo, Alcino & El Kalak, Izidin, 2020. "The effect of the feed-in-system policy on renewable energy investments: Evidence from the EU countries," Energy Economics, Elsevier, vol. 92(C).
    12. Jan Marc Berk & Job Swank, 2007. "Regional real exchange rates and Phillips curves in monetary unions - Evidence from the US and EMU," DNB Working Papers 147, Netherlands Central Bank, Research Department.
    13. Eric Fur, 2023. "Risk and return of classic car market prices: passion or financial investment?," Journal of Asset Management, Palgrave Macmillan, vol. 24(1), pages 59-68, February.
    14. Balcilar, Mehmet & Hammoudeh, Shawkat & Toparli, Elif Akay, 2018. "On the risk spillover across the oil market, stock market, and the oil related CDS sectors: A volatility impulse response approach," Energy Economics, Elsevier, vol. 74(C), pages 813-827.
    15. Georgiev, Iliyan, 2010. "Model-based asymptotic inference on the effect of infrequent large shocks on cointegrated variables," Journal of Econometrics, Elsevier, vol. 158(1), pages 37-50, September.
    16. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    17. Matthias Duschl & Thomas Brenner, 2013. "Characteristics of regional industry-specific employment growth rates' distributions," Papers in Regional Science, Wiley Blackwell, vol. 92(2), pages 249-270, June.
    18. Jin, Xiaoye, 2015. "Volatility transmission and volatility impulse response functions among the Greater China stock markets," Journal of Asian Economics, Elsevier, vol. 39(C), pages 43-58.
    19. Busch, Thomas & Christensen, Bent Jesper & Nielsen, Morten Ørregaard, 2011. "The role of implied volatility in forecasting future realized volatility and jumps in foreign exchange, stock, and bond markets," Journal of Econometrics, Elsevier, vol. 160(1), pages 48-57, January.
    20. Chen, Zhongxue & Huang, Hanwen & Ng, Hon Keung Tony, 2014. "An improved robust association test for GWAS with multiple diseases," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 153-161.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:79:y:2023:i:2:p:1159-1172. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.