IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v76y2020i4p1319-1329.html
   My bibliography  Save this article

Relative efficiency of using summary versus individual data in random‐effects meta‐analysis

Author

Listed:
  • Ding‐Geng Chen
  • Dungang Liu
  • Xiaoyi Min
  • Heping Zhang

Abstract

Meta‐analysis is a statistical methodology for combining information from diverse sources so that a more reliable and efficient conclusion can be reached. It can be conducted by either synthesizing study‐level summary statistics or drawing inference from an overarching model for individual participant data (IPD) if available. The latter is often viewed as the “gold standard.” For random‐effects models, however, it remains not fully understood whether the use of IPD indeed gains efficiency over summary statistics. In this paper, we examine the relative efficiency of the two methods under a general likelihood inference setting. We show theoretically and numerically that summary‐statistics‐based analysis is at most as efficient as IPD analysis, provided that the random effects follow the Gaussian distribution, and maximum likelihood estimation is used to obtain summary statistics. More specifically, (i) the two methods are equivalent in an asymptotic sense; and (ii) summary‐statistics‐based inference can incur an appreciable loss of efficiency if the sample sizes are not sufficiently large. Our results are established under the assumption that the between‐study heterogeneity parameter remains constant regardless of the sample sizes, which is different from a previous study. Our findings are confirmed by the analyses of simulated data sets and a real‐world study of alcohol interventions.

Suggested Citation

  • Ding‐Geng Chen & Dungang Liu & Xiaoyi Min & Heping Zhang, 2020. "Relative efficiency of using summary versus individual data in random‐effects meta‐analysis," Biometrics, The International Biometric Society, vol. 76(4), pages 1319-1329, December.
  • Handle: RePEc:bla:biomet:v:76:y:2020:i:4:p:1319-1329
    DOI: 10.1111/biom.13238
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13238
    Download Restriction: no

    File URL: https://libkey.io/10.1111/biom.13238?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dean A. Follmann & Michael A. Proschan, 1999. "Valid Inference in Random Effects Meta-Analysis," Biometrics, The International Biometric Society, vol. 55(3), pages 732-737, September.
    2. Thomas Mathew & Kenneth Nordstrom, 1999. "On the Equivalence of Meta-Analysis Using Literature and Using Individual Patient Data," Biometrics, The International Biometric Society, vol. 55(4), pages 1221-1223, December.
    3. Jarod Y. L. Lee & James J. Brown & Louise M. Ryan, 2017. "Sufficiency Revisited: Rethinking Statistical Algorithms in the Big Data Era," The American Statistician, Taylor & Francis Journals, vol. 71(3), pages 202-208, July.
    4. D. Y. Lin & D. Zeng, 2010. "On the relative efficiency of using summary statistics versus individual-level data in meta-analysis," Biometrika, Biometrika Trust, vol. 97(2), pages 321-332.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Böckenhoff, Annette & Hartung, Joachim, 2000. "Meta-analysis: Different methods - different conclusions?," Technical Reports 2000,08, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    2. Ruoyu Wang & Qihua Wang & Wang Miao, 2023. "A robust fusion-extraction procedure with summary statistics in the presence of biased sources," Biometrika, Biometrika Trust, vol. 110(4), pages 1023-1040.
    3. Elena Kulinskaya & Stephan Morgenthaler & Robert G. Staudte, 2014. "Combining Statistical Evidence," International Statistical Review, International Statistical Institute, vol. 82(2), pages 214-242, August.
    4. Dungang Liu & Regina Y. Liu & Minge Xie, 2015. "Multivariate Meta-Analysis of Heterogeneous Studies Using Only Summary Statistics: Efficiency and Robustness," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 326-340, March.
    5. repec:jss:jstsof:36:i03 is not listed on IDEAS
    6. Bon Joshua J. & Baffour Bernard & Spallek Melanie & Haynes Michele, 2020. "Analysing Sensitive Data from Dynamically-Generated Overlapping Contingency Tables," Journal of Official Statistics, Sciendo, vol. 36(2), pages 275-296, June.
    7. Julian P. T. Higgins & Simon G. Thompson & David J. Spiegelhalter, 2009. "A re‐evaluation of random‐effects meta‐analysis," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(1), pages 137-159, January.
    8. Shuang Zhang & Xingdong Feng, 2022. "Distributed identification of heterogeneous treatment effects," Computational Statistics, Springer, vol. 37(1), pages 57-89, March.
    9. G. Baker Stuart & S. Lindeman Karen, 2013. "Revisiting a Discrepant Result: A Propensity Score Analysis, the Paired Availability Design for Historical Controls, and a Meta-Analysis of Randomized Trials," Journal of Causal Inference, De Gruyter, vol. 1(1), pages 51-82, June.
    10. Jincheng Zhou & James S. Hodges & Haitao Chu, 2020. "Rejoinder to “CACE and meta‐analysis (letter to the editor)” by Stuart Baker," Biometrics, The International Biometric Society, vol. 76(4), pages 1385-1389, December.
    11. repec:jss:jstsof:30:i07 is not listed on IDEAS
    12. Hong Zhang & Zheyang Wu, 2023. "The generalized Fisher's combination and accurate p‐value calculation under dependence," Biometrics, The International Biometric Society, vol. 79(2), pages 1159-1172, June.
    13. Knapp, Guido & Hartung, Joachim, 2000. "Combined test procedures in the meta-analysis of controlled clinical trials," Technical Reports 2000,09, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    14. Nicole Deflaux & Margaret Sunitha Selvaraj & Henry Robert Condon & Kelsey Mayo & Sara Haidermota & Melissa A. Basford & Chris Lunt & Anthony A. Philippakis & Dan M. Roden & Joshua C. Denny & Anjene Mu, 2023. "Demonstrating paths for unlocking the value of cloud genomics through cross cohort analysis," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    15. Zhang, Hong & Wu, Zheyang, 2022. "The general goodness-of-fit tests for correlated data," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    16. Keisuke Hanada & Tomoyuki Sugimoto, 2023. "Inference using an exact distribution of test statistic for random-effects meta-analysis," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(2), pages 281-302, April.
    17. Ao Huang & Kosuke Morikawa & Tim Friede & Satoshi Hattori, 2023. "Adjusting for publication bias in meta‐analysis via inverse probability weighting using clinical trial registries," Biometrics, The International Biometric Society, vol. 79(3), pages 2089-2102, September.
    18. Janie McDonald & Patrick D. Gerard & Christopher S. McMahan & William R. Schucany, 2016. "Exact-Permutation-Based Sign Tests for Clustered Binary Data Via Weighted and Unweighted Test Statistics," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 21(4), pages 698-712, December.
    19. Tang, Lu & Zhou, Ling & Song, Peter X.-K., 2020. "Distributed simultaneous inference in generalized linear models via confidence distribution," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    20. Evangelos Kontopantelis & David Reeves, 2010. "metaan: Random-effects meta-analysis," Stata Journal, StataCorp LP, vol. 10(3), pages 395-407, September.
    21. Jiang, Rong & Yu, Keming, 2020. "Single-index composite quantile regression for massive data," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    22. Li, Haoqi & Lin, Huazhen & Yip, Paul S.F. & Li, Yuan, 2019. "Estimating population size of heterogeneous populations with large data sets and a large number of parameters," Computational Statistics & Data Analysis, Elsevier, vol. 139(C), pages 34-44.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:76:y:2020:i:4:p:1319-1329. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.