IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v110y2015i509p326-340.html
   My bibliography  Save this article

Multivariate Meta-Analysis of Heterogeneous Studies Using Only Summary Statistics: Efficiency and Robustness

Author

Listed:
  • Dungang Liu
  • Regina Y. Liu
  • Minge Xie

Abstract

Meta-analysis has been widely used to synthesize evidence from multiple studies for common hypotheses or parameters of interest. However, it has not yet been fully developed for incorporating heterogeneous studies, which arise often in applications due to different study designs, populations, or outcomes. For heterogeneous studies, the parameter of interest may not be estimable for certain studies, and in such a case, these studies are typically excluded from conventional meta-analysis. The exclusion of part of the studies can lead to a nonnegligible loss of information. This article introduces a meta-analysis for heterogeneous studies by combining the confidence density functions derived from the summary statistics of individual studies, hence referred to as the CD approach. It includes all the studies in the analysis and makes use of all information, direct as well as indirect. Under a general likelihood inference framework, this new approach is shown to have several desirable properties, including: (i) it is asymptotically as efficient as the maximum likelihood approach using individual participant data (IPD) from all studies; (ii) unlike the IPD analysis, it suffices to use summary statistics to carry out the CD approach. Individual-level data are not required; and (iii) it is robust against misspecification of the working covariance structure of parameter estimates. Besides its own theoretical significance, the last property also substantially broadens the applicability of the CD approach. All the properties of the CD approach are further confirmed by data simulated from a randomized clinical trials setting as well as by real data on aircraft landing performance. Overall, one obtains a unifying approach for combining summary statistics, subsuming many of the existing meta-analysis methods as special cases.

Suggested Citation

  • Dungang Liu & Regina Y. Liu & Minge Xie, 2015. "Multivariate Meta-Analysis of Heterogeneous Studies Using Only Summary Statistics: Efficiency and Robustness," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 326-340, March.
    • Handle: RePEc:taf:jnlasa:v:110:y:2015:i:509:p:326-340
    DOI: 10.1080/01621459.2014.899235
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2014.899235
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/01621459.2014.899235?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ryan Martin & Chuanhai Liu, 2013. "Inferential Models: A Framework for Prior-Free Posterior Probabilistic Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 301-313, March.
    2. Thomas Mathew & Kenneth Nordstrom, 1999. "On the Equivalence of Meta-Analysis Using Literature and Using Individual Patient Data," Biometrics, The International Biometric Society, vol. 55(4), pages 1221-1223, December.
    3. D. Y. Lin & D. Zeng, 2010. "On the relative efficiency of using summary statistics versus individual-level data in meta-analysis," Biometrika, Biometrika Trust, vol. 97(2), pages 321-332.
    4. Xie, Minge & Singh, Kesar & Strawderman, William E., 2011. "Confidence Distributions and a Unifying Framework for Meta-Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 320-333.
    5. Min-ge Xie & Kesar Singh, 2013. "Confidence Distribution, the Frequentist Distribution Estimator of a Parameter: A Review," International Statistical Review, International Statistical Institute, vol. 81(1), pages 3-39, April.
    6. A. E. Ades & A. J. Sutton, 2006. "Multiparameter evidence synthesis in epidemiology and medical decision‐making: current approaches," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(1), pages 5-35, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wei Wang & Shou‐En Lu & Jerry Q. Cheng & Minge Xie & John B. Kostis, 2022. "Multivariate survival analysis in big data: A divide‐and‐combine approach," Biometrics, The International Biometric Society, vol. 78(3), pages 852-866, September.
    2. Nezakati, Ensiyeh & Pircalabelu, Eugen, 2021. "Unbalanced distributed estimation and inference for precision matrices," LIDAM Discussion Papers ISBA 2021031, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    3. Céline Cunen & Nils Lid Hjort, 2022. "Combining information across diverse sources: The II‐CC‐FF paradigm," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(2), pages 625-656, June.
    4. Bodnar, Olha & Bodnar, Taras, 2021. "Objective Bayesian meta-analysis based on generalized multivariate random effects model," Working Papers 2021:5, Örebro University, School of Business.
    5. Guang Yang & Dungang Liu & Junyuan Wang & Min‐ge Xie, 2016. "Meta‐analysis framework for exact inferences with application to the analysis of rare events," Biometrics, The International Biometric Society, vol. 72(4), pages 1378-1386, December.
    6. Veronese, Piero & Melilli, Eugenio, 2018. "Some asymptotic results for fiducial and confidence distributions," Statistics & Probability Letters, Elsevier, vol. 134(C), pages 98-105.
    7. Liu, Xuhua & Li, Na & Hu, Yuqin, 2015. "Combining inferences on the common mean of several inverse Gaussian distributions based on confidence distribution," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 136-142.
    8. Ruoyu Wang & Qihua Wang & Wang Miao, 2023. "A robust fusion-extraction procedure with summary statistics in the presence of biased sources," Biometrika, Biometrika Trust, vol. 110(4), pages 1023-1040.
    9. Bodnar, Olha & Bodnar, Taras, 2024. "Gibbs sampler approach for objective Bayesian inference in elliptical multivariate meta-analysis random effects model," Computational Statistics & Data Analysis, Elsevier, vol. 197(C).
    10. Tang, Lu & Zhou, Ling & Song, Peter X.-K., 2020. "Distributed simultaneous inference in generalized linear models via confidence distribution," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    11. Jiang, Rong & Yu, Keming, 2020. "Single-index composite quantile regression for massive data," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    12. Zhao, Xiujie & Chen, Piao & Gaudoin, Olivier & Doyen, Laurent, 2021. "Accelerated degradation tests with inspection effects," European Journal of Operational Research, Elsevier, vol. 292(3), pages 1099-1114.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruoyu Wang & Qihua Wang & Wang Miao, 2023. "A robust fusion-extraction procedure with summary statistics in the presence of biased sources," Biometrika, Biometrika Trust, vol. 110(4), pages 1023-1040.
    2. Randy C. S. Lai & Jan Hannig & Thomas C. M. Lee, 2015. "Generalized Fiducial Inference for Ultrahigh-Dimensional Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 760-772, June.
    3. Elena Kulinskaya & Stephan Morgenthaler & Robert G. Staudte, 2014. "Combining Statistical Evidence," International Statistical Review, International Statistical Institute, vol. 82(2), pages 214-242, August.
    4. Xuhua Liu & Xingzhong Xu, 2016. "Confidence distribution inferences in one-way random effects model," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 59-74, March.
    5. Tang, Lu & Zhou, Ling & Song, Peter X.-K., 2020. "Distributed simultaneous inference in generalized linear models via confidence distribution," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    6. Guang Yang & Dungang Liu & Junyuan Wang & Min‐ge Xie, 2016. "Meta‐analysis framework for exact inferences with application to the analysis of rare events," Biometrics, The International Biometric Society, vol. 72(4), pages 1378-1386, December.
    7. La Vecchia, Davide & Moor, Alban & Scaillet, Olivier, 2023. "A higher-order correct fast moving-average bootstrap for dependent data," Journal of Econometrics, Elsevier, vol. 235(1), pages 65-81.
    8. Xiaokang Luo & Tirthankar Dasgupta & Minge Xie & Regina Y. Liu, 2021. "Leveraging the Fisher randomization test using confidence distributions: Inference, combination and fusion learning," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(4), pages 777-797, September.
    9. Jiang, Rong & Yu, Keming, 2020. "Single-index composite quantile regression for massive data," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    10. Wei Wang & Shou‐En Lu & Jerry Q. Cheng & Minge Xie & John B. Kostis, 2022. "Multivariate survival analysis in big data: A divide‐and‐combine approach," Biometrics, The International Biometric Society, vol. 78(3), pages 852-866, September.
    11. Eugenio Melilli & Piero Veronese, 2024. "Confidence distributions and hypothesis testing," Statistical Papers, Springer, vol. 65(6), pages 3789-3820, August.
    12. Hector, Emily C. & Luo, Lan & Song, Peter X.-K., 2023. "Parallel-and-stream accelerator for computationally fast supervised learning," Computational Statistics & Data Analysis, Elsevier, vol. 177(C).
    13. Ionut Bebu & George Luta & Thomas Mathew & Brian K. Agan, 2016. "Generalized Confidence Intervals and Fiducial Intervals for Some Epidemiological Measures," IJERPH, MDPI, vol. 13(6), pages 1-13, June.
    14. Ding‐Geng Chen & Dungang Liu & Xiaoyi Min & Heping Zhang, 2020. "Relative efficiency of using summary versus individual data in random‐effects meta‐analysis," Biometrics, The International Biometric Society, vol. 76(4), pages 1319-1329, December.
    15. Wu, Suofei & Hannig, Jan & Lee, Thomas C.M., 2022. "Uncertainty quantification for honest regression trees," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    16. Changgee Chang & Zhiqi Bu & Qi Long, 2023. "CEDAR: communication efficient distributed analysis for regressions," Biometrics, The International Biometric Society, vol. 79(3), pages 2357-2369, September.
    17. Piero Veronese & Eugenio Melilli, 2015. "Fiducial and Confidence Distributions for Real Exponential Families," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(2), pages 471-484, June.
    18. Céline Cunen & Nils Lid Hjort, 2022. "Combining information across diverse sources: The II‐CC‐FF paradigm," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(2), pages 625-656, June.
    19. Liu, Xuhua & Li, Na & Hu, Yuqin, 2015. "Combining inferences on the common mean of several inverse Gaussian distributions based on confidence distribution," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 136-142.
    20. Michael P. Fay & Michael A. Proschan & Erica Brittain, 2015. "Combining one-sample confidence procedures for inference in the two-sample case," Biometrics, The International Biometric Society, vol. 71(1), pages 146-156, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:110:y:2015:i:509:p:326-340. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.