IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v82y2014i2p214-242.html
   My bibliography  Save this article

Combining Statistical Evidence

Author

Listed:
  • Elena Kulinskaya
  • Stephan Morgenthaler
  • Robert G. Staudte

Abstract

type="main" xml:id="insr12037-abs-0001"> The combination of evidence from independent studies has a curious history. The origins reach back at least to the beginning of the 20th century. Since the mid-1970s, meta-analysis has become popular in several fields, among them medical statistics and the behavioural sciences. The most widely used procedures were perfected in early papers, and subsequently, a kind of groupthink has taken hold of meta-analysis. This explains the need for a review in a statistics journal, destined for a statistical audience. Meta-analysis is not a hot research topic among graduate students in statistics, and by writing this article, we hope to change this. We wish to point out the shortcomings of the mainstream view and exhibit some of the open problems that await the attention of statistical researchers. A host of competent reviews of meta-analysis have been published, and several book-length treatments are also available. We have listed many of these in the bibliography but cannot guarantee completeness.

Suggested Citation

  • Elena Kulinskaya & Stephan Morgenthaler & Robert G. Staudte, 2014. "Combining Statistical Evidence," International Statistical Review, International Statistical Institute, vol. 82(2), pages 214-242, August.
    • Handle: RePEc:bla:istatr:v:82:y:2014:i:2:p:214-242
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/insr.12037
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Han Chen & Alisa K. Manning & Josée Dupuis, 2012. "A Method of Moments Estimator for Random Effect Multivariate Meta-Analysis," Biometrics, The International Biometric Society, vol. 68(4), pages 1278-1284, December.
    2. Ian R. White, 2009. "Multivariate random-effects meta-analysis," Stata Journal, StataCorp LP, vol. 9(1), pages 40-56, March.
    3. Xie, Minge & Singh, Kesar & Strawderman, William E., 2011. "Confidence Distributions and a Unifying Framework for Meta-Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 320-333.
    4. Andrew L. Rukhin, 2013. "Estimating heterogeneity variance in meta-analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 451-469, June.
    5. Sidik, Kurex & Jonkman, Jeffrey N., 2006. "Robust variance estimation for random effects meta-analysis," Computational Statistics & Data Analysis, Elsevier, vol. 50(12), pages 3681-3701, August.
    6. Chang, Ching-Hui & Pal, Nabendu, 2008. "Testing on the common mean of several normal distributions," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 321-333, December.
    7. Thomas Mathew & Kenneth Nordstrom, 1999. "On the Equivalence of Meta-Analysis Using Literature and Using Individual Patient Data," Biometrics, The International Biometric Society, vol. 55(4), pages 1221-1223, December.
    8. Sue Duval & Richard Tweedie, 2000. "Trim and Fill: A Simple Funnel-Plot–Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis," Biometrics, The International Biometric Society, vol. 56(2), pages 455-463, June.
    9. D. Y. Lin & D. Zeng, 2010. "On the relative efficiency of using summary statistics versus individual-level data in meta-analysis," Biometrika, Biometrika Trust, vol. 97(2), pages 321-332.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruoyu Wang & Qihua Wang & Wang Miao, 2023. "A robust fusion-extraction procedure with summary statistics in the presence of biased sources," Biometrika, Biometrika Trust, vol. 110(4), pages 1023-1040.
    2. Dungang Liu & Regina Y. Liu & Minge Xie, 2015. "Multivariate Meta-Analysis of Heterogeneous Studies Using Only Summary Statistics: Efficiency and Robustness," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 326-340, March.
    3. Jiang, Rong & Yu, Keming, 2020. "Single-index composite quantile regression for massive data," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    4. Bodnar, Olha & Bodnar, Taras, 2021. "Objective Bayesian meta-analysis based on generalized multivariate random effects model," Working Papers 2021:5, Örebro University, School of Business.
    5. Yu, Dalei & Ding, Chang & He, Na & Wang, Ruiwu & Zhou, Xiaohua & Shi, Lei, 2019. "Robust estimation and confidence interval in meta-regression models," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 93-118.
    6. Ding‐Geng Chen & Dungang Liu & Xiaoyi Min & Heping Zhang, 2020. "Relative efficiency of using summary versus individual data in random‐effects meta‐analysis," Biometrics, The International Biometric Society, vol. 76(4), pages 1319-1329, December.
    7. Tang, Lu & Zhou, Ling & Song, Peter X.-K., 2020. "Distributed simultaneous inference in generalized linear models via confidence distribution," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    8. Qian Li & Yan Chen & Shikun Sun & Muyuan Zhu & Jing Xue & Zihan Gao & Jinfeng Zhao & Yihe Tang, 2022. "Research on Crop Irrigation Schedules Under Deficit Irrigation—A Meta-analysis," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(12), pages 4799-4817, September.
    9. Bart Verkuil & Serpil Atasayi & Marc L Molendijk, 2015. "Workplace Bullying and Mental Health: A Meta-Analysis on Cross-Sectional and Longitudinal Data," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-16, August.
    10. Damiano Pizzol & Mike Trott & Igor Grabovac & Mario Antunes & Anna Claudia Colangelo & Simona Ippoliti & Cristian Petre Ilie & Anne Carrie & Nicola Veronese & Lee Smith, 2021. "Laparoscopy in Low-Income Countries: 10-Year Experience and Systematic Literature Review," IJERPH, MDPI, vol. 18(11), pages 1-11, May.
    11. Wolfgang Goymann & John C. Wingfield, 2014. "Male-to-female testosterone ratios, dimorphism, and life history—what does it really tell us?," Behavioral Ecology, International Society for Behavioral Ecology, vol. 25(4), pages 685-699.
    12. Alderotti, Giammarco & Rapallini, Chiara & Traverso, Silvio, 2023. "The Big Five personality traits and earnings: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 94(C).
    13. Ünal, Zehra E. & Kartal, Gamze & Ulusoy, Serra & Ala, Aslı M. & Yilmaz, Munube & Geary, David C., 2023. "Relative contributions of g and basic domain-specific mathematics skills to complex mathematics competencies," Intelligence, Elsevier, vol. 101(C).
    14. Ito, Tsubasa & Sugasawa, Shonosuke, 2021. "Improved confidence regions in meta-analysis of diagnostic test accuracy," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    15. Daniele Zago & Maria Eugênia Andrighetto Canozzi & Júlio Otávio Jardim Barcellos, 2020. "Pregnant beef cow’s nutrition and its effects on postnatal weight and carcass quality of their progeny," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-20, August.
    16. Viktoria Maria Baumeister & Leonie Petra Kuen & Maike Bruckes & Gerhard Schewe, 2021. "The Relationship of Work-Related ICT Use With Well-being, Incorporating the Role of Resources and Demands: A Meta-Analysis," SAGE Open, , vol. 11(4), pages 21582440211, November.
    17. Gundula Krack, 2019. "How to make value-based health insurance designs more effective? A systematic review and meta-analysis," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(6), pages 841-856, August.
    18. Angélica Pigola & Priscila Rezende Costa, 2022. "In search of understanding about knowledge and learning on innovation performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3995-4022, July.
    19. Christopher Snyder & Ran Zhuo, 2018. "Sniff Tests as a Screen in the Publication Process: Throwing out the Wheat with the Chaff," NBER Working Papers 25058, National Bureau of Economic Research, Inc.
    20. Chuang Yuan & Jing Wang & Michael Ying, 2016. "Predictive Value of Carotid Distensibility Coefficient for Cardiovascular Diseases and All-Cause Mortality: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-15, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:82:y:2014:i:2:p:214-242. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.