IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0092508.html
   My bibliography  Save this article

The Quality of Reporting Methods and Results in Network Meta-Analyses: An Overview of Reviews and Suggestions for Improvement

Author

Listed:
  • Brian Hutton
  • Georgia Salanti
  • Anna Chaimani
  • Deborah M Caldwell
  • Chris Schmid
  • Kristian Thorlund
  • Edward Mills
  • Ferrán Catalá-López
  • Lucy Turner
  • Douglas G Altman
  • David Moher

Abstract

Introduction: Some have suggested the quality of reporting of network meta-analyses (a technique used to synthesize information to compare multiple interventions) is sub-optimal. We sought to review information addressing this claim. Objective: To conduct an overview of existing evaluations of quality of reporting in network meta-analyses and indirect treatment comparisons, and to compile a list of topics which may require detailed reporting guidance to enhance future reporting quality. Methods: An electronic search of Medline and the Cochrane Registry of methodologic studies (January 2004–August 2013) was performed by an information specialist. Studies describing findings from quality of reporting assessments were sought. Screening of abstracts and full texts was performed by two team members. Descriptors related to all aspects of reporting a network meta-analysis were summarized. Results: We included eight reports exploring the quality of reporting of network meta-analyses. From past reviews, authors found several aspects of network meta-analyses were inadequately reported, including primary information about literature searching, study selection, and risk of bias evaluations; statement of the underlying assumptions for network meta-analysis, as well as efforts to verify their validity; details of statistical models used for analyses (including information for both Bayesian and Frequentist approaches); completeness of reporting of findings; and approaches for summarizing probability measures as additional important considerations. Conclusions: While few studies were identified, several deficiencies in the current reporting of network meta-analyses were observed. These findings reinforce the need to develop reporting guidance for network meta-analyses. Findings from this review will be used to guide next steps in the development of reporting guidance for network meta-analysis in the format of an extension of the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analysis) Statement.

Suggested Citation

  • Brian Hutton & Georgia Salanti & Anna Chaimani & Deborah M Caldwell & Chris Schmid & Kristian Thorlund & Edward Mills & Ferrán Catalá-López & Lucy Turner & Douglas G Altman & David Moher, 2014. "The Quality of Reporting Methods and Results in Network Meta-Analyses: An Overview of Reviews and Suggestions for Improvement," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-9, March.
    • Handle: RePEc:plo:pone00:0092508
    DOI: 10.1371/journal.pone.0092508
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0092508
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0092508&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0092508?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    2. Alessandro Liberati & Douglas G Altman & Jennifer Tetzlaff & Cynthia Mulrow & Peter C Gøtzsche & John P A Ioannidis & Mike Clarke & P J Devereaux & Jos Kleijnen & David Moher, 2009. "The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-28, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernanda S Tonin & Laiza M Steimbach & Antonio M Mendes & Helena H Borba & Roberto Pontarolo & Fernando Fernandez-Llimos, 2018. "Mapping the characteristics of network meta-analyses on drug therapy: A systematic review," PLOS ONE, Public Library of Science, vol. 13(4), pages 1-16, April.
    2. Ferrán Catalá-López & Brian Hutton & Amparo Núñez-Beltrán & Matthew J Page & Manuel Ridao & Diego Macías Saint-Gerons & Miguel A Catalá & Rafael Tabarés-Seisdedos & David Moher, 2017. "The pharmacological and non-pharmacological treatment of attention deficit hyperactivity disorder in children and adolescents: A systematic review with network meta-analyses of randomised trials," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-31, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    2. Su Keng Tan & Wai Keung Leung & Alexander Tin Hong Tang & Roger A Zwahlen, 2017. "Effects of mandibular setback with or without maxillary advancement osteotomies on pharyngeal airways: An overview of systematic reviews," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-20, October.
    3. Alessandro Concari & Gerjo Kok & Pim Martens, 2020. "A Systematic Literature Review of Concepts and Factors Related to Pro-Environmental Consumer Behaviour in Relation to Waste Management Through an Interdisciplinary Approach," Sustainability, MDPI, vol. 12(11), pages 1-50, May.
    4. Jacob Elnaggar & Fern Tsien & Lucio Miele & Chindo Hicks & Clayton Yates & Melisa Davis, 2019. "An Integrative Genomics Approach for Associating Genetic Susceptibility with the Tumor Immune Microenvironment in Triple Negative Breast Cancer," Biomedical Journal of Scientific & Technical Research, Biomedical Research Network+, LLC, vol. 15(1), pages 1-12, February.
    5. Hyun Kim & Navneet Kaur Baidwan & David Kriebel & Manuel Cifuentes & Sherry Baron, 2018. "Asthma among World Trade Center First Responders: A Qualitative Synthesis and Bias Assessment," IJERPH, MDPI, vol. 15(6), pages 1-14, May.
    6. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    7. Frank Peinemann & Ulrich Grouven & Nicolaus Kröger & Carmen Bartel & Max H Pittler & Stefan Lange, 2011. "First-Line Matched Related Donor Hematopoietic Stem Cell Transplantation Compared to Immunosuppressive Therapy in Acquired Severe Aplastic Anemia," PLOS ONE, Public Library of Science, vol. 6(4), pages 1-16, April.
    8. Jonathan Kingsley & Aisling Bailey & Nooshin Torabi & Pauline Zardo & Suzanne Mavoa & Tonia Gray & Danielle Tracey & Philip Pettitt & Nicholas Zajac & Emily Foenander, 2019. "A Systematic Review Protocol Investigating Community Gardening Impact Measures," IJERPH, MDPI, vol. 16(18), pages 1-12, September.
    9. Wei-Wei Chen & Feng Wang & Rui-Hua Xu, 2013. "Platinum-Based Versus Non-Platinum-Based Chemotherapy as First Line Treatment of Inoperable, Advanced Gastric Adenocarcinoma: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-8, July.
    10. Giovanni Vinti & Valerie Bauza & Thomas Clasen & Kate Medlicott & Terry Tudor & Christian Zurbrügg & Mentore Vaccari, 2021. "Municipal Solid Waste Management and Adverse Health Outcomes: A Systematic Review," IJERPH, MDPI, vol. 18(8), pages 1-26, April.
    11. Hanna Górska-Warsewicz, 2022. "Consumer or Patient Determinants of Hospital Brand Equity—A Systematic Literature Review," IJERPH, MDPI, vol. 19(15), pages 1-36, July.
    12. André Ramalho & João Serrano & Rui Paulo & Pedro Duarte-Mendes & António Rosado & João Petrica, 2021. "Emerging Qualitative Research Trends (2010–2021) on Sedentary Behaviour among Older Adults: A Systematic Literature Review Protocol," IJERPH, MDPI, vol. 18(21), pages 1-8, November.
    13. S. Rajsic & H. Gothe & H. H. Borba & G. Sroczynski & J. Vujicic & T. Toell & Uwe Siebert, 2019. "Economic burden of stroke: a systematic review on post-stroke care," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 107-134, February.
    14. Sibonokuhle Ndlovu, 2023. "Preparedness and Response to COVID-19 Disruptions and Learning Challenges for Students with Disabilities in South Africa: A Systematic Review," Sustainability, MDPI, vol. 15(2), pages 1-17, January.
    15. João Carlos Belloti & Aldo Okamura & Jordana Scheeren & Flávio Faloppa & Vinícius Ynoe de Moraes, 2019. "A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-12, January.
    16. Abbas Mardani & Dalia Streimikiene & Edmundas Kazimieras Zavadskas & Fausto Cavallaro & Mehrbakhsh Nilashi & Ahmad Jusoh & Habib Zare, 2017. "Application of Structural Equation Modeling (SEM) to Solve Environmental Sustainability Problems: A Comprehensive Review and Meta-Analysis," Sustainability, MDPI, vol. 9(10), pages 1-65, October.
    17. Luísa Bandeira Lopes & João Albernaz Neves & João Botelho & Vanessa Machado & José João Mendes, 2021. "Regenerative Endodontic Procedures: An Umbrella Review," IJERPH, MDPI, vol. 18(2), pages 1-17, January.
    18. Gaspar, Rui & Yan, Zheng & Domingos, Samuel, 2019. "Extreme natural and man-made events and human adaptive responses mediated by information and communication technologies' use: A systematic literature review," Technological Forecasting and Social Change, Elsevier, vol. 145(C), pages 125-135.
    19. Nicholas A. Kirk & Nicholas A. Cradock-Henry, 2022. "Land Management Change as Adaptation to Climate and Other Stressors: A Systematic Review of Decision Contexts Using Values-Rules-Knowledge," Land, MDPI, vol. 11(6), pages 1-23, May.
    20. Timothy Noblet & John Marriott & Emma Graham-Clarke & Debra Shirley & Alison Rushton, 2018. "Clinical and cost-effectiveness of non-medical prescribing: A systematic review of randomised controlled trials," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0092508. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.