IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0035732.html
   My bibliography  Save this article

Scientific Value of Systematic Reviews: Survey of Editors of Core Clinical Journals

Author

Listed:
  • Joerg J Meerpohl
  • Florian Herrle
  • Gerd Antes
  • Erik von Elm

Abstract

Background: Synthesizing research evidence using systematic and rigorous methods has become a key feature of evidence-based medicine and knowledge translation. Systematic reviews (SRs) may or may not include a meta-analysis depending on the suitability of available data. They are often being criticised as ‘secondary research’ and denied the status of original research. Scientific journals play an important role in the publication process. How they appraise a given type of research influences the status of that research in the scientific community. We investigated the attitudes of editors of core clinical journals towards SRs and their value for publication. Methods: We identified the 118 journals labelled as “core clinical journals” by the National Library of Medicine, USA in April 2009. The journals’ editors were surveyed by email in 2009 and asked whether they considered SRs as original research projects; whether they published SRs; and for which section of the journal they would consider a SR manuscript. Results: The editors of 65 journals (55%) responded. Most respondents considered SRs to be original research (71%) and almost all journals (93%) published SRs. Several editors regarded the use of Cochrane methodology or a meta-analysis as quality criteria; for some respondents these criteria were premises for the consideration of SRs as original research. Journals placed SRs in various sections such as “Review” or “Feature article”. Characterization of non-responding journals showed that about two thirds do publish systematic reviews. Discussion: Currently, the editors of most core clinical journals consider SRs original research. Our findings are limited by a non-responder rate of 45%. Individual comments suggest that this is a grey area and attitudes differ widely. A debate about the definition of ‘original research’ in the context of SRs is warranted.

Suggested Citation

  • Joerg J Meerpohl & Florian Herrle & Gerd Antes & Erik von Elm, 2012. "Scientific Value of Systematic Reviews: Survey of Editors of Core Clinical Journals," PLOS ONE, Public Library of Science, vol. 7(5), pages 1-5, May.
    • Handle: RePEc:plo:pone00:0035732
    DOI: 10.1371/journal.pone.0035732
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0035732
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0035732&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0035732?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hilda Bastian & Paul Glasziou & Iain Chalmers, 2010. "Seventy-Five Trials and Eleven Systematic Reviews a Day: How Will We Ever Keep Up?," PLOS Medicine, Public Library of Science, vol. 7(9), pages 1-6, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lorenzo Pratici & Phillip McMinn Singer, 2021. "COVID-19 Vaccination: What Do We Expect for the Future? A Systematic Literature Review of Social Science Publications in the First Year of the Pandemic (2020–2021)," Sustainability, MDPI, vol. 13(15), pages 1-18, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dreesens, Dunja & Kremer, Leontien & Burgers, Jako & van der Weijden, Trudy, 2020. "Lost in definitions: Reducing duplication and clarifying definitions of knowledge and decision support tools. A RAND-modified Delphi consensus study," Health Policy, Elsevier, vol. 124(5), pages 531-539.
    2. Blake M. Louscher & Veerasathpurush Allareddy & Satheesh Elangovan, 2019. "Predictors of Citations of Systematic Reviews in Oral Implantology: A Cross-Sectional Bibliometric Analysis," SAGE Open, , vol. 9(1), pages 21582440198, March.
    3. Hansen, Henrik & Trifkovic, Neda, 2013. "Systematic Reviews: Questions, Methods and Usage," MPRA Paper 47993, University Library of Munich, Germany.
    4. Mark J Bolland & Andrew Grey, 2014. "A Case Study of Discordant Overlapping Meta-Analyses: Vitamin D Supplements and Fracture," PLOS ONE, Public Library of Science, vol. 9(12), pages 1-20, December.
    5. Shi, Xuanyu & Du, Jian, 2022. "Distinguishing transformative from incremental clinical evidence: A classifier of clinical research using textual features from abstracts and citing sentences," Journal of Informetrics, Elsevier, vol. 16(2).
    6. Jason Portenoy & Jevin D. West, 2020. "Constructing and evaluating automated literature review systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 3233-3251, December.
    7. Dreesens, Dunja & Kremer, Leontien & van der Weijden, Trudy, 2019. "The Dutch chaos case: A scoping review of knowledge and decision support tools available to clinicians in the Netherlands," Health Policy, Elsevier, vol. 123(12), pages 1288-1297.
    8. Lucy Turner & James Galipeau & Chantelle Garritty & Eric Manheimer & L Susan Wieland & Fatemeh Yazdi & David Moher, 2013. "An Evaluation of Epidemiological and Reporting Characteristics of Complementary and Alternative Medicine (CAM) Systematic Reviews (SRs)," PLOS ONE, Public Library of Science, vol. 8(1), pages 1-11, January.
    9. K. M. Saif‐Ur‐Rahman & Md. Hasan & Shahed Hossain & Iqbal Anwar & Yoshihisa Hirakawa & Hiroshi Yatsuya, 2022. "Prioritization and sequential exclusion of articles in systematic reviews," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(2), June.
    10. Monique Heijmans & Rune Poortvliet & Marieke Van der Gaag & Ana I. González-González & Jessica Beltran Puerta & Carlos Canelo-Aybar & Claudia Valli & Marta Ballester & Claudio Rocha & Montserrat León , 2022. "Using a Taxonomy to Systematically Identify and Describe Self-Management Interventions Components in Randomized Trials for COPD," IJERPH, MDPI, vol. 19(19), pages 1-24, October.
    11. Tanja Burgard & Holger Steinmetz, 2023. "Evidence in management science related to psychology: benefits, tools, and an example of a community-augmented meta-analysis," Management Review Quarterly, Springer, vol. 73(3), pages 1135-1150, September.
    12. Laura Sheble, 2017. "Macro‐level diffusion of a methodological knowledge innovation: Research synthesis methods, 1972–2011," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2693-2708, December.
    13. Md Mahbub Hossain & Abida Sultana & Samia Tasnim & Qiping Fan & Ping Ma & E Lisako J McKyer & Neetu Purohit, 2020. "Prevalence of mental disorders among people who are homeless: An umbrella review," International Journal of Social Psychiatry, , vol. 66(6), pages 528-541, September.
    14. Costa, King & Ntsobi, Mfanelo Patrick, 2023. "A Systematic Review of the Potential for Promotion of Southern Epistemologies in Educational Research: Ubuntu Philosophy as a Research Paradigm, a Conceptual Model," AfricArxiv qshp8, Center for Open Science.
    15. Means, Stephanie N. & Magura, Stephen & Burkhardt, Jason T. & Schröter, Daniela C. & Coryn, Chris L.S., 2015. "Comparing rating paradigms for evidence-based program registers in behavioral health: Evidentiary criteria and implications for assessing programs," Evaluation and Program Planning, Elsevier, vol. 48(C), pages 100-116.
    16. Porjai Pattanittum & Malinee Laopaiboon & David Moher & Pisake Lumbiganon & Chetta Ngamjarus, 2012. "A Comparison of Statistical Methods for Identifying Out-of-Date Systematic Reviews," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-6, November.
    17. Gillian L Currie & Helena N Angel-Scott & Lesley Colvin & Fala Cramond & Kaitlyn Hair & Laila Khandoker & Jing Liao & Malcolm Macleod & Sarah K McCann & Rosie Morland & Nicki Sherratt & Robert Stewart, 2019. "Animal models of chemotherapy-induced peripheral neuropathy: A machine-assisted systematic review and meta-analysis," PLOS Biology, Public Library of Science, vol. 17(5), pages 1-34, May.
    18. Melanie Lum & Luke Wolfenden & Jannah Jones & Alice Grady & Hayley Christian & Kathryn Reilly & Sze Lin Yoong, 2022. "Interventions to Improve Child Physical Activity in the Early Childhood Education and Care Setting: An Umbrella Review," IJERPH, MDPI, vol. 19(4), pages 1-22, February.
    19. Tiago S. Jesus & Helen Hoenig & Michel D. Landry, 2020. "Development of the Rehabilitation Health Policy, Systems, and Services Research Field: Quantitative Analyses of Publications over Time (1990–2017) and across Country Type," IJERPH, MDPI, vol. 17(3), pages 1-17, February.
    20. Furukawa, Chishio, 2019. "Publication Bias under Aggregation Frictions: Theory, Evidence, and a New Correction Method," EconStor Preprints 194798, ZBW - Leibniz Information Centre for Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0035732. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.