IDEAS home Printed from https://ideas.repec.org/a/wly/camsys/v18y2022i4ne1288.html
   My bibliography  Save this article

A suggested data structure for transparent and repeatable reporting of bibliographic searching

Author

Listed:
  • Neal R. Haddaway
  • Melissa L. Rethlefsen
  • Melinda Davies
  • Julie Glanville
  • Bethany McGowan
  • Kate Nyhan
  • Sarah Young

Abstract

Academic searching is integral to research activities: (1) searching to retrieve specific information, (2) to expand our knowledge iteratively, (3) and to collate a representative and unbiased selection of the literature. Rigorous searching methods are vital for reliable, repeatable and unbiased searches needed for these second and third forms of searches (exploratory and systematic searching, respectively) that form a core part of evidence syntheses. Despite the broad awareness of the importance of transparency in reporting search activities in evidence syntheses, the importance of searching has been highlighted only recently and has been the explicit focus of reporting guidance (PRISMA‐S). Ensuring bibliographic searches are reported in a way that is transparent enough to allow for full repeatability or evaluation is challenging for a number of reasons. Here, we detail these reasons and provide for the first time a standardised data structure for transparent and comprehensive reporting of search histories. This data structure was produced by a group of international experts in informatics and library sciences. We explain how the data structure was produced and describe its components in detail. We also demonstrate its practical applicability in tools designed to support literature review authors and explain how it can help to improve interoperability across tools used to manage literature reviews. We call on the research community and developers of reference and review management tools to embrace the data structure to facilitate adequate reporting of academic searching in an effort to raise the standard of evidence syntheses globally.

Suggested Citation

  • Neal R. Haddaway & Melissa L. Rethlefsen & Melinda Davies & Julie Glanville & Bethany McGowan & Kate Nyhan & Sarah Young, 2022. "A suggested data structure for transparent and repeatable reporting of bibliographic searching," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(4), December.
  • Handle: RePEc:wly:camsys:v:18:y:2022:i:4:n:e1288
    DOI: 10.1002/cl2.1288
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/cl2.1288
    Download Restriction: no

    File URL: https://libkey.io/10.1002/cl2.1288?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bernard J. Jansen & Soo Young Rieh, 2010. "The seventeen theoretical constructs of information searching and information retrieval," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(8), pages 1517-1534, August.
    2. Weishu Liu, 2019. "The data source of this study is Web of Science Core Collection? Not enough," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1815-1824, December.
    3. Shannon Kugley & Anne Wade & James Thomas & Quenby Mahood & Anne‐Marie Klint Jørgensen & Karianne Hammerstrøm & Nila Sathe, 2017. "Searching for studies: a guide to information retrieval for Campbell systematic reviews," Campbell Systematic Reviews, John Wiley & Sons, vol. 13(1), pages 1-73.
    4. Jana Schellinger & Kerry Sewell & Jamie E Bloss & Tristan Ebron & Carrie Forbes, 2021. "The effect of librarian involvement on the quality of systematic reviews in dental medicine," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-16, September.
    5. Bernard J. Jansen & Soo Young Rieh, 2010. "The seventeen theoretical constructs of information searching and information retrieval," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(8), pages 1517-1534, August.
    6. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    7. C Sean Burns & Tyler Nix & Robert M Shapiro II & Jeffrey T Huber, 2021. "MEDLINE search retrieval issues: A longitudinal query analysis of five vendor platforms," PLOS ONE, Public Library of Science, vol. 16(5), pages 1-21, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ian Ruthven, 2021. "Resonance and the experience of relevance," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(5), pages 554-569, May.
    2. Barbara Mirel & Jennifer Steiner Tonks & Jean Song & Fan Meng & Weijian Xuan & Rafiqa Ameziane, 2013. "Studying PubMed usages in the field for complex problem solving: Implications for tool design," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(5), pages 874-892, May.
    3. Fereshteh Ghahramani & Jingguo Wang, 2020. "Impact of Smartphones on Quality of Life: A Health Information Behavior Perspective," Information Systems Frontiers, Springer, vol. 22(6), pages 1275-1290, December.
    4. Martin Polak & Norbert Tanzer & Per Carlbring, 2022. "PROTOCOL: Effects of virtual reality exposure therapy versus in vivo exposure in treating social anxiety disorder in adults: A systematic review and meta‐analysis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(3), September.
    5. Muhammad Afzal & Rita Yi Man Li & Muhammad Faisal Ayyub & Muhammad Shoaib & Muhammad Bilal, 2023. "Towards BIM-Based Sustainable Structural Design Optimization: A Systematic Review and Industry Perspective," Sustainability, MDPI, vol. 15(20), pages 1-31, October.
    6. Benjamin Sturm & Ali Sunyaev, 2019. "Design Principles for Systematic Search Systems: A Holistic Synthesis of a Rigorous Multi-cycle Design Science Research Journey," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 61(1), pages 91-111, February.
    7. Julia H. Littell & Sarah Young & Therese D. Pigott & M. Antonia Biggs & Trine Munk‐Olsen & Julia R. Steinberg, 2024. "PROTOCOL: Abortion and mental health outcomes: A systematic review and meta‐analysis," Campbell Systematic Reviews, John Wiley & Sons, vol. 20(2), June.
    8. Muhammad Afzal & Rita Yi Man Li & Muhammad Shoaib & Muhammad Faisal Ayyub & Lavinia Chiara Tagliabue & Muhammad Bilal & Habiba Ghafoor & Otilia Manta, 2023. "Delving into the Digital Twin Developments and Applications in the Construction Industry: A PRISMA Approach," Sustainability, MDPI, vol. 15(23), pages 1-37, November.
    9. Adan Ortiz-Cordova & Bernard J. Jansen, 2012. "Classifying web search queries to identify high revenue generating customers," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(7), pages 1426-1441, July.
    10. Fereshteh Ghahramani & Jingguo Wang, 0. "Impact of Smartphones on Quality of Life: A Health Information Behavior Perspective," Information Systems Frontiers, Springer, vol. 0, pages 1-16.
    11. İlkay Unay-Gailhard & Mark A. Brennen, 2022. "How digital communications contribute to shaping the career paths of youth: a review study focused on farming as a career option," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(4), pages 1491-1508, December.
    12. Mahin Ghafari & Vali Baigi & Zahra Cheraghi & Amin Doosti-Irani, 2016. "The Prevalence of Asymptomatic Bacteriuria in Iranian Pregnant Women: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-10, June.
    13. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    14. Santos Urbina & Sofía Villatoro & Jesús Salinas, 2021. "Self-Regulated Learning and Technology-Enhanced Learning Environments in Higher Education: A Scoping Review," Sustainability, MDPI, vol. 13(13), pages 1-12, June.
    15. Oded Berger-Tal & Alison L Greggor & Biljana Macura & Carrie Ann Adams & Arden Blumenthal & Amos Bouskila & Ulrika Candolin & Carolina Doran & Esteban Fernández-Juricic & Kiyoko M Gotanda & Catherine , 2019. "Systematic reviews and maps as tools for applying behavioral ecology to management and policy," Behavioral Ecology, International Society for Behavioral Ecology, vol. 30(1), pages 1-8.
    16. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    17. Maryono, Maryono & Killoes, Aditya Marendra & Adhikari, Rajendra & Abdul Aziz, Ammar, 2024. "Agriculture development through multi-stakeholder partnerships in developing countries: A systematic literature review," Agricultural Systems, Elsevier, vol. 213(C).
    18. Alene Sze Jing Yong & Yi Heng Lim & Mark Wing Loong Cheong & Ednin Hamzah & Siew Li Teoh, 2022. "Willingness-to-pay for cancer treatment and outcome: a systematic review," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(6), pages 1037-1057, August.
    19. Xue-Ying Xu & Hong Kong & Rui-Xiang Song & Yu-Han Zhai & Xiao-Fei Wu & Wen-Si Ai & Hong-Bo Liu, 2014. "The Effectiveness of Noninvasive Biomarkers to Predict Hepatitis B-Related Significant Fibrosis and Cirrhosis: A Systematic Review and Meta-Analysis of Diagnostic Test Accuracy," PLOS ONE, Public Library of Science, vol. 9(6), pages 1-16, June.
    20. Vicente Miñana-Signes & Manuel Monfort-Pañego & Javier Valiente, 2021. "Teaching Back Health in the School Setting: A Systematic Review of Randomized Controlled Trials," IJERPH, MDPI, vol. 18(3), pages 1-18, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:camsys:v:18:y:2022:i:4:n:e1288. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1891-1803 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.