IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0139951.html
   My bibliography  Save this article

Examining the Impact of the National Institutes of Health Public Access Policy on the Citation Rates of Journal Articles

Author

Listed:
  • Sandra L De Groote
  • Mary Shultz
  • Neil R Smalheiser

Abstract

Purpose: To examine whether National Institutes of Health (NIH) funded articles that were archived in PubMed Central (PMC) after the release of the 2008 NIH Public Access Policy show greater scholarly impact than comparable articles not archived in PMC. Methods: A list of journals across several subject areas was developed from which to collect article citation data. Citation information and cited reference counts of the articles published in 2006 and 2009 from 122 journals were obtained from the Scopus database. The articles were separated into categories of NIH funded, non-NIH funded and whether they were deposited in PubMed Central. An analysis of citation data across a five-year timespan was performed on this set of articles. Results: A total of 45,716 articles were examined, including 7,960 with NIH-funding. An analysis of the number of times these articles were cited found that NIH-funded 2006 articles in PMC were not cited significantly more than NIH-funded non-PMC articles. However, 2009 NIH funded articles in PMC were cited 26% more than 2009 NIH funded articles not in PMC, 5 years after publication. This result is highly significant even after controlling for journal (as a proxy of article quality and topic). Conclusion: Our analysis suggests that factors occurring between 2006 and 2009 produced a subsequent boost in scholarly impact of PubMed Central. The 2008 Public Access Policy is likely to be one such factor, but others may have contributed as well (e.g., growing size and visibility of PMC, increasing availability of full-text linkouts from PubMed, and indexing of PMC articles by Google Scholar).

Suggested Citation

  • Sandra L De Groote & Mary Shultz & Neil R Smalheiser, 2015. "Examining the Impact of the National Institutes of Health Public Access Policy on the Citation Rates of Journal Articles," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-9, October.
    • Handle: RePEc:plo:pone00:0139951
    DOI: 10.1371/journal.pone.0139951
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0139951
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0139951&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0139951?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. K.T.L. Vaughan, 2003. "Changing use patterns of print journals in the digital age: Impacts of electronic equivalents on print chemistry journal use," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(12), pages 1149-1152, October.
    2. Gunther Eysenbach, 2006. "Citation Advantage of Open Access Articles," Working Papers id:626, eSocialSciences.
    3. Craig, Iain D. & Plume, Andrew M. & McVeigh, Marie E. & Pringle, James & Amin, Mayur, 2007. "Do open access articles have greater citation impact?," Journal of Informetrics, Elsevier, vol. 1(3), pages 239-248.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chompunuch Saravudecha & Duangruthai Na Thungfai & Chananthida Phasom & Sodsri Gunta-in & Aorrakanya Metha & Peangkobfah Punyaphet & Tippawan Sookruay & Wannachai Sakuludomkan & Nut Koonrungsesomboon, 2023. "Hybrid Gold Open Access Citation Advantage in Clinical Medicine: Analysis of Hybrid Journals in the Web of Science," Publications, MDPI, vol. 11(2), pages 1-9, March.
    2. Adimoelja, Alvina & Athreya, Advait, 2022. "Reducing barriers to open science by standardizing practices and realigning incentives," OSF Preprints hmgnq, Center for Open Science.
    3. Adimoelja, Alvina & Athreya, Advait, 2022. "Reducing barriers to open science by standardizing practices and realigning incentives," OSF Preprints hmgnq_v1, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Milan Frederik Klus & Alexander Dilger, 2020. "Success factors of academic journals in the digital age," Business Research, Springer;German Academic Association for Business Research, vol. 13(3), pages 1115-1143, November.
    2. Aurelia Magdalena Pisoschi & Claudia Gabriela Pisoschi, 2016. "Is open access the solution to increase the impact of scientific journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1075-1095, November.
    3. Gianfranco Carotenuto & Francesca Nicolais, 2023. "One Secret for a High Citation Rate," Publications, MDPI, vol. 11(2), pages 1-3, April.
    4. Teja Koler-Povh & Primož Južnič & Goran Turk, 2014. "Impact of open access on citation of scholarly publications in the field of civil engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1033-1045, February.
    5. Mark J. McCabe & Christopher M. Snyder, 2015. "Does Online Availability Increase Citations? Theory and Evidence from a Panel of Economics and Business Journals," The Review of Economics and Statistics, MIT Press, vol. 97(1), pages 144-165, March.
    6. Hajar Sotudeh & Zahra Ghasempour & Maryam Yaghtin, 2015. "The citation advantage of author-pays model: the case of Springer and Elsevier OA journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(2), pages 581-608, August.
    7. Vanclay, Jerome K., 2013. "Factors affecting citation rates in environmental science," Journal of Informetrics, Elsevier, vol. 7(2), pages 265-271.
    8. Juliana Loureiro Almeida Campos & André Sobral & Josivan Soares Silva & Thiago Antonio Sousa Araújo & Washington Soares Ferreira-Júnior & Flávia Rosa Santoro & Gilney Charll Santos & Ulysses Paulino A, 2016. "Insularity and citation behavior of scientific articles in young fields: the case of ethnobiology," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1037-1055, November.
    9. Sergio Copiello, 2019. "The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lie," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 995-1018, November.
    10. Eberhard Feess & Marc Scheufen, 2016. "Academic copyright in the publishing game: a contest perspective," European Journal of Law and Economics, Springer, vol. 42(2), pages 263-294, October.
    11. Ennas, Gianfranco & Di Guardo, Maria Chiara, 2015. "Features of top-rated gold open access journals: An analysis of the scopus database," Journal of Informetrics, Elsevier, vol. 9(1), pages 79-89.
    12. Wohlrabe, Klaus & Birkmeier, Daniel, 2014. "Do open access articles in economics have a citation advantage?," MPRA Paper 56842, University Library of Munich, Germany.
    13. MARK J. McCABE & CHRISTOPHER M. SNYDER, 2014. "Identifying The Effect Of Open Access On Citations Using A Panel Of Science Journals," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1284-1300, October.
    14. Pablo Dorta-González & Sara M. González-Betancor & María Isabel Dorta-González, 2017. "Reconsidering the gold open access citation advantage postulate in a multidisciplinary context: an analysis of the subject categories in the Web of Science database 2009–2014," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 877-901, August.
    15. Mark J. McCabe & Christopher M. Snyder, 2021. "Cite unseen: Theory and evidence on the effect of open access on cites to academic articles across the quality spectrum," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 1960-1979, December.
    16. Siluo Yang & Xin Xing & Dietmar Wolfram, 2018. "Difference in the impact of open-access papers published by China and the USA," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1017-1037, May.
    17. Joseph Staudt, 2020. "Mandating access: assessing the NIH’s public access policy," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 35(102), pages 269-304.
    18. Simon Spedding, 2016. "Open Access Publishing of Health Research: Does Open Access Publishing Facilitate the Translation of Research into Health Policy and Practice?," Publications, MDPI, vol. 4(1), pages 1-9, January.
    19. Liwei Zhang & Liang Ma, 2023. "Is open science a double-edged sword?: data sharing and the changing citation pattern of Chinese economics articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2803-2818, May.
    20. Jonathan Wheeler & Ngoc-Minh Pham & Kenning Arlitsch & Justin D. Shanks, 2022. "Impact factions: assessing the citation impact of different types of open access repositories," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4977-5003, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0139951. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.