IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i8d10.1007_s11192-023-04750-1.html
   My bibliography  Save this article

Can open access increase LIS research’s policy impact? Using regression analysis and causal inference

Author

Listed:
  • Qianjin Zong

    (South China Normal University)

  • Zhihong Huang

    (South China Normal University)

  • Jiaru Huang

    (South China Normal University)

Abstract

The relationship between open access and academic impact (usually measured as citations received from academic publications) has been extensively studied but remains a very controversial topic. However, the effect of open access on policy impact (measured as citations received from policy documents) is still unknown. The purpose of this study was to examine the effect of open access on the policy impact, which might initiate a new controversial topic. Research articles in the field of library and information science (LIS) were selected as the data sample (n = 48,884). Negative binomial regression models were used to examine the dataset. Furthermore, propensity score matching (PSM) analysis, a causal inference approach, was used to estimate the effect of open access on the policy impact based on a selected LIS journal (Scientometrics, n = 4019) that received the most policy citations among the LIS journals. Linear regression models, logit regression models, four other matching methods, open access status provided by different databases, and different sizes of data samples were used to check the robustness of the main results. This study revealed that open access had significant and positive effects on the policy impact.

Suggested Citation

  • Qianjin Zong & Zhihong Huang & Jiaru Huang, 2023. "Can open access increase LIS research’s policy impact? Using regression analysis and causal inference," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4825-4854, August.
    • Handle: RePEc:spr:scient:v:128:y:2023:i:8:d:10.1007_s11192-023-04750-1
    DOI: 10.1007/s11192-023-04750-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04750-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-023-04750-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pablo Dorta-González & Rafael Suárez-Vega & María Isabel Dorta-González, 2020. "Open access effect on uncitedness: a large-scale study controlling by discipline, source type and visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2619-2644, September.
    2. Funk, Tjede & Sharma, Tarang & Chapman, Evelina & Kuchenmüller, Tanja, 2022. "Translating health information into policy-making: A pragmatic framework," Health Policy, Elsevier, vol. 126(1), pages 16-23.
    3. Staša Milojević & Cassidy R. Sugimoto & Erjia Yan & Ying Ding, 2011. "The cognitive structure of Library and Information Science: Analysis of article title words," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(10), pages 1933-1953, October.
    4. A Townsend Peterson & Paul E Johnson & Narayani Barve & Ada Emmett & Marc L Greenberg & Josh Bolick & Huijie Qiao, 2019. "The NIH public access policy did not harm biomedical journals," PLOS Biology, Public Library of Science, vol. 17(10), pages 1-7, October.
    5. Fernanda Morillo, 2020. "Is open access publication useful for all research fields? Presence of funding, collaboration and impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 689-716, October.
    6. Chien Hsiang Liao & Mu-Yen Chen, 2018. "Exploring knowledge patterns of library and information science journals within the field: a citation analysis from 2009 to 2016," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1991-2008, December.
    7. Hajar Sotudeh & Abbas Horri, 2009. "Countries positioning in open access journals system: An investigation of citation distribution patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 7-31, October.
    8. Mark J. McCabe & Christopher M. Snyder, 2021. "Cite unseen: Theory and evidence on the effect of open access on cites to academic articles across the quality spectrum," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 1960-1979, December.
    9. Kim Holmberg & Juha Hedman & Timothy D. Bowman & Fereshteh Didegah & Mikael Laakso, 2020. "Do articles in open access journals have more frequent altmetric activity than articles in subscription-based journals? An investigation of the research output of Finnish universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 645-659, January.
    10. Samantha Vilkins & Will J. Grant, 2017. "Types of evidence cited in Australian Government publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1681-1695, December.
    11. Lin Zhang & Yahui Wei & Ying Huang & Gunnar Sivertsen, 2022. "Should open access lead to closed research? The trends towards paying to perform research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7653-7679, December.
    12. Isabel Basson & Jaco P. Blanckenberg & Heidi Prozesky, 2021. "Do open access journal articles experience a citation advantage? Results and methodological reflections of an application of multiple measures to an analysis by WoS subject areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 459-484, January.
    13. Juan-Carlos Valderrama-Zurián & Remedios Aguilar-Moya & Juan Gorraiz, 2019. "On the bibliometric nature of a foreseeable relationship: open access and education," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1031-1057, September.
    14. Zhihong Huang & Qianjin Zong & Xuerui Ji, 2022. "The associations between scientific collaborations of LIS research and its policy impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6453-6470, November.
    15. Gunther Eysenbach, 2006. "Citation Advantage of Open Access Articles," Working Papers id:626, eSocialSciences.
    16. Wen-Yau Cathy Lin, 2021. "Effects of open access and articles-in-press mechanisms on publishing lag and first-citation speed: a case on energy and fuels journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4841-4869, June.
    17. Garrett Ward Richards, 2017. "How Research-Policy Partnerships Can Benefit Government: A Win-Win for Evidence-Based Policy-Making," Canadian Public Policy, University of Toronto Press, vol. 43(2), pages 165-170, June.
    18. Isidro F. Aguillo, 2020. "Altmetrics of the Open Access Institutional Repositories: a webometrics approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1181-1192, June.
    19. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    20. Michael Taylor, 2020. "An altmetric attention advantage for open access books in the humanities and social sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2523-2543, December.
    21. Jane Cho, 2021. "Altmetrics analysis of highly cited academic papers in the field of library and information science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7623-7635, September.
    22. Wolfgang Glänzel & Pei-Shan Chi, 2020. "The big challenge of Scientometrics 2.0: exploring the broader impact of scientific research in public health," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1011-1031, November.
    23. Staša Milojević & Cassidy R. Sugimoto & Erjia Yan & Ying Ding, 2011. "The cognitive structure of Library and Information Science: Analysis of article title words," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 1933-1953, October.
    24. Joshua Newman & Adrian Cherney & Brian W. Head, 2017. "Policy capacity and evidence-based policy in the public service," Public Management Review, Taylor & Francis Journals, vol. 19(2), pages 157-174, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hashem Atapour & Robabeh Maddahi & Rasoul Zavaraqi, 2024. "Policy citations of scientometric articles: an altmetric study," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4423-4436, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liwei Zhang & Liang Ma, 2024. "Different open access routes, varying societal impacts: evidence from the Royal Society biological journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3407-3431, June.
    2. Zhihong Huang & Qianjin Zong & Xuerui Ji, 2022. "The associations between scientific collaborations of LIS research and its policy impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6453-6470, November.
    3. María Bordons & Borja González-Albo & Luz Moreno-Solano, 2023. "Improving our understanding of open access: how it relates to funding, internationality of research and scientific leadership," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4651-4676, August.
    4. Liwei Zhang & Liang Ma, 2023. "Is open science a double-edged sword?: data sharing and the changing citation pattern of Chinese economics articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2803-2818, May.
    5. Hashem Atapour & Robabeh Maddahi & Rasoul Zavaraqi, 2024. "Policy citations of scientometric articles: an altmetric study," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4423-4436, July.
    6. Chompunuch Saravudecha & Duangruthai Na Thungfai & Chananthida Phasom & Sodsri Gunta-in & Aorrakanya Metha & Peangkobfah Punyaphet & Tippawan Sookruay & Wannachai Sakuludomkan & Nut Koonrungsesomboon, 2023. "Hybrid Gold Open Access Citation Advantage in Clinical Medicine: Analysis of Hybrid Journals in the Web of Science," Publications, MDPI, vol. 11(2), pages 1-9, March.
    7. María Pinto & Rosaura Fernández-Pascual & David Caballero-Mariscal & Dora Sales, 2020. "Information literacy trends in higher education (2006–2019): visualizing the emerging field of mobile information literacy," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1479-1510, August.
    8. Ying Guo & Xiantao Xiao, 2022. "Author-level altmetrics for the evaluation of Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 973-990, February.
    9. Yi Bu & Binglu Wang & Win-bin Huang & Shangkun Che & Yong Huang, 2018. "Using the appearance of citations in full text on author co-citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 275-289, July.
    10. Yang, Siluo & Han, Ruizhen & Wolfram, Dietmar & Zhao, Yuehua, 2016. "Visualizing the intellectual structure of information science (2006–2015): Introducing author keyword coupling analysis," Journal of Informetrics, Elsevier, vol. 10(1), pages 132-150.
    11. Alexander Cuntz & Frank Mueller-Langer & Alessio Muscarnera & Prince C. Oguguo & Marc Scheufen, 2024. "Access to science and innovation in the developing world," WIPO Economic Research Working Papers 78, World Intellectual Property Organization - Economics and Statistics Division.
    12. Shesen Guo & Ganzhou Zhang, 2017. "Analyzing concept complexity, knowledge ageing and diffusion pattern of Mooc," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 413-430, July.
    13. Sabrina Petersohn & Thomas Heinze, 2018. "Professionalization of bibliometric research assessment. Insights from the history of the Leiden Centre for Science and Technology Studies (CWTS)," Science and Public Policy, Oxford University Press, vol. 45(4), pages 565-578.
    14. Hao Wang & Sanhong Deng & Xinning Su, 2016. "A study on construction and analysis of discipline knowledge structure of Chinese LIS based on CSSCI," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1725-1759, December.
    15. Lin, Yiling & Evans, James A. & Wu, Lingfei, 2022. "New directions in science emerge from disconnection and discord," Journal of Informetrics, Elsevier, vol. 16(1).
    16. A. Abrizah & A. Noorhidawati & A. N. Zainab, 2015. "LIS journals categorization in the Journal Citation Report: a stated preference study," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1083-1099, February.
    17. Chaoqun Ni & Cassidy R. Sugimoto & Blaise Cronin, 2013. "Visualizing and comparing four facets of scholarly communication: producers, artifacts, concepts, and gatekeepers," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1161-1173, March.
    18. Justus Haucap & Nima Moshgbar & W. Benedikt Schmal, 2021. "The impact of the German 'DEAL' on competition in the academic publishing market," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 2027-2049, December.
    19. Mingkun Wei & Abdolreza Noroozi Chakoli, 2020. "Evaluating the relationship between the academic and social impact of open access books based on citation behaviors and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2401-2420, December.
    20. Xie, Qing & Zhang, Xinyuan & Song, Min, 2021. "A network embedding-based scholar assessment indicator considering four facets: Research topic, author credit allocation, field-normalized journal impact, and published time," Journal of Informetrics, Elsevier, vol. 15(4).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:8:d:10.1007_s11192-023-04750-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.