IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v12y2018i2p481-493.html
   My bibliography  Save this article

Examining the usage, citation, and diffusion patterns of bibliometric mapping software: A comparative study of three tools

Author

Listed:
  • Pan, Xuelian
  • Yan, Erjia
  • Cui, Ming
  • Hua, Weina

Abstract

This study investigates the use, citation and diffusion of three bibliometric mapping software tools (CiteSpace, HistCite and VOSviewer) in scientific papers. We first conduct a content analysis of a sample of 481 English core journal papers—i.e., papers from journals deemed central to their respective disciplines—in which at least one of these tools is mentioned. This allows us to understand the predominant mention and citation practices surrounding these tools. We then employ several diffusion indicators to gain insight into the diffusion patterns of the three software tools. Overall, we find that researchers mention and cite the tools in diverse ways, many of which fall short of a traditional formal citation. Our results further indicate a clear upward trend in the use of all three tools, though VOSviewer is more frequently used than CiteSpace or HistCite. We also find that these three software tools have seen the fastest and most widespread adoption in library and information science research, where the tools originated. They have since been gradually adopted in other areas of study, initially at a lower diffusion speed but afterward at a rapidly growing rate.

Suggested Citation

  • Pan, Xuelian & Yan, Erjia & Cui, Ming & Hua, Weina, 2018. "Examining the usage, citation, and diffusion patterns of bibliometric mapping software: A comparative study of three tools," Journal of Informetrics, Elsevier, vol. 12(2), pages 481-493.
    • Handle: RePEc:eee:infome:v:12:y:2018:i:2:p:481-493
    DOI: 10.1016/j.joi.2018.03.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157717303292
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2018.03.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wu, Chaojiang & Yan, Erjia & Hill, Chelsey, 2017. "Disciplinary knowledge diffusion in business research," Journal of Informetrics, Elsevier, vol. 11(2), pages 655-668.
    2. Chaomei Chen, 2006. "CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(3), pages 359-377, February.
    3. onder Nomaler & Bart Verspagen, 2008. "Knowledge Flows, Patent Citations and the Impact of Science on Technology," Economic Systems Research, Taylor & Francis Journals, vol. 20(4), pages 339-366.
    4. Heather Piwowar, 2013. "Value all research products," Nature, Nature, vol. 493(7431), pages 159-159, January.
    5. Jürgen Harald Jacob & Siegfried Lehrl & Andreas Wolfram Henkel, 2007. "Early recognition of high quality researchers of the German psychiatry by worldwide accessible bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(2), pages 117-130, November.
    6. Eugene Garfield & A. I. Pudovkin & V. S. Istomin, 2003. "Why do we need algorithmic historiography?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(5), pages 400-412, March.
    7. Hui-Zhen Fu & Yuh-Shan Ho, 2013. "Comparison of independent research of China’s top universities using bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 259-276, July.
    8. M.J. Cobo & A.G. López-Herrera & E. Herrera-Viedma & F. Herrera, 2011. "Science mapping software tools: Review, analysis, and cooperative study among tools," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(7), pages 1382-1402, July.
    9. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2011. "National research assessment exercises: a comparison of peer review and bibliometrics rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 929-941, December.
    10. Ed J. Rinia & Thed. N. Van Leeuwen & Eppo E.W. Bruins & Hendrik G. Van Vuren & Anthony F.J. Van Raan, 2001. "Citation delay in interdisciplinary knowledge exchange," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 293-309, April.
    11. Katy Börner & Shashikant Penumarthy & Mark Meiss & Weimao Ke, 2006. "Mapping the diffusion of scholarly knowledge among major U.S. research institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 415-426, September.
    12. Christine L. Borgman & Ronald E. Rice, 1992. "The convergence of information science and communication: A bibliometric analysis," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(6), pages 397-411, July.
    13. Pan, Xuelian & Yan, Erjia & Wang, Qianqian & Hua, Weina, 2015. "Assessing the impact of software on science: A bootstrapped learning of software entities in full-text papers," Journal of Informetrics, Elsevier, vol. 9(4), pages 860-871.
    14. Ricardo Cartes-Velásquez & Carlos Manterola Delgado, 2014. "Bibliometric analysis of articles published in ISI dental journals, 2007–2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2223-2233, March.
    15. Grant Lewison & Isla Rippon & Steven Wooding, 2005. "Tracking knowledge diffusion through citations," Research Evaluation, Oxford University Press, vol. 14(1), pages 5-14, April.
    16. Garfield, Eugene, 2009. "From the science of science to Scientometrics visualizing the history of science with HistCite software," Journal of Informetrics, Elsevier, vol. 3(3), pages 173-179.
    17. Howard D. White, 2003. "Pathfinder networks and author cocitation analysis: A remapping of paradigmatic information scientists," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(5), pages 423-434, March.
    18. James Howison & Julia Bullard, 2016. "Software in the scientific literature: Problems with seeing, finding, and using software mentioned in the biology literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(9), pages 2137-2155, September.
    19. Erjia Yan, 2016. "Disciplinary knowledge production and diffusion in science," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(9), pages 2223-2245, September.
    20. Milojević, Staša & Sugimoto, Cassidy R. & Larivière, Vincent & Thelwall, Mike & Ding, Ying, 2014. "The role of handbooks in knowledge creation and diffusion: A case of science and technology studies," Journal of Informetrics, Elsevier, vol. 8(3), pages 693-709.
    21. Li, Kai & Yan, Erjia & Feng, Yuanyuan, 2017. "How is R cited in research outputs? Structure, impacts, and citation standard," Journal of Informetrics, Elsevier, vol. 11(4), pages 989-1002.
    22. Nees Jan Eck & Ludo Waltman, 2010. "Software survey: VOSviewer, a computer program for bibliometric mapping," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 523-538, August.
    23. Yu, Qi & Ding, Ying & Song, Min & Song, Sungjeon & Liu, Jianhua & Zhang, Bin, 2015. "Tracing database usage: Detecting main paths in database link networks," Journal of Informetrics, Elsevier, vol. 9(1), pages 1-15.
    24. Ying Ding & Guo Zhang & Tamy Chambers & Min Song & Xiaolong Wang & Chengxiang Zhai, 2014. "Content-based citation analysis: The next generation of citation analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(9), pages 1820-1833, September.
    25. Yuxian Liu & Ronald Rousseau, 2010. "Knowledge diffusion through publications and citations: A case study using ESI-fields as unit of diffusion," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 340-351, February.
    26. Xuelian Pan & Erjia Yan & Weina Hua, 2016. "Disciplinary differences of software use and impact in scientific literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1593-1610, December.
    27. Yuxian Liu & Ronald Rousseau, 2010. "Knowledge diffusion through publications and citations: A case study using ESI‐fields as unit of diffusion," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(2), pages 340-351, February.
    28. Thed van Leeuwen & Robert Tijssen, 2000. "Interdisciplinary dynamics of modern science: analysis of cross-disciplinary citation flows," Research Evaluation, Oxford University Press, vol. 9(3), pages 183-187, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yuzhuo & Zhang, Chengzhi, 2020. "Using the full-text content of academic articles to identify and evaluate algorithm entities in the domain of natural language processing," Journal of Informetrics, Elsevier, vol. 14(4).
    2. Enrique Orduña-Malea & Rodrigo Costas, 2021. "Link-based approach to study scientific software usage: the case of VOSviewer," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8153-8186, September.
    3. Wang, Shiyun & Mao, Jin & Lu, Kun & Cao, Yujie & Li, Gang, 2021. "Understanding interdisciplinary knowledge integration through citance analysis: A case study on eHealth," Journal of Informetrics, Elsevier, vol. 15(4).
    4. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    5. Lu Jiang & Xinyu Kang & Shan Huang & Bo Yang, 2022. "A refinement strategy for identification of scientific software from bioinformatics publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3293-3316, June.
    6. Robert Tomaszewski, 2023. "Visibility, impact, and applications of bibliometric software tools through citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 4007-4028, July.
    7. Pan, Xuelian & Yan, Erjia & Cui, Ming & Hua, Weina, 2019. "How important is software to library and information science research? A content analysis of full-text publications," Journal of Informetrics, Elsevier, vol. 13(1), pages 397-406.
    8. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Di Costa, Flavia, 2020. "Knowledge spillovers: Does the geographic proximity effect decay over time? A discipline-level analysis, accounting for cognitive proximity, with and without self-citations," Journal of Informetrics, Elsevier, vol. 14(4).
    9. Yan, Erjia & Ding, Ying & Cronin, Blaise & Leydesdorff, Loet, 2013. "A bird's-eye view of scientific trading: Dependency relations among fields of science," Journal of Informetrics, Elsevier, vol. 7(2), pages 249-264.
    10. van Eck, Nees Jan & Waltman, Ludo, 2014. "CitNetExplorer: A new software tool for analyzing and visualizing citation networks," Journal of Informetrics, Elsevier, vol. 8(4), pages 802-823.
    11. Li, Kai & Yan, Erjia, 2018. "Co-mention network of R packages: Scientific impact and clustering structure," Journal of Informetrics, Elsevier, vol. 12(1), pages 87-100.
    12. Peter Wittek & Sándor Darányi & Gustaf Nelhans, 2017. "Ruling out static latent homophily in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 765-777, February.
    13. Shiyun Wang & Jin Mao & Yujie Cao & Gang Li, 2022. "Integrated knowledge content in an interdisciplinary field: identification, classification, and application," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6581-6614, November.
    14. Wang, Jue & Zhang, Liwei, 2018. "Proximal advantage in knowledge diffusion: The time dimension," Journal of Informetrics, Elsevier, vol. 12(3), pages 858-867.
    15. Hu, Xiaojun & Rousseau, Ronald, 2018. "A new approach to explore the knowledge transition path in the evolution of science & technology: From the biology of restriction enzymes to their application in biotechnology," Journal of Informetrics, Elsevier, vol. 12(3), pages 842-857.
    16. Ileana Blanco & Luigi De Bellis & Andrea Luvisi, 2022. "Bibliometric Mapping of Research on Life Cycle Assessment of Olive Oil Supply Chain," Sustainability, MDPI, vol. 14(7), pages 1-25, March.
    17. McLevey, John & McIlroy-Young, Reid, 2017. "Introducing metaknowledge: Software for computational research in information science, network analysis, and science of science," Journal of Informetrics, Elsevier, vol. 11(1), pages 176-197.
    18. Gaviria-Marin, Magaly & Merigó, José M. & Baier-Fuentes, Hugo, 2019. "Knowledge management: A global examination based on bibliometric analysis," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 194-220.
    19. Zhichao Wang & Valentin Zelenyuk, 2021. "Performance Analysis of Hospitals in Australia and its Peers: A Systematic Review," CEPA Working Papers Series WP012021, School of Economics, University of Queensland, Australia.
    20. Mehdi Toloo & Rouhollah Khodabandelou & Amar Oukil, 2022. "A Comprehensive Bibliometric Analysis of Fractional Programming (1965–2020)," Mathematics, MDPI, vol. 10(11), pages 1-21, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:12:y:2018:i:2:p:481-493. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.