IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i6d10.1007_s11192-024-05038-8.html
   My bibliography  Save this article

Does Granger causality exist between article usage and publication counts? A topic-level time-series evidence from IEEE Xplore

Author

Listed:
  • Wencan Tian

    (Dalian University of Technology)

  • Yongzhen Wang

    (Dalian University of Technology)

  • Zhigang Hu

    (South China Normal University)

  • Ruonan Cai

    (Shandong University)

  • Guangyao Zhang

    (Dalian University of Technology
    Maastricht University)

  • Xianwen Wang

    (Dalian University of Technology)

Abstract

In this study, employing the IEEE Xplore database as the data source, articles on different topics (keywords) and their usage data generated from January 2011 to December 2020 were collected and analyzed. The study examined the temporal relationships between these usage data and publication counts at the topic level via Granger causality analysis. The study found that almost 80% of the topics exhibit significant usage-publication interactions from a time-series perspective, with varying time lag lengths depending on the direction of the Granger causality results. Topics that present bidirectional Granger causality show longer time lag lengths than those exhibiting unidirectional causality. Additionally, the study found that the direction of the unidirectional Granger causality was influenced by the significance of a topic. Topics with a greater preference for article usage as the Granger cause of publication counts were deemed more important. The findings’ reliability was confirmed by varying the maximum lag period. This study provides strong support for using usage data to identify hot topics of research.

Suggested Citation

  • Wencan Tian & Yongzhen Wang & Zhigang Hu & Ruonan Cai & Guangyao Zhang & Xianwen Wang, 2024. "Does Granger causality exist between article usage and publication counts? A topic-level time-series evidence from IEEE Xplore," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3285-3302, June.
    • Handle: RePEc:spr:scient:v:129:y:2024:i:6:d:10.1007_s11192-024-05038-8
    DOI: 10.1007/s11192-024-05038-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-05038-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-024-05038-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anthony Breitzman, 2021. "The relationship between web usage and citation statistics for electronics and information technology articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2085-2105, March.
    2. Ling-Chu Lee & Pin-Hua Lin & Yun-Wen Chuang & Yi-Yang Lee, 2011. "Research output and economic productivity: a Granger causality test," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(2), pages 465-478, November.
    3. Valentina Markusova & Valentin Bogorov & Alexander Libkind, 2018. "Usage metrics vs classical metrics: analysis of Russia’s research output," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 593-603, February.
    4. Pei-Shan Chi & Wolfgang Glänzel, 2018. "Comparison of citation and usage indicators in research assessment in scientific disciplines and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 537-554, July.
    5. Guangyao Zhang & Yuqi Wang & Weixi Xie & Han Du & Chunlin Jiang & Xianwen Wang, 2021. "The open access usage advantage: a temporal and spatial analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6187-6199, July.
    6. Xianwen Wang & Zhi Wang & Shenmeng Xu, 2013. "Tracing scientist’s research trends realtimely," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 717-729, May.
    7. Hong Wu & Huifang Yi & Chang Li, 2021. "An integrated approach for detecting and quantifying the topic evolutions of patent technology: a case study on graphene field," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(8), pages 6301-6321, August.
    8. Barbara McGillivray & Mathias Astell, 2019. "The relationship between usage and citations in an open access mega-journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 817-838, November.
    9. Xu, Haiyun & Winnink, Jos & Yue, Zenghui & Zhang, Huiling & Pang, Hongshen, 2021. "Multidimensional Scientometric indicators for the detection of emerging research topics," Technological Forecasting and Social Change, Elsevier, vol. 163(C).
    10. Jin-kun Wan & Ping-huan Hua & Ronald Rousseau & Xiu-kun Sun, 2010. "The journal download immediacy index (DII): experiences using a Chinese full-text database," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 555-566, March.
    11. Small, Henry & Boyack, Kevin W. & Klavans, Richard, 2014. "Identifying emerging topics in science and technology," Research Policy, Elsevier, vol. 43(8), pages 1450-1467.
    12. Kevin W. Boyack & Richard Klavans, 2010. "Co‐citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(12), pages 2389-2404, December.
    13. Pei-Shan Chi & Juan Gorraiz & Wolfgang Glänzel, 2019. "Comparing capture, usage and citation indicators: an altmetric analysis of journal papers in chemistry disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1461-1473, September.
    14. Johan Bollen & Herbert van de Sompel, 2006. "Mapping the structure of science through usage," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(2), pages 227-258, November.
    15. Liwen Vaughan & Juan Tang & Rongbin Yang, 2017. "Investigating disciplinary differences in the relationships between citations and downloads," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1533-1545, June.
    16. Chaomei Chen, 2006. "CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(3), pages 359-377, February.
    17. Yang Ding & Xianlei Dong & Yi Bu & Bin Zhang & Kexin Lin & Beibei Hu, 2021. "Revisiting the relationship between downloads and citations: a perspective from papers with different citation patterns in the case of the Lancet," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7609-7621, September.
    18. Star X. Zhao & Wen Lou & Alice M. Tan & Shuang Yu, 2018. "Do funded papers attract more usage?," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 153-168, April.
    19. Muhammad Salman Khan & Muhammad Younas, 2017. "Analyzing readers behavior in downloading articles from IEEE digital library: a study of two selected journals in the field of education," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1523-1537, March.
    20. Xianwen Wang & Chen Liu & Wenli Mao & Zhichao Fang, 2015. "Erratum to: The open access advantage considering citation, article usage and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 1149-1149, June.
    21. Wanying Ding & Chaomei Chen, 2014. "Dynamic topic detection and tracking: A comparison of HDP, C-word, and cocitation methods," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(10), pages 2084-2097, October.
    22. Joshua J. Clarkson & Chris Janiszewski & Melissa D. Cinelli, 2013. "The Desire for Consumption Knowledge," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 39(6), pages 1313-1329.
    23. Chenwei Zhang & Yi Bu & Ying Ding & Jian Xu, 2018. "Understanding scientific collaboration: Homophily, transitivity, and preferential attachment," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(1), pages 72-86, January.
    24. Wolfgang Glänzel & Juan Gorraiz, 2015. "Usage metrics versus altmetrics: confusing terminology?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2161-2164, March.
    25. Pei-Shan Chi, 2020. "The field-specific citation and usage patterns of book literature in the Book Citation Index," Research Evaluation, Oxford University Press, vol. 29(2), pages 203-214.
    26. Zhichao Fang & Rodrigo Costas & Wencan Tian & Xianwen Wang & Paul Wouters, 2020. "An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2519-2549, September.
    27. Christian Schlögl & Juan Gorraiz & Christian Gumpenberger & Kris Jack & Peter Kraker, 2014. "Comparison of downloads, citations and readership data for two information systems journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1113-1128, November.
    28. Uddin, Shahadat & Khan, Arif, 2016. "The impact of author-selected keywords on citation counts," Journal of Informetrics, Elsevier, vol. 10(4), pages 1166-1177.
    29. Kevin W. Boyack & Richard Klavans, 2010. "Co-citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(12), pages 2389-2404, December.
    30. Inchae Park & Keeeun Lee & Byungun Yoon, 2015. "Exploring Promising Research Frontiers Based on Knowledge Maps in the Solar Cell Technology Field," Sustainability, MDPI, vol. 7(10), pages 1-30, October.
    31. Mike Thelwall & Nabeil Maflahi, 2015. "Are scholarly articles disproportionately read in their own country? An analysis of mendeley readers," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(6), pages 1124-1135, June.
    32. Katy Börner & Shashikant Penumarthy & Mark Meiss & Weimao Ke, 2006. "Mapping the diffusion of scholarly knowledge among major U.S. research institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 415-426, September.
    33. Woo Hyoung Lee, 2008. "How to identify emerging research fields using scientometrics: An example in the field of Information Security," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(3), pages 503-525, September.
    34. Iman Tahamtan & Lutz Bornmann, 2019. "What do citation counts measure? An updated review of studies on citations in scientific documents published between 2006 and 2018," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1635-1684, December.
    35. Zahedi, Zohreh & Haustein, Stefanie, 2018. "On the relationships between bibliographic characteristics of scientific documents and citation and Mendeley readership counts: A large-scale analysis of Web of Science publications," Journal of Informetrics, Elsevier, vol. 12(1), pages 191-202.
    36. Johan Bollen & Herbert Van de Sompel, 2008. "Usage impact factor: The effects of sample characteristics on usage‐based impact metrics," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(1), pages 136-149, January.
    37. Tim Brody & Stevan Harnad & Leslie Carr, 2006. "Earlier Web usage statistics as predictors of later citation impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(8), pages 1060-1072, June.
    38. Xianwen Wang & Chen Liu & Wenli Mao & Zhichao Fang, 2015. "The open access advantage considering citation, article usage and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 555-564, May.
    39. Hu, Beibei & Ding, Yang & Dong, Xianlei & Bu, Yi & Ding, Ying, 2021. "On the relationship between download and citation counts: An introduction of Granger-causality inference," Journal of Informetrics, Elsevier, vol. 15(2).
    40. Xianwen Wang & Wenli Mao & Shenmeng Xu & Chunbo Zhang, 2014. "Usage history of scientific literature: Nature metrics and metrics of Nature publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1923-1933, March.
    41. Najmeh Masoumi & Reza Khajavi, 2023. "A fuzzy classifier for evaluation of research topics by using keyword co-occurrence network and sponsors information," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1485-1512, March.
    42. Wolfgang Glänzel & Bart Thijs, 2012. "Using ‘core documents’ for detecting and labelling new emerging topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 399-416, May.
    43. Vicente P. Guerrero-Bote & Félix Moya-Anegón, 2014. "Relationship between downloads and citations at journal and paper levels, and the influence of language," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1043-1065, November.
    44. Jeong, Do-Heon & Song, Min, 2014. "Time gap analysis by the topic model-based temporal technique," Journal of Informetrics, Elsevier, vol. 8(3), pages 776-790.
    45. Juan Gorraiz & Christian Gumpenberger & Christian Schlögl, 2014. "Usage versus citation behaviours in four subject areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1077-1095, November.
    46. Michael J. Kurtz & Edwin A. Henneken, 2017. "Measuring metrics - a 40-year longitudinal cross-validation of citations, downloads, and peer review in astrophysics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(3), pages 695-708, March.
    47. Christian Schloegl & Juan Gorraiz, 2010. "Comparison of citation and usage indicators: the case of oncology journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 567-580, March.
    48. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bikun Chen, 2018. "Usage pattern comparison of the same scholarly articles between Web of Science (WoS) and Springer," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 519-537, April.
    2. Yufeng Duan & Zequan Xiong, 2017. "Download patterns of journal papers and their influencing factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1761-1775, September.
    3. Hu, Beibei & Ding, Yang & Dong, Xianlei & Bu, Yi & Ding, Ying, 2021. "On the relationship between download and citation counts: An introduction of Granger-causality inference," Journal of Informetrics, Elsevier, vol. 15(2).
    4. Barbara McGillivray & Mathias Astell, 2019. "The relationship between usage and citations in an open access mega-journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 817-838, November.
    5. Bikun Chen & Dannan Deng & Zhouyan Zhong & Chengzhi Zhang, 2020. "Exploring linguistic characteristics of highly browsed and downloaded academic articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1769-1790, March.
    6. Shuo Xu & Liyuan Hao & Xin An & Hongshen Pang & Ting Li, 2020. "Review on emerging research topics with key-route main path analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 607-624, January.
    7. Chunli Wei & Jingyi Zhao & Jue Ni & Jiang Li, 2023. "What does open peer review bring to scientific articles? Evidence from PLoS journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2763-2776, May.
    8. Xianwen Wang & Zhichao Fang & Xiaoling Sun, 2016. "Usage patterns of scholarly articles on Web of Science: a study on Web of Science usage count," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 917-926, November.
    9. Anthony Breitzman, 2021. "The relationship between web usage and citation statistics for electronics and information technology articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2085-2105, March.
    10. Liwen Vaughan & Juan Tang & Rongbin Yang, 2017. "Investigating disciplinary differences in the relationships between citations and downloads," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1533-1545, June.
    11. Zhiqi Wang & Wolfgang Glänzel & Yue Chen, 2020. "The impact of preprints in Library and Information Science: an analysis of citations, usage and social attention indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1403-1423, November.
    12. Zhichao Fang & Rodrigo Costas & Wencan Tian & Xianwen Wang & Paul Wouters, 2020. "An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2519-2549, September.
    13. Muhammad Salman Khan & Muhammad Younas, 2017. "Analyzing readers behavior in downloading articles from IEEE digital library: a study of two selected journals in the field of education," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1523-1537, March.
    14. Mojisola Erdt & Htet Htet Aung & Ashley Sara Aw & Charlie Rapple & Yin-Leng Theng, 2017. "Analysing researchers’ outreach efforts and the association with publication metrics: A case study of Kudos," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-25, August.
    15. Siluo Yang & Xin Xing & Dietmar Wolfram, 2018. "Difference in the impact of open-access papers published by China and the USA," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1017-1037, May.
    16. Kraker, Peter & Schlögl, Christian & Jack, Kris & Lindstaedt, Stefanie, 2015. "Visualization of co-readership patterns from an online reference management system," Journal of Informetrics, Elsevier, vol. 9(1), pages 169-182.
    17. Wolfgang Glänzel & Juan Gorraiz, 2015. "Usage metrics versus altmetrics: confusing terminology?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2161-2164, March.
    18. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    19. Xu, Shuo & Hao, Liyuan & An, Xin & Yang, Guancan & Wang, Feifei, 2019. "Emerging research topics detection with multiple machine learning models," Journal of Informetrics, Elsevier, vol. 13(4).
    20. Yuan Zhou & Heng Lin & Yufei Liu & Wei Ding, 2019. "A novel method to identify emerging technologies using a semi-supervised topic clustering model: a case of 3D printing industry," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 167-185, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:6:d:10.1007_s11192-024-05038-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.