IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v100y2014i2d10.1007_s11192-014-1308-5.html
   My bibliography  Save this article

Topic-based Pagerank: toward a topic-level scientific evaluation

Author

Listed:
  • Erjia Yan

    (Drexel University)

Abstract

Within the same research field, different subfields and topics may exhibit varied citation behaviors and scholarly communication patterns. For a more effect scientific evaluation at the topic level, this study proposes a topic-based PageRank approach. This approach aims to evaluate the scientific impact of research entities (e.g., papers, authors, journals, and institutions) at the topic-level. The proposed topic-based PageRank, when applied to a data set on library and information science publications, has effectively detected a variety of research topics and identified authors, papers, and journals of the highest impact from each topic. Evaluation results show that compared with the standard PageRank and a topic modeling technique, the proposed topic-based PageRank has the best performance on relevance and impact. Different perspectives of organizing scientific literature are also discussed and this study recommends the mode of organization that integrates stable research domains and dynamic topics.

Suggested Citation

  • Erjia Yan, 2014. "Topic-based Pagerank: toward a topic-level scientific evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 407-437, August.
  • Handle: RePEc:spr:scient:v:100:y:2014:i:2:d:10.1007_s11192-014-1308-5
    DOI: 10.1007/s11192-014-1308-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-014-1308-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-014-1308-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yan, Erjia & Ding, Ying & Cronin, Blaise & Leydesdorff, Loet, 2013. "A bird's-eye view of scientific trading: Dependency relations among fields of science," Journal of Informetrics, Elsevier, vol. 7(2), pages 249-264.
    2. Erjia Yan & Ying Ding & Cassidy R. Sugimoto, 2011. "P-Rank: An indicator measuring prestige in heterogeneous scholarly networks," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(3), pages 467-477, March.
    3. Chaoqun Ni & Cassidy R. Sugimoto & Jiepu Jiang, 2013. "Venue‐author‐coupling: A measure for identifying disciplines through author communities," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 265-279, February.
    4. Cassidy R. Sugimoto & Daifeng Li & Terrell G. Russell & S. Craig Finlay & Ying Ding, 2011. "The shifting sands of disciplinary development: Analyzing North American Library and Information Science dissertations using latent Dirichlet allocation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(1), pages 185-204, January.
    5. Staša Milojević & Cassidy R. Sugimoto & Erjia Yan & Ying Ding, 2011. "The cognitive structure of Library and Information Science: Analysis of article title words," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(10), pages 1933-1953, October.
    6. Erjia Yan & Cassidy R. Sugimoto, 2011. "Institutional interactions: Exploring social, cognitive, and geographic relationships between institutions as demonstrated through citation networks," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(8), pages 1498-1514, August.
    7. Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2012. "A further step forward in measuring journals’ scientific prestige: The SJR2 indicator," Journal of Informetrics, Elsevier, vol. 6(4), pages 674-688.
    8. Erjia Yan & Ying Ding & Elin K. Jacob, 2012. "Overlaying communities and topics: an analysis on publication networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 499-513, February.
    9. Cassidy R. Sugimoto & Daifeng Li & Terrell G. Russell & S. Craig Finlay & Ying Ding, 2011. "The shifting sands of disciplinary development: Analyzing North American Library and Information Science dissertations using latent Dirichlet allocation," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(1), pages 185-204, January.
    10. Ludo Waltman & Nees Jan van Eck, 2012. "A new methodology for constructing a publication‐level classification system of science," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(12), pages 2378-2392, December.
    11. Kevin W. Boyack & Richard Klavans & Katy Börner, 2005. "Mapping the backbone of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(3), pages 351-374, August.
    12. Ying Ding, 2011. "Topic-based PageRank on author cocitation networks," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(3), pages 449-466, March.
    13. Li, Daifeng & Ding, Ying & Shuai, Xin & Bollen, Johan & Tang, Jie & Chen, Shanshan & Zhu, Jiayi & Rocha, Guilherme, 2012. "Adding community and dynamic to topic models," Journal of Informetrics, Elsevier, vol. 6(2), pages 237-253.
    14. Ying Ding, 2011. "Applying weighted PageRank to author citation networks," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(2), pages 236-245, February.
    15. Wolfgang Glänzel & Bart Thijs, 2011. "Using ‘core documents’ for the representation of clusters and topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 297-309, July.
    16. Anthony F.J. van Raan, 2008. "Bibliometric statistical properties of the 100 largest European research universities: Prevalent scaling rules in the science system," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(3), pages 461-475, February.
    17. Ismael Rafols & Loet Leydesdorff, 2009. "Content‐based and algorithmic classifications of journals: Perspectives on the dynamics of scientific communication and indexer effects," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(9), pages 1823-1835, September.
    18. Graeme Hirst, 1978. "Discipline impact factors: A method for determining core journal lists," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 29(4), pages 171-172, July.
    19. Ludo Waltman & Erjia Yan & Nees Jan Eck, 2011. "A recursive field-normalized bibliometric performance indicator: an application to the field of library and information science," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 301-314, October.
    20. Chen, P. & Xie, H. & Maslov, S. & Redner, S., 2007. "Finding scientific gems with Google’s PageRank algorithm," Journal of Informetrics, Elsevier, vol. 1(1), pages 8-15.
    21. Ludo Waltman & Nees Jan Eck, 2012. "A new methodology for constructing a publication-level classification system of science," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2378-2392, December.
    22. Erjia Yan, 2014. "Finding knowledge paths among scientific disciplines," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(11), pages 2331-2347, November.
    23. Frizo Janssens & Wolfgang Glänzel & Bart Moor, 2008. "A hybrid mapping of information science," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(3), pages 607-631, June.
    24. Erjia Yan & Cassidy R. Sugimoto, 2011. "Institutional interactions: Exploring social, cognitive, and geographic relationships between institutions as demonstrated through citation networks," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(8), pages 1498-1514, August.
    25. Chaoqun Ni & Cassidy R. Sugimoto & Jiepu Jiang, 2013. "Venue-author-coupling: A measure for identifying disciplines through author communities," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 265-279, February.
    26. Karol Życzkowski, 2010. "Citation graph, weighted impact factors and performance indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 301-315, October.
    27. Wolfgang Glänzel & Bart Thijs, 2012. "Using ‘core documents’ for detecting and labelling new emerging topics," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 399-416, May.
    28. Staša Milojević & Cassidy R. Sugimoto & Erjia Yan & Ying Ding, 2011. "The cognitive structure of Library and Information Science: Analysis of article title words," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 1933-1953, October.
    29. Yan, Erjia & Ding, Ying & Milojević, Staša & Sugimoto, Cassidy R., 2012. "Topics in dynamic research communities: An exploratory study for the field of information retrieval," Journal of Informetrics, Elsevier, vol. 6(1), pages 140-153.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yanan Wang & An Zeng & Ying Fan & Zengru Di, 2019. "Ranking scientific publications considering the aging characteristics of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 155-166, July.
    2. Dietmar Wolfram, 2015. "The symbiotic relationship between information retrieval and informetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2201-2214, March.
    3. Yongjun Zhu & Erjia Yan, 2015. "Dynamic subfield analysis of disciplines: an examination of the trading impact and knowledge diffusion patterns of computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 335-359, July.
    4. Mengjiao Qi & An Zeng & Menghui Li & Ying Fan & Zengru Di, 2017. "Standing on the shoulders of giants: the effect of outstanding scientists on young collaborators’ careers," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1839-1850, June.
    5. Fiala, Dalibor & Šubelj, Lovro & Žitnik, Slavko & Bajec, Marko, 2015. "Do PageRank-based author rankings outperform simple citation counts?," Journal of Informetrics, Elsevier, vol. 9(2), pages 334-348.
    6. Xie, Qing & Zhang, Xinyuan & Kim, Giyeong & Song, Min, 2022. "Exploring the influence of coauthorship with top scientists on researchers’ affiliation, research topic, productivity, and impact," Journal of Informetrics, Elsevier, vol. 16(3).
    7. Jianlin Zhou & An Zeng & Ying Fan & Zengru Di, 2016. "Ranking scientific publications with similarity-preferential mechanism," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 805-816, February.
    8. Pei Chen & Shan Gao & Fan Jiang & Yifang Ma, 2024. "Measuring the labor market outcomes of universities: evidence from China’s listed company executives," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5715-5730, September.
    9. Ebadi, Ashkan & Tremblay, Stéphane & Goutte, Cyril & Schiffauerova, Andrea, 2020. "Application of machine learning techniques to assess the trends and alignment of the funded research output," Journal of Informetrics, Elsevier, vol. 14(2).
    10. Yongjun Zhu & Erjia Yan & Min Song, 2016. "Understanding the evolving academic landscape of library and information science through faculty hiring data," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1461-1478, September.
    11. Fen Zhao & Yi Zhang & Jianguo Lu & Ofer Shai, 2019. "Measuring academic influence using heterogeneous author-citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1119-1140, March.
    12. Yongjun Zhang & Jialin Ma & Zijian Wang & Bolun Chen & Yongtao Yu, 2018. "Collective topical PageRank: a model to evaluate the topic-dependent academic impact of scientific papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1345-1372, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yongjun Zhu & Erjia Yan, 2015. "Dynamic subfield analysis of disciplines: an examination of the trading impact and knowledge diffusion patterns of computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 335-359, July.
    2. Yan, Erjia, 2014. "Research dynamics: Measuring the continuity and popularity of research topics," Journal of Informetrics, Elsevier, vol. 8(1), pages 98-110.
    3. Mu-hsuan Huang & Wang-Ching Shaw & Chi-Shiou Lin, 2019. "One category, two communities: subfield differences in “Information Science and Library Science” in Journal Citation Reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1059-1079, May.
    4. Rons, Nadine, 2018. "Bibliometric approximation of a scientific specialty by combining key sources, title words, authors and references," Journal of Informetrics, Elsevier, vol. 12(1), pages 113-132.
    5. Chaoqun Ni & Cassidy R. Sugimoto & Blaise Cronin, 2013. "Visualizing and comparing four facets of scholarly communication: producers, artifacts, concepts, and gatekeepers," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1161-1173, March.
    6. Urdiales, Cristina & Guzmán, Eduardo, 2024. "An automatic and association-based procedure for hierarchical publication subject categorization," Journal of Informetrics, Elsevier, vol. 18(1).
    7. María Pinto & Rosaura Fernández-Pascual & David Caballero-Mariscal & Dora Sales, 2020. "Information literacy trends in higher education (2006–2019): visualizing the emerging field of mobile information literacy," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1479-1510, August.
    8. Yi Bu & Binglu Wang & Win-bin Huang & Shangkun Che & Yong Huang, 2018. "Using the appearance of citations in full text on author co-citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 275-289, July.
    9. Bo Wang & Shengbo Liu & Kun Ding & Zeyuan Liu & Jing Xu, 2014. "Identifying technological topics and institution-topic distribution probability for patent competitive intelligence analysis: a case study in LTE technology," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 685-704, October.
    10. Yan, Erjia & Ding, Ying & Cronin, Blaise & Leydesdorff, Loet, 2013. "A bird's-eye view of scientific trading: Dependency relations among fields of science," Journal of Informetrics, Elsevier, vol. 7(2), pages 249-264.
    11. Chiara Carusi & Giuseppe Bianchi, 2020. "A look at interdisciplinarity using bipartite scholar/journal networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 867-894, February.
    12. Sjögårde, Peter & Ahlgren, Per, 2018. "Granularity of algorithmically constructed publication-level classifications of research publications: Identification of topics," Journal of Informetrics, Elsevier, vol. 12(1), pages 133-152.
    13. Jing Zhang & Xiaomin Liu & Lili Wu, 2016. "The study of subject-classification based on journal coupling and expert subject-classification system," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1149-1170, June.
    14. Liwei Cai & Jiahao Tian & Jiaying Liu & Xiaomei Bai & Ivan Lee & Xiangjie Kong & Feng Xia, 2019. "Scholarly impact assessment: a survey of citation weighting solutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 453-478, February.
    15. Pin Li & Guoli Yang & Chuanqi Wang, 2019. "Visual topical analysis of library and information science," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1753-1791, December.
    16. Qian-Jin Zong & Hong-Zhou Shen & Qin-Jian Yuan & Xiao-Wei Hu & Zhi-Ping Hou & Shun-Guo Deng, 2013. "Doctoral dissertations of Library and Information Science in China: A co-word analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 781-799, February.
    17. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    18. Xie, Yundong & Wu, Qiang & Zhang, Peng & Li, Xingchen, 2020. "Information Science and Library Science (IS-LS) journal subject categorisation and comparison based on editorship information," Journal of Informetrics, Elsevier, vol. 14(4).
    19. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    20. A. Abrizah & A. Noorhidawati & A. N. Zainab, 2015. "LIS journals categorization in the Journal Citation Report: a stated preference study," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1083-1099, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:100:y:2014:i:2:d:10.1007_s11192-014-1308-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.