IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v113y2017i2d10.1007_s11192-017-2510-z.html
   My bibliography  Save this article

Evaluating journal impact based on weighted citations

Author

Listed:
  • Fuli Zhang

    (Anshan Normal University)

Abstract

Publishing at high-rank journals is a common objective to most researchers, and there’s a crucial need for a journal ranking system with universal recognition. This paper presents a quantitative approach to rank scientific journals. The approach, HR-PageRank, combines weighted PageRank according to author’s H-index, and relevance between citing and cited papers. The output of the proposed approach is compared against journal impact factor, H5-index, PageRank algorithm and China Computer Federation ranking list. The experiments of quantifying scholarly impact objectively are conducted in two real scholarly data sets: (1) Microsoft Academic Graph and (2) Digital Bibliography and Library Project. Our experimental results indicate that HR-PageRank algorithm outperforms the well-known PageRank algorithm in finding the influential journals according to Spearman’s rank correlation coefficient, discounted cumulated gain and the correlation C.

Suggested Citation

  • Fuli Zhang, 2017. "Evaluating journal impact based on weighted citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1155-1169, November.
    • Handle: RePEc:spr:scient:v:113:y:2017:i:2:d:10.1007_s11192-017-2510-z
    DOI: 10.1007/s11192-017-2510-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2510-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2510-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bornmann, Lutz & Mutz, Rüdiger & Hug, Sven E. & Daniel, Hans-Dieter, 2011. "A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants," Journal of Informetrics, Elsevier, vol. 5(3), pages 346-359.
    2. Erjia Yan & Ying Ding & Cassidy R. Sugimoto, 2011. "P-Rank: An indicator measuring prestige in heterogeneous scholarly networks," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(3), pages 467-477, March.
    3. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    4. E. Garfield & I. H. Sher, 1963. "New factors in the evaluation of scientific literature through citation indexing," American Documentation, Wiley Blackwell, vol. 14(3), pages 195-201, July.
    5. J. E. Hirsch, 2010. "An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 741-754, December.
    6. Su, Cheng & Pan, YunTao & Zhen, YanNing & Ma, Zheng & Yuan, JunPeng & Guo, Hong & Yu, ZhengLu & Ma, CaiFeng & Wu, YiShan, 2011. "PrestigeRank: A new evaluation method for papers and journals," Journal of Informetrics, Elsevier, vol. 5(1), pages 1-13.
    7. Chen, P. & Xie, H. & Maslov, S. & Redner, S., 2007. "Finding scientific gems with Google’s PageRank algorithm," Journal of Informetrics, Elsevier, vol. 1(1), pages 8-15.
    8. Michael Schreiber, 2015. "A variant of the h-index to measure recent performance," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2373-2380, November.
    9. Philip Ball, 2006. "Prestige is factored into journal ratings," Nature, Nature, vol. 439(7078), pages 770-770, February.
    10. Anne‐Wil Harzing & Ron van der Wal, 2009. "A Google Scholar h‐index for journals: An alternative metric to measure journal impact in economics and business," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 41-46, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bai, Xiaomei & Zhang, Fuli & Liu, Jiaying & Xia, Feng, 2023. "Quantifying the impact of scientific collaboration and papers via motif-based heterogeneous networks," Journal of Informetrics, Elsevier, vol. 17(2).
    2. Alexander Kuchansky & Andrii Biloshchytskyi & Yurii Andrashko & Svitlana Biloshchytska & Adil Faizullin, 2022. "The Scientific Productivity of Collective Subjects Based on the Time-Weighted PageRank Method with Citation Intensity," Publications, MDPI, vol. 10(4), pages 1-17, October.
    3. Zhang, Baolong & Wang, Hao & Deng, Sanhong & Su, Xinning, 2020. "Measurement and analysis of Chinese journal discriminative capacity," Journal of Informetrics, Elsevier, vol. 14(1).
    4. Lian, Ying & Liu, Yijun & Dong, Xuefan, 2020. "Strategies for controlling false online information during natural disasters: The case of Typhoon Mangkhut in China," Technology in Society, Elsevier, vol. 62(C).
    5. Ying Lian & Yueting Zhou & Xueying Lian & Xuefan Dong, 2022. "Cyber violence caused by the disclosure of route information during the COVID-19 pandemic," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-18, December.
    6. Bin Wang & Feng Wu & Lukui Shi, 2023. "AGSTA-NET: adaptive graph spatiotemporal attention network for citation count prediction," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 511-541, January.
    7. Hou, Shengjie & Zhang, Xiang & Yi, Biyi & Tang, Yi, 2022. "Public attitudes on open source communities in China: A text mining analysis," Technology in Society, Elsevier, vol. 71(C).
    8. Yu, Dejian & Sheng, Libo, 2021. "Influence difference main path analysis: Evidence from DNA and blockchain domain citation networks," Journal of Informetrics, Elsevier, vol. 15(4).
    9. Xie, Qing & Zhang, Xinyuan & Song, Min, 2021. "A network embedding-based scholar assessment indicator considering four facets: Research topic, author credit allocation, field-normalized journal impact, and published time," Journal of Informetrics, Elsevier, vol. 15(4).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eleni Fragkiadaki & Georgios Evangelidis, 2016. "Three novel indirect indicators for the assessment of papers and authors based on generations of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 657-694, February.
    2. Dinesh Pradhan & Partha Sarathi Paul & Umesh Maheswari & Subrata Nandi & Tanmoy Chakraborty, 2017. "$$C^3$$ C 3 -index: a PageRank based multi-faceted metric for authors’ performance measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 253-273, January.
    3. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    4. Anne-Wil Harzing & Satu Alakangas & David Adams, 2014. "hIa: an individual annual h-index to accommodate disciplinary and career length differences," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 811-821, June.
    5. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    6. Xiaorui Jiang & Xiaoping Sun & Hai Zhuge, 2013. "Graph-based algorithms for ranking researchers: not all swans are white!," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 743-759, September.
    7. Akshaya Kumar Biswal, 2013. "An Absolute Index (Ab-index) to Measure a Researcher’s Useful Contributions and Productivity," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-10, December.
    8. Fen Zhao & Yi Zhang & Jianguo Lu & Ofer Shai, 2019. "Measuring academic influence using heterogeneous author-citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1119-1140, March.
    9. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.
    10. Eleni Fragkiadaki & Georgios Evangelidis, 2014. "Review of the indirect citations paradigm: theory and practice of the assessment of papers, authors and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 261-288, May.
    11. Loet Leydesdorff & Lutz Bornmann & Tobias Opthof, 2019. "hα: the scientist as chimpanzee or bonobo," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1163-1166, March.
    12. Asma Hammami & Nabil Semmar, 2022. "The simplex simulation as a tool to reveal publication strategies and citation factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 319-350, January.
    13. Jingda Ding & Chao Liu & Goodluck Asobenie Kandonga, 2020. "Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1303-1322, March.
    14. Vîiu, Gabriel-Alexandru, 2016. "A theoretical evaluation of Hirsch-type bibliometric indicators confronted with extreme self-citation," Journal of Informetrics, Elsevier, vol. 10(2), pages 552-566.
    15. Deming Lin & Tianhui Gong & Wenbin Liu & Martin Meyer, 2020. "An entropy-based measure for the evolution of h index research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2283-2298, December.
    16. Ash Mohammad Abbas, 2011. "Weighted indices for evaluating the quality of research with multiple authorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 107-131, July.
    17. Jiang Wu, 2013. "Geographical knowledge diffusion and spatial diversity citation rank," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 181-201, January.
    18. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    19. Lathabai, Hiran H., 2020. "ψ-index: A new overall productivity index for actors of science and technology," Journal of Informetrics, Elsevier, vol. 14(4).
    20. Marcin Kozak & Lutz Bornmann, 2012. "A New Family of Cumulative Indexes for Measuring Scientific Performance," PLOS ONE, Public Library of Science, vol. 7(10), pages 1-4, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:113:y:2017:i:2:d:10.1007_s11192-017-2510-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.