IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v115y2018i2d10.1007_s11192-018-2680-3.html
   My bibliography  Save this article

Multiple versions of the h-index: cautionary use for formal academic purposes

Author

Listed:
  • Jaime A. Teixeira da Silva
  • Judit Dobránszki

    (University of Debrecen)

Abstract

The h-index, or Hirsch index, named after Jorge E. Hirsch, is one of the few author-based metrics currently available that offers a perspective of the productivity and citation impact of a scientist, researcher, or academic. There are four tools most commonly used to calculate the h-index, all of which depend on separate databases: Scopus, Web of Knowledge, Google Scholar, and ResearchGate. Using the h-index of the authors of this paper derived from these four sources, it is abundantly clear that scores vary widely and that it is unclear which of these sources is a reliable or accurate source of information, for any purpose. As the use and application of author-based metrics increases, including for official academic purposes, it is becoming increasingly important to know which source of the h-index is most accurate, and thus valid. Although this is not a review of the h-index, some perspectives are provided of the h-index-related literature to place this case study within a wider context of the weaknesses and criticisms of using the h-index as a metric to evaluate scientific outcome.

Suggested Citation

  • Jaime A. Teixeira da Silva & Judit Dobránszki, 2018. "Multiple versions of the h-index: cautionary use for formal academic purposes," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1107-1113, May.
    • Handle: RePEc:spr:scient:v:115:y:2018:i:2:d:10.1007_s11192-018-2680-3
    DOI: 10.1007/s11192-018-2680-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-018-2680-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-018-2680-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Olga Popova & Dmitry Romanov & Alexander Drozdov & Alexander Gerashchenko, 2017. "Citation-based criteria of the significance of the research activity of scientific teams," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1179-1202, September.
    2. Jaime A. Teixeira da Silva & Judit Dobránszki, 2017. "Highly cited retracted papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1653-1661, March.
    3. Judit Bar-Ilan, 2008. "Which h-index? — A comparison of WoS, Scopus and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 257-271, February.
    4. Halevi, Gali & Moed, Henk & Bar-Ilan, Judit, 2017. "Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation—Review of the Literature," Journal of Informetrics, Elsevier, vol. 11(3), pages 823-834.
    5. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    6. Jaime A. Teixeira da Silva & Helmar Bornemann-Cimenti, 2017. "Why do some retracted papers continue to be cited?," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 365-370, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guangyuan Hu & Lei Wang & Rong Ni & Weishu Liu, 2020. "Which h-index? An exploration within the Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1225-1233, June.
    2. Pantea Kamrani & Isabelle Dorsch & Wolfgang G. Stock, 2021. "Do researchers know what the h-index is? And how do they estimate its importance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5489-5508, July.
    3. Jaime A. Teixeira da Silva, 2018. "The Google Scholar h-index: useful but burdensome metric," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 631-635, October.
    4. Judit Dobránszki & Jaime A. Teixeira da Silva, 2019. "Corrective factors for author- and journal-based metrics impacted by citations to accommodate for retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 387-398, October.
    5. Alonso Rodríguez-Navarro & Ricardo Brito, 2019. "Probability and expected frequency of breakthroughs: basis and use of a robust method of research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 213-235, April.
    6. Johanna M. Askeridis, 2018. "An h index for Mendeley: comparison of citation-based h indices and a readership-based hmen index for 29 authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 615-624, October.
    7. Lutz Bornmann & Loet Leydesdorff, 2018. "Count highly-cited papers instead of papers with h citations: use normalized citation counts and compare “like with like”!," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1119-1123, May.
    8. Lauranne Chaignon & Domingo Docampo & Daniel Egret, 2023. "In search of a scientific elite: highly cited researchers (HCR) in France," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5801-5827, October.
    9. Haoran Zhu & Lei Lei, 2022. "The Research Trends of Text Classification Studies (2000–2020): A Bibliometric Analysis," SAGE Open, , vol. 12(2), pages 21582440221, April.
    10. Adam Emmer, 2019. "The careers behind and the impact of solo author articles in Nature and Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 825-840, August.
    11. Jaime A. Teixeira da Silva & Judit Dobránszki, 2018. "Rejoinder to “Multiple versions of the h-index: cautionary use for formal academic purposes”," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1131-1137, May.
    12. Rodrigo Costas & Thomas Franssen, 2018. "Reflections around ‘the cautionary use’ of the h-index: response to Teixeira da Silva and Dobránszki," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1125-1130, May.
    13. James Hartley, 2019. "Some reflections on being cited 10,000 times," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 375-381, January.
    14. Jaime A. Teixeira da Silva, 2021. "The i100-index, i1000-index and i10,000-index: expansion and fortification of the Google Scholar h-index for finer-scale citation descriptions and researcher classification," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3667-3672, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pantea Kamrani & Isabelle Dorsch & Wolfgang G. Stock, 2021. "Do researchers know what the h-index is? And how do they estimate its importance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5489-5508, July.
    2. Avick Kumar Dey & Pijush Kanti Dutta Pramanik & Prasenjit Choudhury & Goutam Bandopadhyay, 2021. "Distinctive author ranking using DEA indexing," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(2), pages 601-620, April.
    3. Maor Weinberger & Maayan Zhitomirsky-Geffet, 2021. "Diversity of success: measuring the scholarly performance diversity of tenured professors in the Israeli academia," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 2931-2970, April.
    4. Judit Dobránszki & Jaime A. Teixeira da Silva, 2019. "Corrective factors for author- and journal-based metrics impacted by citations to accommodate for retractions," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 387-398, October.
    5. Liu, Xiaojuan & Wang, Chenlin & Chen, Dar-Zen & Huang, Mu-Hsuan, 2022. "Exploring perception of retraction based on mentioned status in post-retraction citations," Journal of Informetrics, Elsevier, vol. 16(3).
    6. Ana Batlles-delaFuente & Luis Jesús Belmonte-Ureña & José Antonio Plaza-Úbeda & Emilio Abad-Segura, 2021. "Sustainable Business Model in the Product-Service System: Analysis of Global Research and Associated EU Legislation," IJERPH, MDPI, vol. 18(19), pages 1-33, September.
    7. Parul Khurana & Kiran Sharma, 2022. "Impact of h-index on author’s rankings: an improvement to the h-index for lower-ranked authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4483-4498, August.
    8. Behzad Gholampour & Sajad Gholampour & Alireza Noruzi & Clément Arsenault & Thomas Haertlé & Ali Akbar Saboury, 2022. "Retracted articles in oncology in the last three decades: frequency, reasons, and themes," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1841-1865, April.
    9. Emilio Abad-Segura & Ana Batlles-delaFuente & Mariana-Daniela González-Zamar & Luis Jesús Belmonte-Ureña, 2021. "Implications for Sustainability of the Joint Application of Bioeconomy and Circular Economy: A Worldwide Trend Study," Sustainability, MDPI, vol. 13(13), pages 1-24, June.
    10. Salim Moussa, 2022. "The propagation of error: retracted articles in marketing and their citations," Italian Journal of Marketing, Springer, vol. 2022(1), pages 11-36, March.
    11. Bor Luen Tang, 2023. "Some Insights into the Factors Influencing Continuous Citation of Retracted Scientific Papers," Publications, MDPI, vol. 11(4), pages 1-14, October.
    12. Fiorenzo Franceschini & Domenico Maisano, 2011. "Bibliometric positioning of scientific manufacturing journals: a comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 463-485, February.
    13. S. Alonso & F. J. Cabrerizo & E. Herrera-Viedma & F. Herrera, 2010. "hg-index: a new index to characterize the scientific output of researchers based on the h- and g-indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 391-400, February.
    14. Kousha, Kayvan & Thelwall, Mike & Abdoli, Mahshid, 2018. "Can Microsoft Academic assess the early citation impact of in-press articles? A multi-discipline exploratory analysis," Journal of Informetrics, Elsevier, vol. 12(1), pages 287-298.
    15. Mathieu Ouimet & Pierre-Olivier Bédard & François Gélineau, 2011. "Are the h-index and some of its alternatives discriminatory of epistemological beliefs and methodological preferences of faculty members? The case of social scientists in Quebec," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 91-106, July.
    16. Filippo Radicchi & Claudio Castellano, 2013. "Analysis of bibliometric indicators for individual scholars in a large data set," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 627-637, December.
    17. Gad Saad, 2010. "Applying the h-index in exploring bibliometric properties of elite marketing scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(2), pages 423-433, May.
    18. Jaime A. Teixeira da Silva & Serhii Nazarovets, 2023. "Partial citation analysis of five classes of retracted papers, and devising a new four-tier citation classification system for retracted (and other) papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4887-4894, August.
    19. Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2175-2188, September.
    20. Christopher McCarty & James W. Jawitz & Allison Hopkins & Alex Goldman, 2013. "Predicting author h-index using characteristics of the co-author network," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 467-483, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:115:y:2018:i:2:d:10.1007_s11192-018-2680-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.