IDEAS home Printed from https://ideas.repec.org/a/gam/jpubli/v12y2024i2p12-d1380265.html
   My bibliography  Save this article

Coping with the Inequity and Inefficiency of the H-Index: A Cross-Disciplinary Empirical Analysis

Author

Listed:
  • Fabio Zagonari

    (Dipartimento di Scienze per la Qualità della Vita, Università di Bologna, C.so d’Augusto 237, 47921 Rimini, Italy)

  • Paolo Foschi

    (Dipartimento di Scienze Statistiche “Paolo Fortunati”, Università di Bologna, 40126 Bologna, Italy)

Abstract

This paper measures two main inefficiency features (many publications other than articles; many co-authors’ reciprocal citations) and two main inequity features (more co-authors in some disciplines; more citations for authors with more experience). It constructs a representative dataset based on a cross-disciplinary balanced sample (10,000 authors with at least one publication indexed in Scopus from 2006 to 2015). It estimates to what extent four additional improvements of the H-index as top-down regulations (∆H h = H h − H h+1 from H 1 = based on publications to H 5 = net per-capita per-year based on articles) account for inefficiency and inequity across twenty-five disciplines and four subjects. Linear regressions and ANOVA results show that the single improvements of the H-index considerably and decreasingly explain the inefficiency and inequity features but make these vaguely comparable across disciplines and subjects, while the overall improvement of the H-index (H 1 –H 5 ) marginally explains these features but make disciplines and subjects clearly comparable, to a greater extent across subjects than disciplines. Fitting a Gamma distribution to H 5 for each discipline and subject by maximum likelihood shows that the estimated probability densities and the percentages of authors characterised by H 5 ≥ 1 to H 5 ≥ 3 are different across disciplines but similar across subjects.

Suggested Citation

  • Fabio Zagonari & Paolo Foschi, 2024. "Coping with the Inequity and Inefficiency of the H-Index: A Cross-Disciplinary Empirical Analysis," Publications, MDPI, vol. 12(2), pages 1-30, April.
  • Handle: RePEc:gam:jpubli:v:12:y:2024:i:2:p:12-:d:1380265
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2304-6775/12/2/12/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2304-6775/12/2/12/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Matthias Kuppler, 2022. "Predicting the future impact of Computer Science researchers: Is there a gender bias?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6695-6732, November.
    2. John Mingers & Martin Meyer, 2017. "Erratum to: Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1123-1124, August.
    3. James C. Ryan, 2016. "A validation of the individual annual h-index (hIa): application of the hIa to a qualitatively and quantitatively different sample," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(1), pages 577-590, October.
    4. Zahid Halim & Shafaq Khan, 2019. "A data science-based framework to categorize academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 393-423, April.
    5. Corey J A Bradshaw & Justin M Chalker & Stefani A Crabtree & Bart A Eijkelkamp & John A Long & Justine R Smith & Kate Trinajstic & Vera Weisbecker, 2021. "A fairer way to compare researchers at any career stage and in any discipline using open-access citation data," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-15, September.
    6. Eungi Kim & Da-Yeong Jeong, 2023. "Dominant Characteristics of Subject Categories in a Multiple-Category Hierarchical Scheme: A Case Study of Scopus," Publications, MDPI, vol. 11(4), pages 1-13, December.
    7. John Mingers & Martin Meyer, 2017. "Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1111-1121, August.
    8. Tolga Yuret, 2018. "Author-weighted impact factor and reference return ratio: can we attain more equality among fields?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2097-2111, September.
    9. Abdulrahman A. Alshdadi & Muhammad Usman & Madini O. Alassafi & Muhammad Tanvir Afzal & Rayed AlGhamdi, 2023. "Formulation of rules for the scientific community using deep learning," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1825-1852, March.
    10. Yinyu Jin & Sha Yuan & Zhou Shao & Wendy Hall & Jie Tang, 2021. "Turing Award elites revisited: patterns of productivity, collaboration, authorship and impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2329-2348, March.
    11. Muhammad Usman & Ghulam Mustafa & Muhammad Tanvir Afzal, 2021. "Ranking of author assessment parameters using Logistic Regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 335-353, January.
    12. Ana C. M. Brito & Filipi N. Silva & Diego R. Amancio, 2023. "Analyzing the influence of prolific collaborations on authors productivity and visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2471-2487, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Diana Barros (a) Aurora A.C. Teixeira (b), 2021. "A Portrait of Development Economics in the Last Sixty Years," Journal of Economic Development, Chung-Ang Unviersity, Department of Economics, vol. 46(2), pages 69-118, June.
    2. Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "A novel method for depicting academic disciplines through Google Scholar Citations: The case of Bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1251-1273, March.
    3. Mahsa Kaveh & Mahdieh Mirzabeigi & Hajar Sotudeh & Amirsaeid Moloodi, 2022. "The effects of the challenges in the transliteration of Persian names into English on the recall of retrieved results in the web of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 1099-1128, February.
    4. Anne K. Krüger, 2020. "Quantification 2.0? Bibliometric Infrastructures in Academic Evaluation," Politics and Governance, Cogitatio Press, vol. 8(2), pages 58-67.
    5. Jaime A. Teixeira da Silva, 2018. "The Google Scholar h-index: useful but burdensome metric," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 631-635, October.
    6. Enrique Orduna-Malea & Selenay Aytac & Clara Y. Tran, 2019. "Universities through the eyes of bibliographic databases: a retroactive growth comparison of Google Scholar, Scopus and Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 433-450, October.
    7. Jeppe Nicolaisen & Tove Faber Frandsen, 2021. "Number of references: a large-scale study of interval ratios," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 259-285, January.
    8. Luna-Morales Maria Elena & Luna-Morales Evelia & Pérez-Angón Miguel Ángel, 2021. "Influence of the international collaboration in the field of metric studies of science and technology: the case of Mexico (1971–2018)," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2485-2511, March.
    9. Michael Gusenbauer, 2019. "Google Scholar to overshadow them all? Comparing the sizes of 12 academic search engines and bibliographic databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 177-214, January.
    10. Wu, Jiang & Ou, Guiyan & Liu, Xiaohui & Dong, Ke, 2022. "How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence," Journal of Informetrics, Elsevier, vol. 16(2).
    11. Adela Laura Popa & Naiana Nicoleta Ţarcă & Dinu Vlad Sasu & Simona Aurelia Bodog & Remus Dorel Roşca & Teodora Mihaela Tarcza, 2022. "Exploring Marketing Insights for Healthcare: Trends and Perspectives Based on Literature Investigation," Sustainability, MDPI, vol. 14(17), pages 1-21, August.
    12. Nakajima, Kazuki & Liu, Ruodan & Shudo, Kazuyuki & Masuda, Naoki, 2023. "Quantifying gender imbalance in East Asian academia: Research career and citation practice," Journal of Informetrics, Elsevier, vol. 17(4).
    13. José Luis Gallego Ortega & Antonio Rodríguez Fuentes & Antonio García Guzmán, 2021. "Application of Mathematical Methods to the Study of Special-Needs Education in Spanish Journals," Mathematics, MDPI, vol. 9(6), pages 1-17, March.
    14. Saarela, Mirka & Kärkkäinen, Tommi, 2020. "Can we automate expert-based journal rankings? Analysis of the Finnish publication indicator," Journal of Informetrics, Elsevier, vol. 14(2).
    15. Mingyang Wang & Shijia Jiao & Kah-Hin Chai & Guangsheng Chen, 2019. "Building journal’s long-term impact: using indicators detected from the sustained active articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 261-283, October.
    16. Croft, William L. & Sack, Jörg-Rüdiger, 2022. "Predicting the citation count and CiteScore of journals one year in advance," Journal of Informetrics, Elsevier, vol. 16(4).
    17. Julián D. Cortés & Daniel A. Andrade, 2022. "Winners and runners-up alike?—a comparison between awardees and special mention recipients of the most reputable science award in Colombia via a composite citation indicator," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-14, December.
    18. Lin Feng & Jian Zhou & Sheng-Lan Liu & Ning Cai & Jie Yang, 2020. "Analysis of journal evaluation indicators: an experimental study based on unsupervised Laplacian score," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 233-254, July.
    19. Yu, Shuo & Alqahtani, Fayez & Tolba, Amr & Lee, Ivan & Jia, Tao & Xia, Feng, 2022. "Collaborative Team Recognition: A Core Plus Extension Structure," Journal of Informetrics, Elsevier, vol. 16(4).
    20. Nisar Ali & Zahid Halim & Syed Fawad Hussain, 2023. "An artificial intelligence-based framework for data-driven categorization of computer scientists: a case study of world’s Top 10 computing departments," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1513-1545, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jpubli:v:12:y:2024:i:2:p:12-:d:1380265. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.