IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v92y2012i2d10.1007_s11192-012-0637-5.html
   My bibliography  Save this article

Positive and negative aspects of citation indices and journal impact factors

Author

Listed:
  • Alexandru T. Balaban

    (Texas A&M University at Galveston)

Abstract

The Hirsch citation index h is nowadays the most frequently used numerical indicator for the performance of scientists as reflected in their output and in the reaction of the scientific community reflected in citations of individual contributions. A few of the possible improvements of h are briefly reviewed. Garfield’s journal impact factor (IF) characterizes the reaction of the scientific community to publications in journals, reflected in citations of all papers published in any given journal during the preceding 2 years, and normalized against all citable articles during the same period. Again, a few of the possible improvements or supplements of IF are briefly reviewed, including the journal-h index proposed by Braun, Glänzel, and Schubert. Ascribing higher weighting factors to citations of individual papers proportionally to IF is considered to be a misuse of useful numerical indices based on citations. At most, one could turn this argument on its head and one can find reasons to ascribe an inverse proportionality relative to IF for individual citations: if a paper is considered worthy to be cited even if it was published in a low-IF journal, that citation ought to be worth more than if the citation would have been from a higher-impact journal. A weight factor reflecting the prestige of the citing author(s) may also be considered.

Suggested Citation

  • Alexandru T. Balaban, 2012. "Positive and negative aspects of citation indices and journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 241-247, August.
    • Handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0637-5
    DOI: 10.1007/s11192-012-0637-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-012-0637-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-012-0637-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Milan Randić, 2009. "Citations versus limitations of citations: beyond Hirsch index," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(3), pages 809-818, September.
    2. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    3. Leo Egghe, 2010. "Letter to the editor: On Randić’s H-sequence," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 795-797, September.
    4. Graeme Hirst, 1978. "Discipline impact factors: A method for determining core journal lists," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 29(4), pages 171-172, July.
    5. Jerome K. Vanclay, 2009. "Bias in the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 3-12, January.
    6. William W. Hood & Concepción S. Wilson, 2001. "The Literature of Bibliometrics, Scientometrics, and Informetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 52(2), pages 291-314, October.
    7. Lutz Bornmann & Hans‐Dieter Daniel, 2007. "What do we know about the h index?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(9), pages 1381-1385, July.
    8. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gerhard Reichmann & Christian Schlögl, 2022. "On the possibilities of presenting the research performance of an institute over a long period of time: the case of the Institute of Information Science at the University of Graz in Austria," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3193-3223, June.
    2. Francisco González Sala & Julia Osca Lluch & Francisco Tortosa Gil & María Peñaranda Ortega, 2017. "Characteristics of monographic special issues in Ibero-American psychology journals: visibility and relevance for authors and publishers," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1069-1077, August.
    3. Marcelo Mendoza, 2021. "Differences in Citation Patterns across Areas, Article Types and Age Groups of Researchers," Publications, MDPI, vol. 9(4), pages 1-23, October.
    4. Zeki Simsek & Ciaran Heavey & Justin J. P. Jansen, 2013. "Journal Impact as a Diffusion Process: A Conceptualization and the Case of the Journal of Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 50(8), pages 1374-1407, December.
    5. Peter Jacso, 2012. "Grim tales about the impact factor and the h-index in the Web of Science and the Journal Citation Reports databases: reflections on Vanclay’s criticism," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 325-354, August.
    6. Huang, Mu-Hsuan & Huang, Wei-Tzu & Chen, Dar-Zen, 2014. "Technological impact factor: An indicator to measure the impact of academic publications on practical innovation," Journal of Informetrics, Elsevier, vol. 8(1), pages 241-251.
    7. Saeed-Ul Hassan & Mubashir Imran & Sehrish Iqbal & Naif Radi Aljohani & Raheel Nawaz, 2018. "Deep context of citations using machine-learning models in scholarly full-text articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1645-1662, December.
    8. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    9. Zhiwei Zhou & Rui Xing & Jing Liu & Feiyue Xing, 2014. "Landmark papers written by the Nobelists in physics from 1901 to 2012: a bibliometric analysis of their citations and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 329-338, August.
    10. Walters, William H., 2014. "Do Article Influence scores overestimate the citation impact of social science journals in subfields that are related to higher-impact natural science disciplines?," Journal of Informetrics, Elsevier, vol. 8(2), pages 421-430.
    11. Finardi, Ugo, 2013. "Correlation between Journal Impact Factor and Citation Performance: An experimental study," Journal of Informetrics, Elsevier, vol. 7(2), pages 357-370.
    12. Eduardo Araujo Oliveira & Roberto Peicots-Filho & Daniella Reis Martelli & Isabel Gomes Quirino & Maria Christina Lopes Oliveira & Mariana Guerra Duarte & Sergio Veloso Pinheiro & Enrico Antonio Colos, 2013. "Is there a correlation between journal impact factor and researchers’ performance? A study comprising the fields of clinical nephrology and neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 149-160, November.
    13. Rogge, Jan-Christoph, 2015. "Soziale Bedingungen und Effekte der quantitativen Leistungsmessung: Ergebnisse einer Befragung von jungen Wissenschaftlerinnen und Wissenschaftlern," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 66(2), pages 205-214.
    14. Osterloh,, 2016. "Professor – Brötli-Fresser: Entwicklungstendenzen und Zukunftsperspektiven des Theorie-Praxis-Verhältnisses in der Managementforschung," Die Unternehmung - Swiss Journal of Business Research and Practice, Nomos Verlagsgesellschaft mbH & Co. KG, vol. 70(4), pages 471-485.
    15. João Mateus Freitas Veneroso & Marlon Dias & Alberto Ueda & Sabir Ribas & Berthier Ribeiro-Neto & Nivio Ziviani & Edmundo Souza e Silva, 2019. "P-score: a reputation bibliographic index that complements citation counts," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1269-1291, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter Jacso, 2012. "Grim tales about the impact factor and the h-index in the Web of Science and the Journal Citation Reports databases: reflections on Vanclay’s criticism," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 325-354, August.
    2. Derek R. Smith, 2012. "Impact factors, scientometrics and the history of citation-based research," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 419-427, August.
    3. Marcin Kozak & Lutz Bornmann, 2012. "A New Family of Cumulative Indexes for Measuring Scientific Performance," PLOS ONE, Public Library of Science, vol. 7(10), pages 1-4, October.
    4. Rey-Martí, Andrea & Ribeiro-Soriano, Domingo & Palacios-Marqués, Daniel, 2016. "A bibliometric analysis of social entrepreneurship," Journal of Business Research, Elsevier, vol. 69(5), pages 1651-1655.
    5. Amin Mazloumian, 2012. "Predicting Scholars' Scientific Impact," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-5, November.
    6. Judit Bar-Ilan, 2012. "Journal report card," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 249-260, August.
    7. Bornmann, Lutz & Marx, Werner, 2012. "HistCite analysis of papers constituting the h index research front," Journal of Informetrics, Elsevier, vol. 6(2), pages 285-288.
    8. Vanclay, Jerome K., 2013. "Factors affecting citation rates in environmental science," Journal of Informetrics, Elsevier, vol. 7(2), pages 265-271.
    9. Roberto Todeschini, 2011. "The j-index: a new bibliometric index and multivariate comparisons between other common indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 621-639, June.
    10. Damien Besancenot & Kim Huynh & Francisco Serranito, 2015. "Co-Authorship And Individual Research Productivity In Economics: Assessing The Assortative Matching Hypothesis," Working Papers halshs-01252373, HAL.
    11. Fiorenzo Franceschini & Domenico Maisano, 2011. "Bibliometric positioning of scientific manufacturing journals: a comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 463-485, February.
    12. Marek Gągolewski & Przemysław Grzegorzewski, 2009. "A geometric approach to the construction of scientific impact indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 617-634, December.
    13. Chao Lu & Ying Ding & Chengzhi Zhang, 2017. "Understanding the impact change of a highly cited article: a content-based citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 927-945, August.
    14. Thed Leeuwen, 2012. "Discussing some basic critique on Journal Impact Factors: revision of earlier comments," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 443-455, August.
    15. Kang, Kiyeon & Sohn, So Young, 2016. "Evaluating the patenting activities of pharmaceutical research organizations based on new technology indices," Journal of Informetrics, Elsevier, vol. 10(1), pages 74-81.
    16. Leng Liu & Congjie Cao & Wei Song, 2023. "Bibliometric Analysis in the Field of Rural Revitalization: Current Status, Progress, and Prospects," IJERPH, MDPI, vol. 20(1), pages 1-18, January.
    17. Franceschini, Fiorenzo & Maisano, Domenico, 2010. "The Hirsch spectrum: A novel tool for analyzing scientific journals," Journal of Informetrics, Elsevier, vol. 4(1), pages 64-73.
    18. Li Zhai & Xiangbin Yan & Bin Zhu, 2014. "The H l -index: improvement of H-index based on quality of citing papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1021-1031, February.
    19. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    20. Chen, Meiqian & Guo, Zhaoxia & Dong, Yucheng & Chiclana, Francisco & Herrera-Viedma, Enrique, 2021. "Citations optimal growth path: A tool to analyze sensitivity to citations of h-like indexes," Journal of Informetrics, Elsevier, vol. 15(4).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0637-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.