IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v53y2002i2d10.1023_a1014800407876.html
   My bibliography  Save this article

Advantages and limitations in the use of impact factor measures for the assessment of research performance

Author

Listed:
  • Maria Bordons

    (Centro de Información y Documentación Científica (CINDOC-CSIC))

  • M. T. Fernández

    (Centro de Información y Documentación Científica (CINDOC-CSIC))

  • Isabel Gómez

    (Centro de Información y Documentación Científica (CINDOC-CSIC))

Abstract

Impact factor is a quasi-qualitative indicator, which provides a measurement of the prestige and international visibility of journals. Although the use of impact factor-based indicators for science policy purposes has increased over the last two decades, several limitations have been pointed out and should be borne in mind. The use of impact factor should be treated carefully when applied to the analysis of peripheral countries, whose national journals are hardly covered by ISI databases. Our experience in the use of impact factor based indicators for the analysis of the Spanish scientific production is shown. The usefulness of the impact factor measures in macro, meso and micro analyses is displayed. In addition, the main advantages, such as the great accessibility of impact factor and its ready-to-use nature are pointed out. Several limitations such as the need to avoid inter-field comparisons or the convenience of using a fixed journal set for international comparisons are also stressed. It is worth noting that the use of impact factor in the research evaluation process has influenced strongly the publication strategy of scientists.

Suggested Citation

  • Maria Bordons & M. T. Fernández & Isabel Gómez, 2002. "Advantages and limitations in the use of impact factor measures for the assessment of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 195-206, February.
    • Handle: RePEc:spr:scient:v:53:y:2002:i:2:d:10.1023_a:1014800407876
    DOI: 10.1023/A:1014800407876
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1023/A:1014800407876
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1023/A:1014800407876?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Per O Seglen, 1992. "How representative is the journal impact factor?," Research Evaluation, Oxford University Press, vol. 2(3), pages 143-149, December.
    2. Aline Solari & Marie-Helene Magri, 2000. "A New Approach to the SCI Journal Citation Reports, a System for Evaluating Scientific Journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(3), pages 605-625, March.
    3. Thed N. Van Leeuwen & Henk F. Moed & Robert J. W. Tijssen & Martijn S. Visser & Anthony F. J. Van Raan, 2001. "Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 335-346, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    2. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    3. Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    4. Li, Jiang & Qiao, Lili & Li, Wenyuze & Jin, Yidan, 2014. "Chinese-language articles are not biased in citations: Evidences from Chinese-English bilingual journals in Scopus and Web of Science," Journal of Informetrics, Elsevier, vol. 8(4), pages 912-916.
    5. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    6. Martín-Martín, Alberto & Orduna-Malea, Enrique & Thelwall, Mike & Delgado López-Cózar, Emilio, 2018. "Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories," Journal of Informetrics, Elsevier, vol. 12(4), pages 1160-1177.
    7. Gennaro Guida, 2018. "Italian Economics Departments’ Scientific Research Performance: Comparison between VQR and ASN Methodologies," International Journal of Business and Management, Canadian Center of Science and Education, vol. 13(9), pages 182-182, August.
    8. José María Gómez-Sancho & María Jesús Mancebón-Torrubia, 2009. "The evaluation of scientific production: Towards a neutral impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 435-458, November.
    9. Peder Olesen Larsen & Markus Ins, 2010. "The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 575-603, September.
    10. Franceschini, Fiorenzo & Maisano, Domenico, 2010. "The Hirsch spectrum: A novel tool for analyzing scientific journals," Journal of Informetrics, Elsevier, vol. 4(1), pages 64-73.
    11. Andreea Mironescu & Alina Moroșanu & Anca-Diana Bibiri, 2023. "The regional dynamics of multilingual publishing in web of science: A statistical analysis of central and eastern european journals and researchers in linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1133-1162, February.
    12. Ju-O Wang & Tzeng-Ji Chen & Senyeong Kao & Te-Chun Yeh & Li-Fang Chou & Shung-Tai Ho, 2012. "Scientific publications by anesthesia departments in East Asia," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 135-143, July.
    13. Kostoff, Ronald N., 2008. "Comparison of China/USA science and technology performance," Journal of Informetrics, Elsevier, vol. 2(4), pages 354-363.
    14. Johannes Stegmann & Guenter Grohmann, 2001. "Citation rates, knowledge export and international visibility of dermatology journals listed and not listed in theJournal Citation Reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(3), pages 483-502, March.
    15. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    16. Dehio, Jochen & Rothgang, Michael, 2017. "Indikatorikstudien – Fortentwicklung und optionale Untersuchungen: Hochschulbildung und -finanzierung," Studien zum deutschen Innovationssystem 10-2017, Expertenkommission Forschung und Innovation (EFI) - Commission of Experts for Research and Innovation, Berlin.
    17. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2010. "A comparison of the scientific performance of the U.S. and the European union at the turn of the 21st century," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 329-344, October.
    18. Rafols, Ismael & Stirling, Andy, 2020. "Designing indicators for opening up evaluation. Insights from research assessment," SocArXiv h2fxp, Center for Open Science.
    19. Vladimír Holý & Karel Šafr, 2018. "Are economically advanced countries more efficient in basic and applied research?," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 26(4), pages 933-950, December.
    20. Yongli Li & Guijie Zhang & Yuqiang Feng & Chong Wu, 2015. "An entropy-based social network community detecting method and its application to scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 1003-1017, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:53:y:2002:i:2:d:10.1023_a:1014800407876. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.