IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v92y2012i2d10.1007_s11192-012-0676-y.html
   My bibliography  Save this article

What do the scientists think about the impact factor?

Author

Listed:
  • Gualberto Buela-Casal

    (Universidad de Granada)

  • Izabela Zych

    (Universidad de Córdoba)

Abstract

The impact factor is a highly polemic metric. It was designed to help scientists in searching for bibliographic references for their own works, enabling communication among researchers and helping librarians in deciding which journal they should purchase. Nevertheless, it has soon become the most important measure of scientific performance applied to journals, articles, scientists, universities, etc. Since then, some researchers argue that it is a useless and flawed measure, while others defend its utility. The current study is the first survey on the opinion on the topic of a broad sample of scientists from all over the world. The questionnaire was answered by 1,704 researchers from 86 different countries, all the continents and all the UNESCO major fields of knowledge. The results show that the opinion is slightly above the median which could be understood as “neither positive nor negative”. Surprisingly, there is a negative correlation between the number of articles published by the respondents and their opinion on the impact factor.

Suggested Citation

  • Gualberto Buela-Casal & Izabela Zych, 2012. "What do the scientists think about the impact factor?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 281-292, August.
    • Handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0676-y
    DOI: 10.1007/s11192-012-0676-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-012-0676-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-012-0676-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lidia González & Juan Miguel Campanario, 2007. "Structure of the impact factor of journals included in the Social Sciences Citation Index: Citations from documents labeled “editorial material”," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(2), pages 252-262, January.
    2. Stephen J. Bensman, 2012. "The impact factor: its place in Garfield’s thought, in science evaluation, and in library collection management," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 263-275, August.
    3. Gualberto Buela-Casal & Pandelis Perakakis & Michael Taylor & Purificación Checa, 2006. "Measuring internationality: Reflections and perspectives on academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(1), pages 45-65, April.
    4. Aksnes, Dag W. & Rip, Arie, 2009. "Researchers' perceptions of citations," Research Policy, Elsevier, vol. 38(6), pages 895-905, July.
    5. Gualberto Buela-Casal & Pandelis Perakakis & Michael Taylor & Purificación Checa, 2006. "Measuring internationality: Reflections and perspectives on academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(1), pages 45-65, April.
    6. Dag W. Aksnes, 2006. "Citation rates and perceptions of scientific contribution," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(2), pages 169-185, January.
    7. Stephen J. Bensman, 2008. "Distributional differences of the impact factor in the sciences versus the social sciences: An analysis of the probabilistic structure of the 2005 journal citation reports," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(9), pages 1366-1382, July.
    8. James Hartley, 2012. "To cite or not to cite: author self-citations and the impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 313-317, August.
    9. Gualberto Buela-Casal & Izabela Zych & Ana Medina & María I. Viedma Del Jesus & Susana Lozano & Gloria Torres, 2009. "Analysis of the influence of the two types of the journal articles; theoretical and empirical on the impact factor of a journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 265-282, July.
    10. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francisco González-Sala & Julia Osca-Lluch & Julia Haba-Osca, 2019. "Information Resources: Differential Characteristics between Ibero-American and Dutch JCR Psychology Journals from 1998 to 2017," Resources, MDPI, vol. 8(2), pages 1-18, June.
    2. Csomós, György, 2020. "Introducing recalibrated academic performance indicators in the evaluation of individuals’ research performance: A case study from Eastern Europe," Journal of Informetrics, Elsevier, vol. 14(4).
    3. Juan Miguel Campanario & William Cabos, 2014. "The effect of additional citations in the stability of Journal Citation Report categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1113-1130, February.
    4. Simona Malovaná & Martin Hodula & Zuzana Gric, 2024. "Researching the Research: A Central Banking Edition," International Journal of Central Banking, International Journal of Central Banking, vol. 20(1), pages 263-323, February.
    5. David Urbano & Sebastian Aparicio & David Audretsch, 2019. "Twenty-five years of research on institutions, entrepreneurship, and economic growth: what has been learned?," Small Business Economics, Springer, vol. 53(1), pages 21-49, June.
    6. Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
    7. Pantea Kamrani & Isabelle Dorsch & Wolfgang G. Stock, 2021. "Do researchers know what the h-index is? And how do they estimate its importance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5489-5508, July.
    8. Gustavo Dambiski Gomes de Carvalho & Luis Mauricio Martins de Resende & Joseane Pontes & Hélio Gomes de Carvalho & Leozenir Mendes Betim, 2021. "Innovation and Management in MSMEs: A Literature Review of Highly Cited Papers," SAGE Open, , vol. 11(4), pages 21582440211, October.
    9. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    10. W. W. Koczkodaj & T. Kakiashvili & A. Szymańska & J. Montero-Marin & R. Araya & J. Garcia-Campayo & K. Rutkowski & D. Strzałka, 2017. "How to reduce the number of rating scale items without predictability loss?," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 581-593, May.
    11. Sergio Copiello, 2020. "The alleged citation advantage of video abstracts may be a matter of self-citations and self-selection bias. Comment on “The impact of video abstract on citation counts” by Zong et al," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 751-757, January.
    12. Gazni, Ali, 2020. "The growing number of patent citations to scientific papers: Changes in the world, nations, and fields," Technology in Society, Elsevier, vol. 62(C).
    13. Rogge, Jan-Christoph, 2015. "Soziale Bedingungen und Effekte der quantitativen Leistungsmessung: Ergebnisse einer Befragung von jungen Wissenschaftlerinnen und Wissenschaftlern," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 66(2), pages 205-214.
    14. Eugenio Petrovich, 2022. "Bibliometrics in Press. Representations and uses of bibliometric indicators in the Italian daily newspapers," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2195-2233, May.
    15. Rob Law & Daniel Leung, 2020. "Journal impact factor: A valid symbol of journal quality?," Tourism Economics, , vol. 26(5), pages 734-742, August.
    16. Andrei V. Grinëv & Daria S. Bylieva & Victoria V. Lobatyuk, 2021. "Russian University Teachers’ Perceptions of Scientometrics," Publications, MDPI, vol. 9(2), pages 1-16, May.
    17. de Carvalho, Gustavo Dambiski Gomes & Sokulski, Carla Cristiane & da Silva, Wesley Vieira & de Carvalho, Hélio Gomes & de Moura, Rafael Vignoli & de Francisco, Antonio Carlos & da Veiga, Claudimar Per, 2020. "Bibliometrics and systematic reviews: A comparison between the Proknow-C and the Methodi Ordinatio," Journal of Informetrics, Elsevier, vol. 14(3).
    18. Sangwal, Keshra, 2013. "Citation and impact factor distributions of scientific journals published in individual countries," Journal of Informetrics, Elsevier, vol. 7(2), pages 487-504.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Carvalho, Gustavo Dambiski Gomes & Sokulski, Carla Cristiane & da Silva, Wesley Vieira & de Carvalho, Hélio Gomes & de Moura, Rafael Vignoli & de Francisco, Antonio Carlos & da Veiga, Claudimar Per, 2020. "Bibliometrics and systematic reviews: A comparison between the Proknow-C and the Methodi Ordinatio," Journal of Informetrics, Elsevier, vol. 14(3).
    2. Hyeonchae Yang & Woo-Sung Jung, 2015. "A strategic management approach for Korean public research institutes based on bibliometric investigation," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(4), pages 1437-1464, July.
    3. Eugenio Petrovich, 2022. "Bibliometrics in Press. Representations and uses of bibliometric indicators in the Italian daily newspapers," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2195-2233, May.
    4. Mladen Andreis & Maja Jokić, 2008. "An impact of Croatian journals measured by citation analysis from SCI-expanded database in time span 1975–2001," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(2), pages 263-288, May.
    5. David A. Pendlebury & Jonathan Adams, 2012. "Comments on a critique of the Thomson Reuters journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 395-401, August.
    6. Pandelis Perakakis & Michael Taylor & Marco Mazza & Varvara Trachana, 2010. "Natural selection of academic papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 553-559, November.
    7. Chiang Kao, 2009. "The authorship and internationality of Industrial Engineering journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 123-136, October.
    8. Gustavo Dambiski Gomes de Carvalho & Luis Mauricio Martins de Resende & Joseane Pontes & Hélio Gomes de Carvalho & Leozenir Mendes Betim, 2021. "Innovation and Management in MSMEs: A Literature Review of Highly Cited Papers," SAGE Open, , vol. 11(4), pages 21582440211, October.
    9. Andrey Lovakov & Elena Agadullina, 2019. "Bibliometric analysis of publications from post-Soviet countries in psychological journals in 1992–2017," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1157-1171, May.
    10. András Schubert & Gábor Schubert, 2020. "Internationality at university level," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1341-1364, June.
    11. Jiancheng Guan & Xia Gao, 2008. "Comparison and evaluation of Chinese research performance in the field of bioinformatics," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(2), pages 357-379, May.
    12. Xin Gu & Karen L. Blackmore, 2016. "Recent trends in academic journal growth," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 693-716, August.
    13. Emanuel Kulczycki & Ewa A. Rozkosz, 2017. "Does an expert-based evaluation allow us to go beyond the Impact Factor? Experiences from building a ranking of national journals in Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 417-442, April.
    14. Sujin Choi, 2012. "Core-periphery, new clusters, or rising stars?: international scientific collaboration among ‘advanced’ countries in the era of globalization," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(1), pages 25-41, January.
    15. Michael Calver & Kate Bryant & Grant Wardell-Johnson, 2018. "Quantifying the internationality and multidisciplinarity of authors and journals using ecological statistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 731-748, May.
    16. Huang, Ding-wei, 2017. "Impact factor distribution revisited," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 482(C), pages 173-180.
    17. Chen, Kuan-Ming & Jen, Tsung-Hau & Wu, Margaret, 2014. "Estimating the accuracies of journal impact factor through bootstrap," Journal of Informetrics, Elsevier, vol. 8(1), pages 181-196.
    18. Dirce Maria Santin & Samile Andrea De Souza Vanz & Sonia Elisa Caregnato, 2016. "Internationality of Publications, Co-Authorship, References and Citations in Brazilian Evolutionary Biology," Publications, MDPI, vol. 4(1), pages 1-13, February.
    19. Ludo Waltman & Nees Jan Eck, 2013. "Source normalized indicators of citation impact: an overview of different approaches and an empirical comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 699-716, September.
    20. Carol Nash, 2023. "Roles and Responsibilities for Peer Reviewers of International Journals," Publications, MDPI, vol. 11(2), pages 1-24, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:92:y:2012:i:2:d:10.1007_s11192-012-0676-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.