IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v97y2013i2d10.1007_s11192-013-0992-x.html
   My bibliography  Save this article

Is there a correlation between journal impact factor and researchers’ performance? A study comprising the fields of clinical nephrology and neurosciences

Author

Listed:
  • Eduardo Araujo Oliveira

    (Federal University of Minas Gerais (UFMG)
    Rua Engenheiro Amaro Lanari)

  • Roberto Peicots-Filho

    (Pontífícia Universidade Católica (PUC, Curitiba))

  • Daniella Reis Martelli

    (Universidade Estadual de Montes Claros)

  • Isabel Gomes Quirino

    (Federal University of Minas Gerais (UFMG))

  • Maria Christina Lopes Oliveira

    (Federal University of Minas Gerais (UFMG))

  • Mariana Guerra Duarte

    (Federal University of Minas Gerais (UFMG))

  • Sergio Veloso Pinheiro

    (Federal University of Minas Gerais (UFMG))

  • Enrico Antonio Colosimo

    (Federal University of Minas Gerais (UFMG))

  • Ana Cristina Simões e Silva

    (Federal University of Minas Gerais (UFMG))

  • Hercílio Martelli-Júnior

    (Universidade Estadual de Montes Claros)

Abstract

Quantifying the scientific performance of investigators has become an integral part of decision-making in research policy. The aim of the present study was to evaluate if there is a correlation between journal impact factor (IF) and researchers’ influence among a selected group of Brazilian investigators in the fields of clinical nephrology and neurosciences. This study was based on 94 senior investigators (36 in clinical nephrology and 58 in clinical neurosciences) receiving productivity scholarships from the Brazilian Council for Scientific and Technological Development (CNPq) according to a list provided by the agency in February 2009. Scientific performance indicators included in the analysis were: number of papers indexed by the Web of Science and Scopus databases, number of citations, h- and m-index. IFs were analyzed as (1) cumulative IF (∑IF), (2) IF adjusted by time (IF/t), and (3) average IF. There was a moderate positive correlation only between ∑IF and two indicators: total number of citations (P

Suggested Citation

  • Eduardo Araujo Oliveira & Roberto Peicots-Filho & Daniella Reis Martelli & Isabel Gomes Quirino & Maria Christina Lopes Oliveira & Mariana Guerra Duarte & Sergio Veloso Pinheiro & Enrico Antonio Colos, 2013. "Is there a correlation between journal impact factor and researchers’ performance? A study comprising the fields of clinical nephrology and neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 149-160, November.
    • Handle: RePEc:spr:scient:v:97:y:2013:i:2:d:10.1007_s11192-013-0992-x
    DOI: 10.1007/s11192-013-0992-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-013-0992-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-013-0992-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Per O. Seglen, 1994. "Causal relationship between article citedness and journal impact," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 45(1), pages 1-11, January.
    2. Alexandru T. Balaban, 2012. "Positive and negative aspects of citation indices and journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 241-247, August.
    3. John Panaretos & Chrisovaladis Malesios, 2009. "Assessing scientific research performance and impact with single indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 635-670, December.
    4. Michel Zitt, 2012. "The journal impact factor: angel, devil, or scapegoat? A comment on J.K. Vanclay’s article 2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 485-503, August.
    5. Lutz Bornmann & Gerlind Wallon & Anna Ledin, 2008. "Is the h index related to (standard) bibliometric measures and to the assessments by peers? An investigation of the h index by using molecular life sciences data," Research Evaluation, Oxford University Press, vol. 17(2), pages 149-156, June.
    6. Fiorenzo Franceschini & Domenico Maisano, 2011. "Proposals for evaluating the regularity of a scientist’s research output," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 279-295, July.
    7. Sotaro Shibayama, 2011. "Distribution of academic research funds: a case of Japanese national research grant," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 43-60, July.
    8. Sune Lehmann & Andrew D. Jackson & Benny E. Lautrup, 2006. "Measures for measures," Nature, Nature, vol. 444(7122), pages 1003-1004, December.
    9. Sebastian K. Boell & Concepción S. Wilson, 2010. "Journal Impact Factors for evaluating scientific performance: use of h-like indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 613-626, March.
    10. Maria Bordons & M. T. Fernández & Isabel Gómez, 2002. "Advantages and limitations in the use of impact factor measures for the assessment of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 195-206, February.
    11. Thed Leeuwen, 2012. "Discussing some basic critique on Journal Impact Factors: revision of earlier comments," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 443-455, August.
    12. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2011. "National research assessment exercises: the effects of changing the rules of the game during the game," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 229-238, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhiwei Zhou & Rui Xing & Jing Liu & Feiyue Xing, 2014. "Landmark papers written by the Nobelists in physics from 1901 to 2012: a bibliometric analysis of their citations and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 329-338, August.
    2. Deise Deolindo Silva & Maria Cláudia Cabrini Grácio, 2021. "Dispersion measures for h-index: a study of the Brazilian researchers in the field of mathematics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 1983-2011, March.
    3. Myrto-Panagiota Zacharof & Anna Charalambidou, 2018. "An Exploration of the Sub-Register of Chemical Engineering Research Papers Published in English," Publications, MDPI, vol. 6(3), pages 1-19, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eduardo A. Oliveira & Enrico A. Colosimo & Daniella R. Martelli & Isabel G. Quirino & Maria Christina L. Oliveira & Leonardo S. Lima & Ana Cristina Simões e Silva & Hercílio Martelli-Júnior, 2012. "Comparison of Brazilian researchers in clinical medicine: are criteria for ranking well-adjusted?," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 429-443, February.
    2. Zhiwei Zhou & Rui Xing & Jing Liu & Feiyue Xing, 2014. "Landmark papers written by the Nobelists in physics from 1901 to 2012: a bibliometric analysis of their citations and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 329-338, August.
    3. Bornmann, Lutz & Mutz, Rüdiger & Daniel, Hans-Dieter, 2010. "The h index research output measurement: Two approaches to enhance its accuracy," Journal of Informetrics, Elsevier, vol. 4(3), pages 407-414.
    4. Finardi, Ugo, 2013. "Correlation between Journal Impact Factor and Citation Performance: An experimental study," Journal of Informetrics, Elsevier, vol. 7(2), pages 357-370.
    5. Walters, William H., 2014. "Do Article Influence scores overestimate the citation impact of social science journals in subfields that are related to higher-impact natural science disciplines?," Journal of Informetrics, Elsevier, vol. 8(2), pages 421-430.
    6. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.
    7. Antonia Ferrer-Sapena & Susana Díaz-Novillo & Enrique A. Sánchez-Pérez, 2017. "Measuring Time-Dynamics and Time-Stability of Journal Rankings in Mathematics and Physics by Means of Fractional p -Variations," Publications, MDPI, vol. 5(3), pages 1-14, September.
    8. Muzammil Tahira & Rose Alinda Alias & Aryati Bakri, 2013. "Scientometric assessment of engineering in Malaysians universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 865-879, September.
    9. Carmen Anton & Nelu Florea & Silviu-Mihail Tiþã, 2012. "Comparison Of Scientific Socio-Economic Research Performances In Eastern European Universities," CES Working Papers, Centre for European Studies, Alexandru Ioan Cuza University, vol. 4(4), pages 636-647, December.
    10. Glenn Ellison, 2013. "How Does the Market Use Citation Data? The Hirsch Index in Economics," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 63-90, July.
    11. Sebastian K. Boell & Concepción S. Wilson, 2010. "Journal Impact Factors for evaluating scientific performance: use of h-like indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 613-626, March.
    12. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    13. Thelwall, Mike & Fairclough, Ruth, 2015. "Geometric journal impact factors correcting for individual highly cited articles," Journal of Informetrics, Elsevier, vol. 9(2), pages 263-272.
    14. Benda, Wim G.G. & Engels, Tim C.E., 2011. "The predictive validity of peer review: A selective review of the judgmental forecasting qualities of peers, and implications for innovation in science," International Journal of Forecasting, Elsevier, vol. 27(1), pages 166-182.
    15. Lin Zhu & Donghua Zhu & Xuefeng Wang & Scott W. Cunningham & Zhinan Wang, 2019. "An integrated solution for detecting rising technology stars in co-inventor networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 137-172, October.
    16. Sangwal, Keshra, 2013. "Citation and impact factor distributions of scientific journals published in individual countries," Journal of Informetrics, Elsevier, vol. 7(2), pages 487-504.
    17. Benda, Wim G.G. & Engels, Tim C.E., 2011. "The predictive validity of peer review: A selective review of the judgmental forecasting qualities of peers, and implications for innovation in science," International Journal of Forecasting, Elsevier, vol. 27(1), pages 166-182, January.
    18. John Panaretos & Chrisovaladis Malesios, 2009. "Assessing scientific research performance and impact with single indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 635-670, December.
    19. Péter Vinkler, 2011. "Application of the distribution of citations among publications in scientometric evaluations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(10), pages 1963-1978, October.
    20. repec:jes:wpaper:y:2012:v:4:p:636-647 is not listed on IDEAS
    21. Zeki Simsek & Ciaran Heavey & Justin J. P. Jansen, 2013. "Journal Impact as a Diffusion Process: A Conceptualization and the Case of the Journal of Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 50(8), pages 1374-1407, December.

    More about this item

    Keywords

    Scientific publication indicators; Clinical medicine; Impact factor; h-Index; Scopus;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:97:y:2013:i:2:d:10.1007_s11192-013-0992-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.