IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v76y2008i2d10.1007_s11192-007-1924-4.html
   My bibliography  Save this article

An investigation into diabetes researcher’s perceptions of the Journal Impact Factor — reconsidering evaluating research

Author

Listed:
  • Eva M. Sønderstrup-Andersen

    (Roskilde Psychiatric Hospital Special Library
    Danish Library Agency, Copenhagen, H.C.)

  • Hans H. K. Sønderstrup-Andersen

    (National Research Centre for the Working Environment)

Abstract

Currently the Journal Impact Factors (JIF) attracts considerable attention as components in the evaluation of the quality of research in and between institutions. This paper reports on a questionnaire study of the publishing behaviour and researchers preferences for seeking new knowledge information and the possible influence of JIF on these variables. 54 Danish medical researchers active in the field of Diabetes research took part. We asked the researchers to prioritise a series of scientific journals with respect to which journals they prefer for publishing research and gaining new knowledge. In addition we requested the researchers to indicate whether or not the JIF of the prioritised journals has had any influence on these decisions. Furthermore we explored the perception of the researchers as to what degree the JIF could be considered a reliable, stable or objective measure for determining the scientific quality of journals. Moreover we asked the researchers to judge the applicability of JIF as a measure for doing research evaluations. One remarkable result is that app. 80% of the researchers share the opinion that JIF does indeed have an influence on which journals they would prefer for publishing. As such we found a statistically significant correlation between how the researchers ranked the journals and the JIF of the ranked journals. Another notable result is that no significant correlation exists between journals where the researchers actually have published papers and journals in which they would prefer to publish in the future measured by JIF. This could be taken as an indicator for the actual motivational influence on the publication behaviour of the researchers. That is, the impact factor actually works in our case. It seems that the researchers find it fair and reliable to use the Journal Impact Factor for research evaluation purposes.

Suggested Citation

  • Eva M. Sønderstrup-Andersen & Hans H. K. Sønderstrup-Andersen, 2008. "An investigation into diabetes researcher’s perceptions of the Journal Impact Factor — reconsidering evaluating research," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 391-406, August.
  • Handle: RePEc:spr:scient:v:76:y:2008:i:2:d:10.1007_s11192-007-1924-4
    DOI: 10.1007/s11192-007-1924-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-007-1924-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-007-1924-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gunther Maier, 2006. "Impact factors and peer judgment: The case of regional science journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(3), pages 651-667, December.
    2. Michael H. MacRoberts & Barbara R. MacRoberts, 1989. "Problems of citation analysis: A critical review," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 40(5), pages 342-349, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dangzhi Zhao & Elisabeth Logan, 2002. "Citation analysis using scientific publications on the Web as data source: A case study in the XML research area," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(3), pages 449-472, July.
    2. Ponomariov, Branco & Toivanen, Hannes, 2014. "Knowledge flows and bases in emerging economy innovation systems: Brazilian research 2005–2009," Research Policy, Elsevier, vol. 43(3), pages 588-596.
    3. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    4. Malcolm Wright & J. Scott Armstrong, 2008. "The Ombudsman: Verification of Citations: Fawlty Towers of Knowledge?," Interfaces, INFORMS, vol. 38(2), pages 125-139, April.
    5. T. J. Phelan, 1999. "A compendium of issues for citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 45(1), pages 117-136, May.
    6. Jianhua Hou, 2017. "Exploration into the evolution and historical roots of citation analysis by referenced publication year spectroscopy," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1437-1452, March.
    7. Peter Sjögårde & Fereshteh Didegah, 2022. "The association between topic growth and citation impact of research publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1903-1921, April.
    8. Mehmet Ali Köseoglu & John A. Parnell & Melissa Yan Yee Yick, 2021. "Identifying influential studies and maturity level in intellectual structure of fields: evidence from strategic management," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1271-1309, February.
    9. Рубинштейн Александр Яковлевич, "undated". "Ранжирование Российских Экономических Журналов: Научный Метод Или «Игра В Цыфирь»? [Ran Ranking of Russian Economic Journals: The Scientific Method or “Numbers Game”?]," Working papers a:pru175:ye:2016:1, Institute of Economics.
    10. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    11. Masaki Eto, 2013. "Evaluations of context-based co-citation searching," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 651-673, February.
    12. Martin Meyer, 2000. "What is Special about Patent Citations? Differences between Scientific and Patent Citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 49(1), pages 93-123, August.
    13. Li, Yunrong & Radicchi, Filippo & Castellano, Claudio & Ruiz-Castillo, Javier, 2013. "Quantitative evaluation of alternative field normalization procedures," Journal of Informetrics, Elsevier, vol. 7(3), pages 746-755.
    14. Petridis, Konstantinos & Malesios, Chrisovalantis & Arabatzis, Garyfallos & Thanassoulis, Emmanuel, 2013. "Efficiency analysis of forestry journals: Suggestions for improving journals’ quality," Journal of Informetrics, Elsevier, vol. 7(2), pages 505-521.
    15. Mike Thelwall & Kayvan Kousha & Meiko Makita & Mahshid Abdoli & Emma Stuart & Paul Wilson & Jonathan Levitt, 2023. "In which fields do higher impact journals publish higher quality articles?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3915-3933, July.
    16. repec:hig:journl:v:6:y:2012:i:1:p:38-58 is not listed on IDEAS
    17. Nelson, Andrew J., 2012. "Putting university research in context: Assessing alternative measures of production and diffusion at Stanford," Research Policy, Elsevier, vol. 41(4), pages 678-691.
    18. Wang, Guoyan & Hu, Guangyuan & Li, Chuanfeng & Tang, Li, 2018. "Long live the scientists: Tracking the scientific fame of great minds in physics," Journal of Informetrics, Elsevier, vol. 12(4), pages 1089-1098.
    19. Ronald N. Kostoff, 2002. "Citation analysis of research performer quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(1), pages 49-71, January.
    20. Joshua Aizenman & Kenneth Kletzer, 2011. "The life cycle of scholars and papers in economics - the 'citation death tax'," Applied Economics, Taylor & Francis Journals, vol. 43(27), pages 4135-4148.
    21. Steven M. Shugan, 2003. "Editorial: Journal Rankings: Save the Outlets for Your Research," Marketing Science, INFORMS, vol. 22(4), pages 437-441.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:76:y:2008:i:2:d:10.1007_s11192-007-1924-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.