IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/dmsp9.html
   My bibliography  Save this paper

Scrambling for higher metrics in the Journal Impact Factor bubble period: a real-world problem in science management and its implications

Author

Listed:
  • Tran, Trung
  • Linh, Hoang Khanh
  • La, Viet-Phuong
  • Ho, Manh-Toan

    (Thanh Tay University Hanoi)

  • Vuong, Quan-Hoang

Abstract

Universities and funders in many countries have been using Journal Impact Factor (JIF) as an indicator for research and grant assessment despite its controversial nature as a statistical representation of scientific quality. This study investigates how the changes of JIF over the years can affect its role in research evaluation and science management by using JIF data from annual Journal Citation Reports (JCR) to illustrate the changes. The descriptive statistics find out an increase in the median JIF for the top 50 journals in the JCR, from 29.300 in 2017 to 33.162 in 2019. Moreover, on average, elite journal families have up to 27 journals in the top 50. In the group of journals with a JIF of lower than 1, the proportion has shrunk by 14.53% in the 2015–2019 period. The findings suggest a potential ‘JIF bubble period’ that science policymaker, university, public fund managers, and other stakeholders should pay more attention to JIF as a criterion for quality assessment to ensure more efficient science management.

Suggested Citation

  • Tran, Trung & Linh, Hoang Khanh & La, Viet-Phuong & Ho, Manh-Toan & Vuong, Quan-Hoang, 2020. "Scrambling for higher metrics in the Journal Impact Factor bubble period: a real-world problem in science management and its implications," OSF Preprints dmsp9, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:dmsp9
    DOI: 10.31219/osf.io/dmsp9
    as

    Download full text from publisher

    File URL: https://osf.io/download/5e410b9ef1369e02e28adb28/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/dmsp9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. John Tregoning, 2018. "How will you judge me if not by impact factor?," Nature, Nature, vol. 558(7710), pages 345-345, June.
    2. Anke Snoek, 2019. "Why publishing should be a pleasure, not a pressure," Nature Human Behaviour, Nature, vol. 3(10), pages 1032-1032, October.
    3. Shibayama, Sotaro & Baba, Yasunori, 2015. "Impact-oriented science policies and scientific publication practices: The case of life sciences in Japan," Research Policy, Elsevier, vol. 44(4), pages 936-950.
    4. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    5. Sornette, Didier & Cauwels, Peter, 2015. "Financial Bubbles: Mechanisms and Diagnostics," Review of Behavioral Economics, now publishers, vol. 2(3), pages 279-305, October.
    6. Mabiso, Athur & van Rheenen, Teunis & Ferguson, Jenna, 2013. "Organizational partnerships for food Policy research impact: A review of what works:," IFPRI discussion papers 1305, International Food Policy Research Institute (IFPRI).
    7. Maria Bordons & M. T. Fernández & Isabel Gómez, 2002. "Advantages and limitations in the use of impact factor measures for the assessment of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 195-206, February.
    8. Lutz Bornmann, 2011. "Mimicry in science?," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 173-177, January.
    9. Quan-Hoang Vuong, 2019. "Breaking barriers in publishing demands a proactive attitude," Nature Human Behaviour, Nature, vol. 3(10), pages 1034-1034, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. , Aisdl, 2020. "The rise of research on development economics in Vietnam: Analyses and implications for the public and policymakers from SSHPA 2008-2020 dataset," OSF Preprints 9nbyr, Center for Open Science.
    2. Salim Sazzed, 2021. "Association between the Rankings of Top Bioinformatics and Medical Informatics Journals and the Scholarly Reputations of Chief Editors," Publications, MDPI, vol. 9(3), pages 1-15, September.
    3. Ho, Manh-Toan, 2020. "The rise of research on development economics in Vietnam: Analyses and implications for the public and policymakers from SSHPA 2008-2020 dataset," Thesis Commons msy6e, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francisco González-Sala & Julia Osca-Lluch & Julia Haba-Osca, 2019. "Are journal and author self-citations a visibility strategy?," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1345-1364, June.
    2. Vuong, Quan-Hoang & Huyen, Nguyen Thanh Thanh & Pham, Thanh-Hang & Phuong, Luong Anh & Nguyen, Minh-Hoang, 2020. "Mapping the intellectual and conceptual structure of research on gender issues in the family business: A bibliometric review," OSF Preprints jgnrw, Center for Open Science.
    3. Ghaleb Alnahdi & Dimitris Anastasiou, 2020. "Recruitment Practices for Special Education Faculty: Implications for Saudi Universities," SAGE Open, , vol. 10(3), pages 21582440209, August.
    4. Bachar Fakhry & Christian Richter, 2018. "Does the Federal Constitutional Court Ruling Mean the German Financial Market is Efficient?," European Journal of Business Science and Technology, Mendel University in Brno, Faculty of Business and Economics, vol. 4(2), pages 111-125.
    5. Fiorenzo Franceschini & Maurizio Galetto & Domenico Maisano & Luca Mastrogiacomo, 2012. "The success-index: an alternative approach to the h-index for evaluating an individual’s research output," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 621-641, September.
    6. Spencer Wheatley & Didier Sornette & Tobias Huber & Max Reppen & Robert N. Gantner, 2018. "Are Bitcoin Bubbles Predictable? Combining a Generalized Metcalfe's Law and the LPPLS Model," Papers 1803.05663, arXiv.org.
    7. Geert Campenhout & Tom Caneghem & Steve Uytbergen, 2008. "A comparison of overall and sub-area journal influence: The case of the accounting literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 61-90, October.
    8. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2010. "Citations versus journal impact factor as proxy of quality: could the latter ever be preferable?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 821-833, September.
    9. Quan-Hoang Vuong & Tam-Tri Le & Viet-Phuong La & Huyen Thanh Thanh Nguyen & Manh-Toan Ho & Quy Khuc & Minh-Hoang Nguyen, 2022. "Covid-19 vaccines production and societal immunization under the serendipity-mindsponge-3D knowledge management theory and conceptual framework," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-12, December.
    10. Battiston, Pietro & Sacco, Pier Luigi & Stanca, Luca, 2022. "Cover effects on citations uncovered: Evidence from Nature," Journal of Informetrics, Elsevier, vol. 16(2).
    11. Rodrigo Costas & Thed N. Leeuwen & María Bordons, 2012. "Referencing patterns of individual researchers: Do top scientists rely on more extensive information sources?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2433-2450, December.
    12. Eliseo Reategui & Alause Pires & Michel Carniato & Sergio Roberto Kieling Franco, 2020. "Evaluation of Brazilian research output in education: confronting international and national contexts," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 427-444, October.
    13. Riza Demirer & David Gabauer & Rangan Gupta & Joshua Nielsen, 2023. "Gold-to-Platinum Price Ratio and the Predictability of Bubbles in Financial Markets," Working Papers 202317, University of Pretoria, Department of Economics.
    14. Ghabban, Fahad & Selamat, Ali & Ibrahim, Roliana, 2018. "New model for encouraging academic staff in Saudi universities to use IT for knowledge sharing to improve scholarly publication performance," Technology in Society, Elsevier, vol. 55(C), pages 92-99.
    15. Huyen Thanh T. Nguyen & Minh-Hoang Nguyen & Tam-Tri Le & Manh-Toan Ho & Quan-Hoang Vuong, 2021. "Open Access Publishing Probabilities Based on Gender and Authorship Structures in Vietnam," Publications, MDPI, vol. 9(4), pages 1-16, October.
    16. Salim Sazzed, 2021. "Association between the Rankings of Top Bioinformatics and Medical Informatics Journals and the Scholarly Reputations of Chief Editors," Publications, MDPI, vol. 9(3), pages 1-15, September.
    17. Fabian Scheidegger & Andre Briviba & Bruno S. Frey, 2023. "Behind the curtains of academic publishing: strategic responses of economists and business scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4765-4790, August.
    18. Elena Veretennik & Maria Yudkevich, 2023. "Inconsistent quality signals: evidence from the regional journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3675-3701, June.
    19. Nguyen, Minh-Hoang, 2021. "Lecture 1: Phân tích dữ liệu xã hội sử dụng BMF, MCMC và bayesvl với ngôn ngữ R," OSF Preprints s9rq7, Center for Open Science.
    20. José Alberto Molina & David Iñiguez & Gonzalo Ruiz & Alfonso Tarancón, 2021. "Leaders among the leaders in Economics: a network analysis of the Nobel Prize laureates," Applied Economics Letters, Taylor & Francis Journals, vol. 28(7), pages 584-589, April.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:dmsp9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.