IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0224541.html
   My bibliography  Save this article

Identifying publications in questionable journals in the context of performance-based research funding

Author

Listed:
  • Joshua Eykens
  • Raf Guns
  • A I M Jakaria Rahman
  • Tim C E Engels

Abstract

In this article we discuss the five yearly screenings for publications in questionable journals which have been carried out in the context of the performance-based research funding model in Flanders, Belgium. The Flemish funding model expanded from 2010 onwards, with a comprehensive bibliographic database for research output in the social sciences and humanities. Along with an overview of the procedures followed during the screenings for articles in questionable journals submitted for inclusion in this database, we present a bibliographic analysis of the publications identified. First, we show how the yearly number of publications in questionable journals has evolved over the period 2003–2016. Second, we present a disciplinary classification of the identified journals. In the third part of the results section, three authorship characteristics are discussed: multi-authorship, the seniority–or experience level–of authors in general and of the first author in particular, and the relation of the disciplinary scope of the journal (cognitive classification) with the departmental affiliation of the authors (organizational classification). Our results regarding yearly rates of publications in questionable journals indicate that awareness of the risks of questionable journals does not lead to a turn away from open access in general. The number of publications in open access journals rises every year, while the number of publications in questionable journals decreases from 2012 onwards. We find further that both early career and more senior researchers publish in questionable journals. We show that the average proportion of senior authors contributing to publications in questionable journals is somewhat higher than that for publications in open access journals. In addition, this paper yields insight into the extent to which publications in questionable journals pose a threat to the public and political legitimacy of a performance-based research funding system of a western European region. We include concrete suggestions for those tasked with maintaining bibliographic databases and screening for publications in questionable journals.

Suggested Citation

  • Joshua Eykens & Raf Guns & A I M Jakaria Rahman & Tim C E Engels, 2019. "Identifying publications in questionable journals in the context of performance-based research funding," PLOS ONE, Public Library of Science, vol. 14(11), pages 1-19, November.
    • Handle: RePEc:plo:pone00:0224541
    DOI: 10.1371/journal.pone.0224541
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0224541
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0224541&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0224541?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Frederick H. Wallace & Timothy J. Perri, 2018. "Economists behaving badly: publications in predatory journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 749-766, May.
    2. Linda Sīle & Janne Pölönen & Gunnar Sivertsen & Raf Guns & Tim C E Engels & Pavel Arefiev & Marta Dušková & Lotte Faurbæk & András Holl & Emanuel Kulczycki & Bojan Macan & Gustaf Nelhans & Michal Petr, 2018. "Comprehensiveness of national bibliographic databases for social sciences and humanities: Findings from a European survey," Research Evaluation, Oxford University Press, vol. 27(4), pages 310-322.
    3. Declan Butler, 2013. "Investigating journals: The dark side of publishing," Nature, Nature, vol. 495(7442), pages 433-435, March.
    4. Tove Faber Frandsen, 2017. "Are predatory journals undermining the credibility of science? A bibliometric analysis of citers," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1513-1528, December.
    5. Raf Guns & Linda Sīle & Joshua Eykens & Frederik T. Verleysen & Tim C. E. Engels, 2018. "A comparison of cognitive and organizational classification of publications in the social sciences and humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 1093-1111, August.
    6. Mollie Bloudoff-Indelicato, 2015. "Backlash after Frontiers journals added to list of questionable publishers," Nature, Nature, vol. 526(7575), pages 613-613, October.
    7. Kaare Aagaard, 2015. "How incentives trickle down: Local use of a national bibliometric indicator system," Science and Public Policy, Oxford University Press, vol. 42(5), pages 725-737.
    8. Demir, Selcuk Besir, 2018. "Predatory journals: Who publishes in them and why?," Journal of Informetrics, Elsevier, vol. 12(4), pages 1296-1311.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jaime A. Teixeira da Silva & Daniel J. Dunleavy & Mina Moradzadeh & Joshua Eykens, 2021. "A credit-like rating system to determine the legitimacy of scientific journals and publishers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8589-8616, October.
    2. Emanuel Kulczycki & Marek Hołowiecki & Zehra Taşkın & Franciszek Krawczyk, 2021. "Citation patterns between impact-factor and questionable journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8541-8560, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vít Macháček & Martin Srholec, 2021. "RETRACTED ARTICLE: Predatory publishing in Scopus: evidence on cross-country differences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 1897-1921, March.
    2. Salim Moussa, 2021. "Citation contagion: a citation analysis of selected predatory marketing journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 485-506, January.
    3. Emanuel Kulczycki & Marek Hołowiecki & Zehra Taşkın & Franciszek Krawczyk, 2021. "Citation patterns between impact-factor and questionable journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8541-8560, October.
    4. Kyle Siler, 2020. "Demarcating spectrums of predatory publishing: Economic and institutional sources of academic legitimacy," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(11), pages 1386-1401, November.
    5. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    6. Libor Ansorge, 2023. "The right to reject an unwanted citations: do we need it?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 4147-4150, July.
    7. Emanuel Kulczycki & Raf Guns & Janne Pölönen & Tim C. E. Engels & Ewa A. Rozkosz & Alesia A. Zuccala & Kasper Bruun & Olli Eskola & Andreja Istenič Starčič & Michal Petr & Gunnar Sivertsen, 2020. "Multilingual publishing in the social sciences and humanities: A seven‐country European study," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(11), pages 1371-1385, November.
    8. Marcelo S. Perlin & Takeyoshi Imasato & Denis Borenstein, 2018. "Is predatory publishing a real threat? Evidence from a large database study," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 255-273, July.
    9. Vîiu, Gabriel-Alexandru, 2016. "A theoretical evaluation of Hirsch-type bibliometric indicators confronted with extreme self-citation," Journal of Informetrics, Elsevier, vol. 10(2), pages 552-566.
    10. Liu, Xiaojuan & Wang, Chenlin & Chen, Dar-Zen & Huang, Mu-Hsuan, 2022. "Exploring perception of retraction based on mentioned status in post-retraction citations," Journal of Informetrics, Elsevier, vol. 16(3).
    11. You, Taekho & Park, Jinseo & Lee, June Young & Yun, Jinhyuk & Jung, Woo-Sung, 2022. "Disturbance of questionable publishing to academia," Journal of Informetrics, Elsevier, vol. 16(2).
    12. Mohamed Boufarss & Mikael Laakso, 2020. "Open Sesame? Open access priorities, incentives, and policies among higher education institutions in the United Arab Emirates," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1553-1577, August.
    13. Yuxian Liu & Yishan Wu & Sandra Rousseau & Ronald Rousseau, 2020. "Reflections on and a short review of the science of team science," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 937-950, November.
    14. Elizabeth Troncoso & Daniel A. López & René Ruby-Figueroa & Dieter Koch & Ricardo Reich, 2024. "Does Quality Matter? Quality Assurance in Research for the Chilean Higher Education System," Publications, MDPI, vol. 12(1), pages 1-20, February.
    15. Altug YALCINTAS, 2020. "Why is economics not part of a system of scientific ethics? A review essay on Wilfred Dolfsma and Ioana Negru’s The Ethical Formation of Economists," The Journal of Philosophical Economics, Bucharest Academy of Economic Studies, The Journal of Philosophical Economics, vol. 13(2), pages 202-214, November.
    16. Mauricio Marrone, 2020. "Application of entity linking to identify research fronts and trends," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 357-379, January.
    17. Martina K Linnenluecke & Mauricio Marrone & Abhay K Singh, 2020. "Conducting systematic literature reviews and bibliometric analyses," Australian Journal of Management, Australian School of Business, vol. 45(2), pages 175-194, May.
    18. Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
    19. Demir, Selcuk Besir, 2018. "Predatory journals: Who publishes in them and why?," Journal of Informetrics, Elsevier, vol. 12(4), pages 1296-1311.
    20. Jaime A. Teixeira da Silva & Daniel J. Dunleavy & Mina Moradzadeh & Joshua Eykens, 2021. "A credit-like rating system to determine the legitimacy of scientific journals and publishers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8589-8616, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0224541. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.