IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i1d10.1007_s11192-022-04520-5.html
   My bibliography  Save this article

Towards a new paradigm for ‘journal quality’ criteria: a scoping review

Author

Listed:
  • Mina Moradzadeh

    (Iran University of Medical Sciences
    Kerman University of Medical Sciences)

  • Shahram Sedghi

    (Iran University of Medical Sciences)

  • Sirous Panahi

    (Iran University of Medical Sciences)

Abstract

‘Journal quality’ is by nature, a dynamic and multidimensional concept that is influenced by many factors. So far, no studies have been conducted to examine the architecture of this concept in depth. The aim of this scoping review was to map out the current status of research in this broad area, identify as many ‘journal quality’ criteria as possible from the fragmented literature, and develop a conceptual framework for this concept. We used the six-stage scoping review framework developed by Arksey, O'Malley (2005), and Levac (2010). A total of 116 documents met the eligibility criteria and 203 ‘quality criteria’ were extracted. The identified ‘quality criteria’ were grouped into five themes: ethical, content structure and technical, scientific rigor, editorial structure, and promoting and indexing. Although this study found gaps in empirical research, it provides a valuable basis for future research in this field. Furthermore, it is a first step towards improving the transparency of ‘journal quality’ criteria in order to develop a ‘quality rating’ or ‘quality evaluation’ system.

Suggested Citation

  • Mina Moradzadeh & Shahram Sedghi & Sirous Panahi, 2023. "Towards a new paradigm for ‘journal quality’ criteria: a scoping review," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 279-321, January.
    • Handle: RePEc:spr:scient:v:128:y:2023:i:1:d:10.1007_s11192-022-04520-5
    DOI: 10.1007/s11192-022-04520-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-022-04520-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-022-04520-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pilar Valderrama & Manuel Escabias & Evaristo Jiménez-Contreras & Alberto Rodríguez-Archilla & Mariano J. Valderrama, 2018. "Proposal of a stochastic model to determine the bibliometric variables influencing the quality of a journal: application to the field of Dentistry," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1087-1095, May.
    2. Xin Gu & Karen Blackmore, 2017. "Characterisation of academic journals in the digital age," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1333-1350, March.
    3. Thomas Feliciani & Junwen Luo & Lai Ma & Pablo Lucas & Flaminio Squazzoni & Ana Marušić & Kalpana Shankar, 2019. "A scoping review of simulation models of peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 555-594, October.
    4. Erik Cobo & Albert Selva-O'Callagham & Josep-Maria Ribera & Francesc Cardellach & Ruth Dominguez & Miquel Vilardell, 2007. "Statistical Reviewers Improve Reporting in Biomedical Articles: A Randomized Trial," PLOS ONE, Public Library of Science, vol. 2(3), pages 1-8, March.
    5. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    6. Matherly, Michele & Shortridge, Rebecca Toppe, 2009. "A pragmatic model to estimate journal quality in accounting," Journal of Accounting Education, Elsevier, vol. 27(1), pages 14-29.
    7. Jaime A. Teixeira da Silva & Daniel J. Dunleavy & Mina Moradzadeh & Joshua Eykens, 2021. "A credit-like rating system to determine the legitimacy of scientific journals and publishers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8589-8616, October.
    8. Henk F. Moed, 2016. "Comprehensive indicator comparisons intelligible to non-experts: the case of two SNIP versions," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 51-65, January.
    9. E. Susanna Cahn, 2014. "Journal Rankings: Comparing Reputation, Citation and Acceptance Rates," International Journal of Information Systems in the Service Sector (IJISSS), IGI Global, vol. 6(4), pages 92-103, October.
    10. Yundong Xie & Qiang Wu & Xingchen Li, 2019. "Editorial team scholarly index (ETSI): an alternative indicator for evaluating academic journal reputation," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1333-1349, September.
    11. Sandra Miguel & Zaida Chinchilla‐Rodriguez & Félix de Moya‐Anegón, 2011. "Open access and Scopus: A new approach to scientific visibility from the standpoint of access," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(6), pages 1130-1145, June.
    12. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    13. Ann Forsyth, 2020. "Measuring Journal Success," Journal of the American Planning Association, Taylor & Francis Journals, vol. 86(4), pages 389-392, October.
    14. Han Zheng & Htet Htet Aung & Mojisola Erdt & Tai‐Quan Peng & Aravind Sesagiri Raamkumar & Yin‐Leng Theng, 2019. "Social media presence of scholarly journals," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 70(3), pages 256-270, March.
    15. Weishu Liu & Guangyuan Hu & Mengdi Gu, 2016. "The probability of publishing in first-quartile journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1273-1276, March.
    16. Antonio Ferrara & Andrea Bonaccorsi, 2016. "How robust is journal rating in Humanities and Social Sciences? Evidence from a large-scale, multi-method exercise," Research Evaluation, Oxford University Press, vol. 25(3), pages 279-291.
    17. Hui Fang, 2021. "Analysis of the new scopus CiteScore," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5321-5331, June.
    18. Kyle Siler, 2020. "Demarcating spectrums of predatory publishing: Economic and institutional sources of academic legitimacy," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(11), pages 1386-1401, November.
    19. Tharapos, Meredith & Marriott, Neil, 2020. "Beauty is in the eye of the beholder: Research quality in accounting education," The British Accounting Review, Elsevier, vol. 52(5).
    20. Jiayi Zhu & Ji Sun, 2019. "Conflicts of interest disclosure policies among Chinese medical journals: A cross-sectional study," PLOS ONE, Public Library of Science, vol. 14(7), pages 1-14, July.
    21. Sandra Miguel & Zaida Chinchilla-Rodriguez & Félix de Moya-Anegón, 2011. "Open access and Scopus: A new approach to scientific visibility from the standpoint of access," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(6), pages 1130-1145, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salim Sazzed, 2021. "Association between the Rankings of Top Bioinformatics and Medical Informatics Journals and the Scholarly Reputations of Chief Editors," Publications, MDPI, vol. 9(3), pages 1-15, September.
    2. Basile, Vincenzo & Sorooshian, Shahryar & Pizzichini, Lucia, 2024. "A scientometrics-based journal Management framework: A strategic move," Socio-Economic Planning Sciences, Elsevier, vol. 93(C).
    3. Sandra Miguel & Ely Francina Tannuri de Oliveira & Maria Cláudia Cabrini Grácio, 2016. "Scientific Production on Open Access: A Worldwide Bibliometric Analysis in the Academic and Scientific Context," Publications, MDPI, vol. 4(1), pages 1-15, January.
    4. Sergio Copiello, 2019. "The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lie," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 995-1018, November.
    5. Andrea Mervar & Maja Jokić, 2022. "Core-periphery nexus in the EU social sciences: bibliometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5793-5817, October.
    6. D’Este, Pablo & Robinson-García, Nicolás, 2023. "Interdisciplinary research and the societal visibility of science: The advantages of spanning multiple and distant scientific fields," Research Policy, Elsevier, vol. 52(2).
    7. Yuki Yamada & Jaime A. Teixeira da Silva, 2022. "A psychological perspective towards understanding the objective and subjective gray zones in predatory publishing," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4075-4087, December.
    8. Elías Sanz-Casado & Daniela Filippo & Rafael Aleixandre Benavent & Vidar Røeggen & Janne Pölönen, 2021. "Impact and visibility of Norwegian, Finnish and Spanish journals in the fields of humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9031-9049, November.
    9. Cenyu Shen, 2017. "Open Access Scholarly Journal Publishing in Chinese," Publications, MDPI, vol. 5(4), pages 1-17, September.
    10. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    11. Bornmann, Lutz & Williams, Richard, 2017. "Can the journal impact factor be used as a criterion for the selection of junior researchers? A large-scale empirical study based on ResearcherID data," Journal of Informetrics, Elsevier, vol. 11(3), pages 788-799.
    12. Amy Forrester, 2015. "Barriers to Open Access Publishing: Views from the Library Literature," Publications, MDPI, vol. 3(3), pages 1-21, September.
    13. Lin Feng & Jian Zhou & Sheng-Lan Liu & Ning Cai & Jie Yang, 2020. "Analysis of journal evaluation indicators: an experimental study based on unsupervised Laplacian score," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 233-254, July.
    14. Li Zhang & Erin Watson, 2018. "The prevalence of green and grey open access: Where do physical science researchers archive their publications?," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 2021-2035, December.
    15. Antonio Perianes-Rodríguez & Carlos Olmeda-Gómez, 2019. "Effects of journal choice on the visibility of scientific publications: a comparison between subscription-based and full Open Access models," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1737-1752, December.
    16. İlkay Unay-Gailhard & Mark A. Brennen, 2022. "How digital communications contribute to shaping the career paths of youth: a review study focused on farming as a career option," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(4), pages 1491-1508, December.
    17. Mahin Ghafari & Vali Baigi & Zahra Cheraghi & Amin Doosti-Irani, 2016. "The Prevalence of Asymptomatic Bacteriuria in Iranian Pregnant Women: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-10, June.
    18. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    19. Santos Urbina & Sofía Villatoro & Jesús Salinas, 2021. "Self-Regulated Learning and Technology-Enhanced Learning Environments in Higher Education: A Scoping Review," Sustainability, MDPI, vol. 13(13), pages 1-12, June.
    20. Bryce, Cormac & Dowling, Michael & Lucey, Brian, 2020. "The journal quality perception gap," Research Policy, Elsevier, vol. 49(5).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:1:d:10.1007_s11192-022-04520-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.