IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i10d10.1007_s11192-023-04809-z.html
   My bibliography  Save this article

So, what if a journal is both at the ‘top’ and ‘bottom’: reply to Mason and Singh

Author

Listed:
  • Jeremiah Joven Joaquin

    (De La Salle University)

  • Raymond R. Tan

    (De La Salle University
    De La Salle University)

  • Hazel T. Biana

    (De La Salle University)

Abstract

In a recent paper in this journal, Mason and Singh (Scientometrics 127:3683–3694, 2022) argue that since there are cases where a research paper is published in an academic journal that is ‘top-ranked’ in one subject category (or research area) but ‘bottom-ranked’ in another (based on some citation-based metric such as SCImago Journal Rankings (SJR) or Journal Citation Reports (JCR)), it follows that it is illogical to use such rankings as a proxy for research quality, impact, and prestige. They conclude that using such rankings for academic hiring, tenure, promotion, and funding is likewise illogical. In this discussion note, we argue that while their premise is true, their conclusion is a non sequitur.

Suggested Citation

  • Jeremiah Joven Joaquin & Raymond R. Tan & Hazel T. Biana, 2023. "So, what if a journal is both at the ‘top’ and ‘bottom’: reply to Mason and Singh," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5859-5863, October.
    • Handle: RePEc:spr:scient:v:128:y:2023:i:10:d:10.1007_s11192-023-04809-z
    DOI: 10.1007/s11192-023-04809-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04809-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-023-04809-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Meredith T Niles & Lesley A Schimanski & Erin C McKiernan & Juan Pablo Alperin, 2020. "Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-15, March.
    2. Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2012. "A further step forward in measuring journals’ scientific prestige: The SJR2 indicator," Journal of Informetrics, Elsevier, vol. 6(4), pages 674-688.
    3. Mason, Shannon & Merga, Margaret K. & González Canché, Manuel S. & Mat Roni, Saiyidi, 2021. "The internationality of published higher education scholarship: How do the ‘top’ journals compare?," Journal of Informetrics, Elsevier, vol. 15(2).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Orhan, Mehmet A. & van Rossenberg, Yvonne & Bal, P. Matthijs, 2024. "Authorship inequality and elite dominance in management and organizational research: A review of six decades," OSF Preprints tzx92, Center for Open Science.
    2. Shannon Mason & Lenandlar Singh, 2022. "When a journal is both at the ‘top’ and the ‘bottom’: the illogicality of conflating citation-based metrics with quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3683-3694, June.
    3. Bornmann, Lutz & Leydesdorff, Loet & Wang, Jian, 2014. "How to improve the prediction based on citation impact percentiles for years shortly after the publication date?," Journal of Informetrics, Elsevier, vol. 8(1), pages 175-180.
    4. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    5. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    6. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    7. Zoltán Krajcsák, 2021. "Researcher Performance in Scopus Articles ( RPSA ) as a New Scientometric Model of Scientific Output: Tested in Business Area of V4 Countries," Publications, MDPI, vol. 9(4), pages 1-23, October.
    8. Verónica Amarante & Marisa Bucheli & Mariana Rodriguez, 2024. "Research Networks and Publications in Economics: Evidence from a Small Developing Country," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 5571-5598, June.
    9. Judit Bar-Ilan & Mark Levene, 2015. "The hw-rank: an h-index variant for ranking web pages," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2247-2253, March.
    10. Félix Moya-Anegón & Vicente P. Guerrero-Bote & Lutz Bornmann & Henk F. Moed, 2013. "The research guarantors of scientific papers and the output counting: a promising new approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 421-434, November.
    11. Chang, Yu-Wei, 2022. "Capability of non-English-speaking countries for securing a foothold in international journal publishing," Journal of Informetrics, Elsevier, vol. 16(3).
    12. Jun Zhang & Xiaoyan Su & Yifei Wang, 2024. "A Qualitative Study on the Relationship between Faculty Mobility and Scientific Impact: Toward the Sustainable Development of Higher Education," Sustainability, MDPI, vol. 16(17), pages 1-18, September.
    13. Najko Jahn & Lisa Matthias & Mikael Laakso, 2022. "Toward transparency of hybrid open access through publisher‐provided metadata: An article‐level study of Elsevier," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(1), pages 104-118, January.
    14. Zhang, Fang & Wu, Shengli, 2020. "Predicting future influence of papers, researchers, and venues in a dynamic academic network," Journal of Informetrics, Elsevier, vol. 14(2).
    15. Currie, Russell R. & Pandher, Gurupdesh S., 2020. "Finance journal rankings: Active scholar assessment revisited," Journal of Banking & Finance, Elsevier, vol. 111(C).
    16. Asier Minondo, 2022. "Comments are welcome," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1565-1582, March.
    17. Cristina López-Duarte & Marta M. Vidal-Suárez & Belén González-Díaz & Nuno Rosa Reis, 2016. "Understanding the relevance of national culture in international business research: a quantitative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1553-1590, September.
    18. Tony Ross-Hellauer & Thomas Klebel & Petr Knoth & Nancy Pontika, 2024. "Value dissonance in research(er) assessment: individual and perceived institutional priorities in review, promotion, and tenure," Science and Public Policy, Oxford University Press, vol. 51(3), pages 337-351.
    19. Nicky Agate & Rebecca Kennison & Stacy Konkiel & Christopher P. Long & Jason Rhody & Simone Sacchi & Penelope Weber, 2020. "The transformative power of values-enacted scholarship," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-12, December.
    20. CholMyong Pak & Guang Yu & Weibin Wang, 2018. "A study on the citation situation within the citing paper: citation distribution of references according to mention frequency," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 905-918, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:10:d:10.1007_s11192-023-04809-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.