IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v27y2018i3p284-284..html
   My bibliography  Save this article

To what extent is inclusion in the Web of Science an indicator of journal ‘quality’?

Author

Listed:
  • Diego Chavarro
  • Ismael Ràfols
  • Puay Tang

Abstract

The assessment of research based on the journal in which it is published is a widely adopted practice. Some research assessments use the Web of Science (WoS) to identify “high quality” journals, which are assumed to publish excellent research. The authority of WoS on journal quality stems from its selection of journals based on editorial standards and scientific impact criteria. These can be considered as universalistic criteria, meaning that they can be applied to any journal regardless of its place of publication, language, or discipline. In this article we examine the coverage by WoS of journals produced in Latin America, Spain, and Portugal. We use a logistic regression to examine the probability of a journal to be covered by WoS given universalistic criteria (editorial standards and scientific impact of the journal) and particularistic criteria (country, language, and discipline of the journal). We find that it is not possible to predict the inclusion of journals in WoS only through the univeralistic criteria because particularistic variables such as country of the journal, its discipline and language are also related to inclusion in WoS. We conclude that using WoS as a universalistic tool for research assessment can disadvantage science published in journals with adequate editorial standards and scientific merit. We discuss the implications of these findings within the research evaluation literature, specifically for countries and disciplines not extensively covered by WoS.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Diego Chavarro & Ismael Ràfols & Puay Tang, 2018. "To what extent is inclusion in the Web of Science an indicator of journal ‘quality’?," Research Evaluation, Oxford University Press, vol. 27(3), pages 284-284.
    • Handle: RePEc:oup:rseval:v:27:y:2018:i:3:p:284-284.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/reseval/rvy015
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Macdonald, Stuart & Kam, Jacqueline, 2010. "Counting footnotes: Citability in management studies," Scandinavian Journal of Management, Elsevier, vol. 26(2), pages 189-203, June.
    2. Anne‐Wil Harzing & Ron van der Wal, 2009. "A Google Scholar h‐index for journals: An alternative metric to measure journal impact in economics and business," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 41-46, January.
    3. Diana Hicks, 1999. "The difficulty of achieving full coverage of international social science literature and the bibliometric consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 44(2), pages 193-215, February.
    4. Éric Archambault & Étienne Vignola-Gagné & Grégoire Côté & Vincent Larivière & Yves Gingrasb, 2006. "Benchmarking scientific output in the social sciences and humanities: The limits of existing databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 329-342, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anna Severin & Nicola Low, 2019. "Readers beware! Predatory journals are infiltrating citation databases," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 64(8), pages 1123-1124, November.
    2. Alba Viana-Lora & Marta Gemma Nel-lo-Andreu, 2022. "Bibliometric analysis of trends in COVID-19 and tourism," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-8, December.
    3. David Doloreux & Jose Gaviria de la Puerta & Iker Pastor-López & Igone Porto Gómez & Borja Sanz & Jon Mikel Zabala-Iturriagagoitia, 2019. "Territorial innovation models: to be or not to be, that’s the question," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1163-1191, September.
    4. Diego Chavarro & Jaime Andrés Perez-Taborda & Alba Ávila, 2022. "Connecting brain and heart: artificial intelligence for sustainable development," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7041-7060, December.
    5. Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2175-2188, September.
    6. Václav Linkov & Kieran O’Doherty & Eunsoo Choi & Gyuseog Han, 2021. "Linguistic Diversity Index: A Scientometric Measure to Enhance the Relevance of Small and Minority Group Languages," SAGE Open, , vol. 11(2), pages 21582440211, April.
    7. Valentina Della Corte & Giovanna Del Gaudio & Fabiana Sepe & Simone Luongo, 2021. "Destination Resilience and Innovation for Advanced Sustainable Tourism Management: A Bibliometric Analysis," Sustainability, MDPI, vol. 13(22), pages 1-19, November.
    8. Pablo Suazo & Alba Viana-Lora, 2022. "The Contribution of Mycological Tourism to Well-Being, the Economy and Sustainable Development," IJERPH, MDPI, vol. 19(24), pages 1-12, December.
    9. Simone Carmine & Valentina De Marchi, 2023. "Reviewing Paradox Theory in Corporate Sustainability Toward a Systems Perspective," Journal of Business Ethics, Springer, vol. 184(1), pages 139-158, April.
    10. Roberta Ruggieri & Fabrizio Pecoraro & Daniela Luzi, 2021. "An intersectional approach to analyse gender productivity and open access: a bibliometric analysis of the Italian National Research Council," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1647-1673, February.
    11. Raf Vanderstraeten & Frédéric Vandermoere, 2021. "Inequalities in the growth of Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8635-8651, October.
    12. Martín-Martín, Alberto & Orduna-Malea, Enrique & Thelwall, Mike & Delgado López-Cózar, Emilio, 2018. "Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories," Journal of Informetrics, Elsevier, vol. 12(4), pages 1160-1177.
    13. Zhenhua Chen & Laurie A. Schintler, 2023. "Rediscovering regional science: Positioning the field's evolving location in science and society," Journal of Regional Science, Wiley Blackwell, vol. 63(3), pages 617-642, June.
    14. Khomeshwaree Mootoosamy & Vahid Aryadoust, 2024. "Transitioning from Communicative Competence to Multimodal and Intercultural Competencies: A Systematic Review," Societies, MDPI, vol. 14(7), pages 1-26, July.
    15. Christensen, Mark & Fahlevi, Heru & Indriani, Mirna & Syukur, Muhammad, 2024. "Deciding to be ignored: Why accounting scholars use dubious quality research outlets in a neocolonial context," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 99(C).
    16. Elena Veretennik & Maria Yudkevich, 2023. "Inconsistent quality signals: evidence from the regional journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3675-3701, June.
    17. V. Hernández-González & A. Pano-Rodríguez & J. Reverter-Masia, 2020. "Spanish doctoral theses in physical activity and sports sciences and authors’ scientific publications (LUSTRUM 2013–2017)," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 661-679, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    2. Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
    3. Sándor Soós & Zsófia Vida & András Schubert, 2018. "Long-term trends in the multidisciplinarity of some typical natural and social sciences, and its implications on the SSH versus STM distinction," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 795-822, March.
    4. Emanuel Kulczycki & Władysław Marek Kolasa & Krystian Szadkowski, 2021. "Marx, Engels, Lenin, and Stalin as highly cited researchers? Historical bibliometrics study," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8683-8700, October.
    5. Abramo, Giovanni & D'Angelo, CiriacoAndrea & Di Costa, Flavia, 2024. "The moderating role of personal characteristics of authors in the publications’ quality for quantity trade-off," Journal of Informetrics, Elsevier, vol. 18(1).
    6. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2019. "A gender analysis of top scientists’ collaboration behavior: evidence from Italy," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 405-418, August.
    7. Melissa Xiaohui Qin, 2024. "A systematic synthesis and analysis of English-language Shuōwén scholarship," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    8. Maite Barrios & Angel Borrego & Andreu Vilaginés & Candela Ollé & Marta Somoza, 2008. "A bibliometric study of psychological research on tourism," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(3), pages 453-467, December.
    9. Kousha, Kayvan & Thelwall, Mike, 2018. "Can Microsoft Academic help to assess the citation impact of academic books?," Journal of Informetrics, Elsevier, vol. 12(3), pages 972-984.
    10. Ekaterina Dyachenko, 2013. "Internationalization of academic journals: is there still a gap between social and natural sciences?," HSE Working papers WP BRP 28/HUM/2013, National Research University Higher School of Economics.
    11. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    12. Thelwall, Mike, 2016. "The discretised lognormal and hooked power law distributions for complete citation data: Best options for modelling and regression," Journal of Informetrics, Elsevier, vol. 10(2), pages 336-346.
    13. Yang, Siluo & Zheng, Mengxue & Yu, Yonghao & Wolfram, Dietmar, 2021. "Are Altmetric.com scores effective for research impact evaluation in the social sciences and humanities?," Journal of Informetrics, Elsevier, vol. 15(1).
    14. Daniel Torres-Salinas & Wenceslao Arroyo-Machado & Mike Thelwall, 2021. "Exploring WorldCat identities as an altmetric information source: a library catalog analysis experiment in the field of Scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1725-1743, February.
    15. Vanessa Sandoval-Romero & Vincent Larivière, 2020. "The national system of researchers in Mexico: implications of publication incentives for researchers in social sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 99-126, January.
    16. Andrea Mervar & Maja Jokić, 2022. "Core-periphery nexus in the EU social sciences: bibliometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5793-5817, October.
    17. Ekaterina L. Dyachenko, 2014. "Internationalization of academic journals: Is there still a gap between social and natural sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 241-255, October.
    18. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    19. Andrea Diem & Stefan C. Wolter, 2011. "The Use of Bibliometrics to Measure Research Performance in Education Sciences," Economics of Education Working Paper Series 0066, University of Zurich, Department of Business Administration (IBW), revised May 2013.
    20. Müller, Harry & Dilger, Alexander, 2013. "Der Einfluss des Forschungsschwerpunkts auf den Zitationserfolg: Eine empirische Untersuchung anhand der Gesamtpublikationen deutschsprachiger Hochschullehrer für BWL," Discussion Papers of the Institute for Organisational Economics 1/2013, University of Münster, Institute for Organisational Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:27:y:2018:i:3:p:284-284.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/rev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.