IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/3kf9d_v1.html
   My bibliography  Save this paper

Under-reporting research relevant to local needs in the global south. Database biases in the representation of knowledge on rice

Author

Listed:
  • Rafols, Ismael
  • Ciarli, Tommaso
  • Chavarro, Diego

Abstract

Although the main bibliometric databases (Web of Science (WoS) and Scopus) claim to include journals on the basis of scientific and publication standards, there have long been concerns that its coverage is biased in favour of journals from industrialised countries and towards topics relevant to these countries. In this article, we investigate this claim for research on rice, comparing the database CAB Abstracts with the mainstream databases. We find clear evidence that for a field such as rice, statistics based on WoS and Scopus strongly under-represent the scientific production by developing countries, and over-represent production by industrialised countries. More importantly, we also find a substantial bias in coverage of different research topics. WoS and Scopus have a ~75% coverage of publications in molecular biology and issues related to consumption, but a much lower coverage (20-30% in WoS and 30-50% in Scopus) for research more directly related to rice production such as plant nutrition, diseases and characteristics. CAB Abstracts coverage is above 80% for all topics except consumption. The study suggests that statistics based on mainstream databases provide a significantly distorted view of the amount of research and diversity of agendas in most countries. Given that bibliometric statistics are often used for benchmarking and evaluation purposes, the database biases may translate into policy framings that undervalue domestic capabilities and research agendas more attuned to local needs in the global south.

Suggested Citation

  • Rafols, Ismael & Ciarli, Tommaso & Chavarro, Diego, 2015. "Under-reporting research relevant to local needs in the global south. Database biases in the representation of knowledge on rice," SocArXiv 3kf9d_v1, Center for Open Science.
  • Handle: RePEc:osf:socarx:3kf9d_v1
    DOI: 10.31219/osf.io/3kf9d_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/5f7890fa1cfe6901e2cf7350/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/3kf9d_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthew L. Wallace & Ismael Rafols, 2015. "Research portfolios in science policy: moving from financial returns to societal benefits," SPRU Working Paper Series 2015-10, SPRU - Science Policy Research Unit, University of Sussex Business School.
    2. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    3. Éric Archambault & David Campbell & Yves Gingras & Vincent Larivière, 2009. "Comparing bibliometric statistics obtained from the Web of Science and Scopus," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(7), pages 1320-1326, July.
    4. Éric Archambault & Étienne Vignola-Gagné & Grégoire Côté & Vincent Larivière & Yves Gingrasb, 2006. "Benchmarking scientific output in the social sciences and humanities: The limits of existing databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 329-342, September.
    5. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rafols, Ismael & Ciarli, Tommaso & Chavarro, Diego, 2015. "Under-reporting research relevant to local needs in the global south. Database biases in the representation of knowledge on rice," SocArXiv 3kf9d, Center for Open Science.
    2. Miguel-Angel Vera-Baceta & Michael Thelwall & Kayvan Kousha, 2019. "Web of Science and Scopus language coverage," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1803-1813, December.
    3. Drivas, Kyriakos & Kremmydas, Dimitris, 2020. "The Matthew effect of a journal's ranking," Research Policy, Elsevier, vol. 49(4).
    4. Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
    5. Sándor Soós & Zsófia Vida & András Schubert, 2018. "Long-term trends in the multidisciplinarity of some typical natural and social sciences, and its implications on the SSH versus STM distinction," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 795-822, March.
    6. Carlo D'Ippoliti, 2021. "“Many‐Citedness”: Citations Measure More Than Just Scientific Quality," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1271-1301, December.
    7. Alasdair Reid, 2023. "Closing the Affordable Housing Gap: Identifying the Barriers Hindering the Sustainable Design and Construction of Affordable Homes," Sustainability, MDPI, vol. 15(11), pages 1-27, May.
    8. Andreea Mironescu & Alina Moroșanu & Anca-Diana Bibiri, 2023. "The regional dynamics of multilingual publishing in web of science: A statistical analysis of central and eastern european journals and researchers in linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1133-1162, February.
    9. Rafols, Ismael & Stirling, Andy, 2020. "Designing indicators for opening up evaluation. Insights from research assessment," SocArXiv h2fxp_v1, Center for Open Science.
    10. Nicky Agate & Rebecca Kennison & Stacy Konkiel & Christopher P. Long & Jason Rhody & Simone Sacchi & Penelope Weber, 2020. "The transformative power of values-enacted scholarship," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-12, December.
    11. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    12. Rafols, Ismael & Stirling, Andy, 2020. "Designing indicators for opening up evaluation. Insights from research assessment," SocArXiv h2fxp, Center for Open Science.
    13. Yaqub, Ohid & Coburn, Josie & Moore, Duncan A.Q., 2024. "Research-targeting, spillovers, and the direction of science: Evidence from HIV research-funding," Research Policy, Elsevier, vol. 53(8).
    14. Tang, Li & Yang, Defang & Wang, Mingxing & Guo, Ying, 2024. "The mediating impact of citation scope: Evidence from China's ESI publications," Journal of Informetrics, Elsevier, vol. 18(3).
    15. Saïd Echchakoui, 0. "Why and how to merge Scopus and Web of Science during bibliometric analysis: the case of sales force literature from 1912 to 2019," Journal of Marketing Analytics, Palgrave Macmillan, vol. 0, pages 1-20.
    16. Benedetto Lepori & Aldo Geuna & Antonietta Mira, 2019. "Scientific output scales with resources. A comparison of US and European universities," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-18, October.
    17. Alberto Martín-Martín & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2018. "Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2175-2188, September.
    18. Loet Leydesdorff & Paul Wouters & Lutz Bornmann, 2016. "Professional and citizen bibliometrics: complementarities and ambivalences in the development and use of indicators—a state-of-the-art report," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2129-2150, December.
    19. Gobinda Chowdhury & Kushwanth Koya & Pete Philipson, 2016. "Measuring the Impact of Research: Lessons from the UK’s Research Excellence Framework 2014," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-15, June.
    20. Luisa F. Cabeza & Marta Chàfer & Érika Mata, 2020. "Comparative Analysis of Web of Science and Scopus on the Energy Efficiency and Climate Impact of Buildings," Energies, MDPI, vol. 13(2), pages 1-24, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:3kf9d_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.