IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i1d10.1007_s11192-021-04209-1.html
   My bibliography  Save this article

Gender differences among active reviewers: an investigation based on publons

Author

Listed:
  • Lin Zhang

    (Wuhan University
    Wuhan University
    KU Leuven)

  • Yuanyuan Shang

    (Wuhan University
    Wuhan University)

  • Ying Huang

    (Wuhan University
    Wuhan University
    KU Leuven)

  • Gunnar Sivertsen

    (Nordic Institute for Studies in Innovation, Research and Education)

Abstract

Peer review of scientific manuscripts before publication is essential in scholarly publishing, and most active researchers hold relationships with a number of journals as both an author and a reviewer. There have been several studies focusing on gender balance in academic research and authorship, but fewer studies on our role as reviewers. Publons is a commercial website run by Clarivate Analytics that allows researchers to track and verify their peer review activities and be recognized for it. The platform features over 2 million researchers and 6.9 million reviews for more than 5,000 partnered journals, listing the most active reviewers as “top reviewers”. Our study focuses on gender representation in this ‘top reviewer’ group while also looking at the countries, regions and research fields they represent, as well as the relationship between their roles as authors and reviewers. The results show that male reviewers dominate in almost all countries, regions, and research fields. Male reviewers generally contribute to review work more frequently than females; however, female reviewers write longer reviews. The correlations between reviewing activity and research activity are generally weak overall and within specific research fields. This may reflect that active reviewers are not necessarily the most productive researchers in their fields. What clearly emerges from our results is the need for more concern over gender representation in the quality assurance and gatekeeping functions of scholarly publishing.

Suggested Citation

  • Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    • Handle: RePEc:spr:scient:v:127:y:2022:i:1:d:10.1007_s11192-021-04209-1
    DOI: 10.1007/s11192-021-04209-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-021-04209-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-021-04209-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Vincent Larivière & Chaoqun Ni & Yves Gingras & Blaise Cronin & Cassidy R. Sugimoto, 2013. "Bibliometrics: Global gender disparities in science," Nature, Nature, vol. 504(7479), pages 211-213, December.
    2. Krawczyk, Michał & Smyk, Magdalena, 2016. "Author׳s gender affects rating of academic articles: Evidence from an incentivized, deception-free laboratory experiment," European Economic Review, Elsevier, vol. 90(C), pages 326-335.
    3. Reingewertz, Yaniv & Lutmar, Carmela, 2018. "Academic in-group bias: An empirical examination of the link between author and journal affiliation," Journal of Informetrics, Elsevier, vol. 12(1), pages 74-86.
    4. José Luis Ortega, 2017. "Are peer-review activities related to reviewer bibliometric performance? A scientometric analysis of Publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 947-962, August.
    5. Bornmann, Lutz & Williams, Richard, 2017. "Can the journal impact factor be used as a criterion for the selection of junior researchers? A large-scale empirical study based on ResearcherID data," Journal of Informetrics, Elsevier, vol. 11(3), pages 788-799.
    6. Pleun Arensbergen & Inge van der Weijden & Peter Besselaar, 2012. "Gender differences in scientific productivity: a persisting phenomenon?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 857-868, December.
    7. Seema Jayachandran, 2015. "The Roots of Gender Inequality in Developing Countries," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 63-88, August.
    8. Giovanni Abramo & Ciriaco Andrea D’Angelo & Alessandro Caprasecca, 2009. "Gender differences in research productivity: A bibliometric analysis of the Italian academic system," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 517-539, June.
    9. Xiao Han T Zeng & Jordi Duch & Marta Sales-Pardo & João A G Moreira & Filippo Radicchi & Haroldo V Ribeiro & Teresa K Woodruff & Luís A Nunes Amaral, 2016. "Differences in Collaboration Patterns across Discipline, Career Stage, and Gender," PLOS Biology, Public Library of Science, vol. 14(11), pages 1-19, November.
    10. Peter van den Besselaar & Ulf Sandström, 2017. "Vicious circles of gender bias, lower positions, and lower performance: Gender differences in scholarly productivity and impact," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-16, August.
    11. Luke Holman & Devi Stuart-Fox & Cindy E Hauser, 2018. "The gender gap in science: How long until women are equally represented?," PLOS Biology, Public Library of Science, vol. 16(4), pages 1-20, April.
    12. Lu Liu & Yang Wang & Roberta Sinatra & C. Lee Giles & Chaoming Song & Dashun Wang, 2018. "Hot streaks in artistic, cultural, and scientific careers," Nature, Nature, vol. 559(7714), pages 396-399, July.
    13. Rørstad, Kristoffer & Aksnes, Dag W., 2015. "Publication rate expressed by age, gender and academic position – A large-scale analysis of Norwegian academic staff," Journal of Informetrics, Elsevier, vol. 9(2), pages 317-333.
    14. Denis Arruda & Fábio Bezerra & Vânia Almeida Neris & Patricia Rocha De Toro & Jacques Wainera, 2009. "Brazilian computer science research: Gender and regional distributions," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 651-665, June.
    15. Junming Huang & Alexander J. Gates & Roberta Sinatra & Albert-László Barabási, 2020. "Historical comparison of gender inequality in scientific careers across countries and disciplines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(9), pages 4609-4616, March.
    16. Bradford Demarest & Guo Freeman & Cassidy R. Sugimoto, 2014. "The reviewer in the mirror: examining gendered and ethnicized notions of reciprocity in peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 717-735, October.
    17. Helena Mihaljević-Brandt & Lucía Santamaría & Marco Tullney, 2016. "The Effect of Gender in the Publication Patterns in Mathematics," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-23, October.
    18. Staša Milojević, 2012. "How Are Academic Age, Productivity and Collaboration Related to Citing Behavior of Researchers?," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-13, November.
    19. Jevin D West & Jennifer Jacquet & Molly M King & Shelley J Correll & Carl T Bergstrom, 2013. "The Role of Gender in Scholarly Authorship," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-6, July.
    20. Jory Lerback & Brooks Hanson, 2017. "Journals invite too few women to referee," Nature, Nature, vol. 541(7638), pages 455-457, January.
    21. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
    22. Michail Kovanis & Raphaël Porcher & Philippe Ravaud & Ludovic Trinquart, 2016. "The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-14, November.
    23. S. Thurner & R. Hanel, 2011. "Peer-review in a world with rational scientists: Toward selection of the average," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 84(4), pages 707-711, December.
    24. Potter Wickware, 1997. "Along the leaky pipeline," Nature, Nature, vol. 390(6656), pages 202-203, November.
    25. Elisabetta Addis & Paola Villa, 2003. "The Editorial Boards of Italian Economics Journals: Women, Gender, and Social Networking," Feminist Economics, Taylor & Francis Journals, vol. 9(1), pages 75-91.
    26. Hajar Sotudeh & Tahereh Dehdarirad & Jonathan Freer, 2018. "Gender differences in scientific productivity and visibility in core neurosurgery journals: Citations and social media metrics," Research Evaluation, Oxford University Press, vol. 27(3), pages 262-269.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Meijun Liu & Sijie Yang & Yi Bu & Ning Zhang, 2023. "Female early-career scientists have conducted less interdisciplinary research in the past six decades: evidence from doctoral theses," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-16, December.
    2. Zhang, Guangyao & Xu, Shenmeng & Sun, Yao & Jiang, Chunlin & Wang, Xianwen, 2022. "Understanding the peer review endeavor in scientific publishing," Journal of Informetrics, Elsevier, vol. 16(2).
    3. Yongchao Ma & Ying Teng & Zhongzhun Deng & Li Liu & Yi Zhang, 2023. "Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2105-2143, April.
    4. Lin Zhang & Ziyi Tu & Yifei Yu & Yuanyuan Shang & Ying Huang, 2024. "Spotting potential reviewers for interdisciplinary research: insights on active reviewers from Publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5533-5556, September.
    5. Magdalena Formanowicz & Marta Witkowska & Weronika Hryniszak & Zuzanna Jakubik & Aleksandra Cisłak, 2023. "Gender bias in special issues: evidence from a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2283-2299, April.
    6. Dengsheng Wu & Huidong Wu & Jianping Li, 2024. "Citation advantage of positive words: predictability, temporal evolution, and universality in varied quality journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4275-4293, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Lin & Shang, Yuanyuan & HUANG, Ying & Sivertsen, Gunnar, 2021. "Gender differences among active reviewers: an investigation based on Publons," SocArXiv 4z6w8, Center for Open Science.
    2. Roberta Ruggieri & Fabrizio Pecoraro & Daniela Luzi, 2021. "An intersectional approach to analyse gender productivity and open access: a bibliometric analysis of the Italian National Research Council," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1647-1673, February.
    3. Josh Yamamoto & Eitan Frachtenberg, 2022. "Gender Differences in Collaboration Patterns in Computer Science," Publications, MDPI, vol. 10(1), pages 1-21, February.
    4. Jamal El-Ouahi & Vincent Larivière, 2023. "On the lack of women researchers in the Middle East and North Africa," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4321-4348, August.
    5. Ho Fai Chan & Benno Torgler, 2020. "Gender differences in performance of top cited scientists by field and country," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2421-2447, December.
    6. Hamid R. Jamali & Alireza Abbasi, 2023. "Gender gaps in Australian research publishing, citation and co-authorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2879-2893, May.
    7. Nakajima, Kazuki & Liu, Ruodan & Shudo, Kazuyuki & Masuda, Naoki, 2023. "Quantifying gender imbalance in East Asian academia: Research career and citation practice," Journal of Informetrics, Elsevier, vol. 17(4).
    8. Antonio De Nicola & Gregorio D’Agostino, 2021. "Assessment of gender divide in scientific communities," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3807-3840, May.
    9. Marek Kwiek & Wojciech Roszka, 2022. "Are female scientists less inclined to publish alone? The gender solo research gap," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1697-1735, April.
    10. Emre Özel, 2024. "What is Gender Bias in Grant Peer review?," Working Papers halshs-03862027, HAL.
    11. Sánchez-Jiménez, Rodrigo & Guerrero-Castillo, Pablo & Guerrero-Bote, Vicente P. & Halevi, Gali & De-Moya-Anegón, Félix, 2024. "Analysis of the distribution of authorship by gender in scientific output: A global perspective," Journal of Informetrics, Elsevier, vol. 18(3).
    12. Hajibabaei, Anahita & Schiffauerova, Andrea & Ebadi, Ashkan, 2022. "Gender-specific patterns in the artificial intelligence scientific ecosystem," Journal of Informetrics, Elsevier, vol. 16(2).
    13. Parminder Bakshi-Hamm & Andreas Hamm, 2022. "Knowledge Production: Analysing Gender- and Country-Dependent Factors in Research Topics through Term Communities," Publications, MDPI, vol. 10(4), pages 1-37, November.
    14. Jyoti Paswan & Vivek Kumar Singh, 2020. "Gender and research publishing analyzed through the lenses of discipline, institution types, impact and international collaboration: a case study from India," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 497-515, April.
    15. Arjun Prakash & Jeevan John Varghese & Shruti Aggarwal, 2024. "Gender of gender studies: examining regional and gender-based disparities in scholarly publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4471-4493, July.
    16. Sabrina J. Mayer & Justus M. K. Rathmann, 2018. "How does research productivity relate to gender? Analyzing gender differences for multiple publication dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1663-1693, December.
    17. Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
    18. Mohsen Jadidi & Fariba Karimi & Haiko Lietz & Claudia Wagner, 2018. "Gender Disparities In Science? Dropout, Productivity, Collaborations And Success Of Male And Female Computer Scientists," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 21(03n04), pages 1-23, May.
    19. Mengyu Yu & Mazie Krehbiel & Samantha Thompson & Tatjana Miljkovic, 2020. "An exploration of gender gap using advanced data science tools: actuarial research community," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 767-789, May.
    20. Abdelghani Maddi & Yves Gingras, 2021. "Gender Diversity In Research Teams And Citation Impact In Economics And Management," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1381-1404, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:1:d:10.1007_s11192-021-04209-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.