IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i1d10.1007_s11192-021-04209-1.html
   My bibliography  Save this article

Gender differences among active reviewers: an investigation based on publons

Author

Listed:
  • Lin Zhang

    (Wuhan University
    Wuhan University
    KU Leuven)

  • Yuanyuan Shang

    (Wuhan University
    Wuhan University)

  • Ying Huang

    (Wuhan University
    Wuhan University
    KU Leuven)

  • Gunnar Sivertsen

    (Nordic Institute for Studies in Innovation, Research and Education)

Abstract

Peer review of scientific manuscripts before publication is essential in scholarly publishing, and most active researchers hold relationships with a number of journals as both an author and a reviewer. There have been several studies focusing on gender balance in academic research and authorship, but fewer studies on our role as reviewers. Publons is a commercial website run by Clarivate Analytics that allows researchers to track and verify their peer review activities and be recognized for it. The platform features over 2 million researchers and 6.9 million reviews for more than 5,000 partnered journals, listing the most active reviewers as “top reviewers”. Our study focuses on gender representation in this ‘top reviewer’ group while also looking at the countries, regions and research fields they represent, as well as the relationship between their roles as authors and reviewers. The results show that male reviewers dominate in almost all countries, regions, and research fields. Male reviewers generally contribute to review work more frequently than females; however, female reviewers write longer reviews. The correlations between reviewing activity and research activity are generally weak overall and within specific research fields. This may reflect that active reviewers are not necessarily the most productive researchers in their fields. What clearly emerges from our results is the need for more concern over gender representation in the quality assurance and gatekeeping functions of scholarly publishing.

Suggested Citation

  • Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    • Handle: RePEc:spr:scient:v:127:y:2022:i:1:d:10.1007_s11192-021-04209-1
    DOI: 10.1007/s11192-021-04209-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-021-04209-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-021-04209-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bradford Demarest & Guo Freeman & Cassidy R. Sugimoto, 2014. "The reviewer in the mirror: examining gendered and ethnicized notions of reciprocity in peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 717-735, October.
    2. Helena Mihaljević-Brandt & Lucía Santamaría & Marco Tullney, 2016. "The Effect of Gender in the Publication Patterns in Mathematics," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-23, October.
    3. Vincent Larivière & Chaoqun Ni & Yves Gingras & Blaise Cronin & Cassidy R. Sugimoto, 2013. "Bibliometrics: Global gender disparities in science," Nature, Nature, vol. 504(7479), pages 211-213, December.
    4. Krawczyk, Michał & Smyk, Magdalena, 2016. "Author׳s gender affects rating of academic articles: Evidence from an incentivized, deception-free laboratory experiment," European Economic Review, Elsevier, vol. 90(C), pages 326-335.
    5. Reingewertz, Yaniv & Lutmar, Carmela, 2018. "Academic in-group bias: An empirical examination of the link between author and journal affiliation," Journal of Informetrics, Elsevier, vol. 12(1), pages 74-86.
    6. José Luis Ortega, 2017. "Are peer-review activities related to reviewer bibliometric performance? A scientometric analysis of Publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 947-962, August.
    7. Bornmann, Lutz & Williams, Richard, 2017. "Can the journal impact factor be used as a criterion for the selection of junior researchers? A large-scale empirical study based on ResearcherID data," Journal of Informetrics, Elsevier, vol. 11(3), pages 788-799.
    8. Pleun Arensbergen & Inge van der Weijden & Peter Besselaar, 2012. "Gender differences in scientific productivity: a persisting phenomenon?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 857-868, December.
    9. Staša Milojević, 2012. "How Are Academic Age, Productivity and Collaboration Related to Citing Behavior of Researchers?," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-13, November.
    10. Seema Jayachandran, 2015. "The Roots of Gender Inequality in Developing Countries," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 63-88, August.
    11. Jevin D West & Jennifer Jacquet & Molly M King & Shelley J Correll & Carl T Bergstrom, 2013. "The Role of Gender in Scholarly Authorship," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-6, July.
    12. Jory Lerback & Brooks Hanson, 2017. "Journals invite too few women to referee," Nature, Nature, vol. 541(7638), pages 455-457, January.
    13. Giovanni Abramo & Ciriaco Andrea D’Angelo & Alessandro Caprasecca, 2009. "Gender differences in research productivity: A bibliometric analysis of the Italian academic system," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 517-539, June.
    14. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
    15. Xiao Han T Zeng & Jordi Duch & Marta Sales-Pardo & João A G Moreira & Filippo Radicchi & Haroldo V Ribeiro & Teresa K Woodruff & Luís A Nunes Amaral, 2016. "Differences in Collaboration Patterns across Discipline, Career Stage, and Gender," PLOS Biology, Public Library of Science, vol. 14(11), pages 1-19, November.
    16. Michail Kovanis & Raphaël Porcher & Philippe Ravaud & Ludovic Trinquart, 2016. "The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-14, November.
    17. S. Thurner & R. Hanel, 2011. "Peer-review in a world with rational scientists: Toward selection of the average," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 84(4), pages 707-711, December.
    18. Peter van den Besselaar & Ulf Sandström, 2017. "Vicious circles of gender bias, lower positions, and lower performance: Gender differences in scholarly productivity and impact," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-16, August.
    19. Luke Holman & Devi Stuart-Fox & Cindy E Hauser, 2018. "The gender gap in science: How long until women are equally represented?," PLOS Biology, Public Library of Science, vol. 16(4), pages 1-20, April.
    20. Potter Wickware, 1997. "Along the leaky pipeline," Nature, Nature, vol. 390(6656), pages 202-203, November.
    21. Lu Liu & Yang Wang & Roberta Sinatra & C. Lee Giles & Chaoming Song & Dashun Wang, 2018. "Hot streaks in artistic, cultural, and scientific careers," Nature, Nature, vol. 559(7714), pages 396-399, July.
    22. Rørstad, Kristoffer & Aksnes, Dag W., 2015. "Publication rate expressed by age, gender and academic position – A large-scale analysis of Norwegian academic staff," Journal of Informetrics, Elsevier, vol. 9(2), pages 317-333.
    23. Elisabetta Addis & Paola Villa, 2003. "The Editorial Boards of Italian Economics Journals: Women, Gender, and Social Networking," Feminist Economics, Taylor & Francis Journals, vol. 9(1), pages 75-91.
    24. Denis Arruda & Fábio Bezerra & Vânia Almeida Neris & Patricia Rocha De Toro & Jacques Wainera, 2009. "Brazilian computer science research: Gender and regional distributions," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 651-665, June.
    25. Junming Huang & Alexander J. Gates & Roberta Sinatra & Albert-László Barabási, 2020. "Historical comparison of gender inequality in scientific careers across countries and disciplines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(9), pages 4609-4616, March.
    26. Hajar Sotudeh & Tahereh Dehdarirad & Jonathan Freer, 2018. "Gender differences in scientific productivity and visibility in core neurosurgery journals: Citations and social media metrics," Research Evaluation, Oxford University Press, vol. 27(3), pages 262-269.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Guangyao & Xu, Shenmeng & Sun, Yao & Jiang, Chunlin & Wang, Xianwen, 2022. "Understanding the peer review endeavor in scientific publishing," Journal of Informetrics, Elsevier, vol. 16(2).
    2. Magdalena Formanowicz & Marta Witkowska & Weronika Hryniszak & Zuzanna Jakubik & Aleksandra Cisłak, 2023. "Gender bias in special issues: evidence from a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2283-2299, April.
    3. Meijun Liu & Sijie Yang & Yi Bu & Ning Zhang, 2023. "Female early-career scientists have conducted less interdisciplinary research in the past six decades: evidence from doctoral theses," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-16, December.
    4. Yongchao Ma & Ying Teng & Zhongzhun Deng & Li Liu & Yi Zhang, 2023. "Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2105-2143, April.
    5. Lin Zhang & Ziyi Tu & Yifei Yu & Yuanyuan Shang & Ying Huang, 2024. "Spotting potential reviewers for interdisciplinary research: insights on active reviewers from Publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5533-5556, September.
    6. Dengsheng Wu & Huidong Wu & Jianping Li, 2024. "Citation advantage of positive words: predictability, temporal evolution, and universality in varied quality journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4275-4293, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Lin & Shang, Yuanyuan & HUANG, Ying & Sivertsen, Gunnar, 2021. "Gender differences among active reviewers: an investigation based on Publons," SocArXiv 4z6w8, Center for Open Science.
    2. Josh Yamamoto & Eitan Frachtenberg, 2022. "Gender Differences in Collaboration Patterns in Computer Science," Publications, MDPI, vol. 10(1), pages 1-21, February.
    3. Roberta Ruggieri & Fabrizio Pecoraro & Daniela Luzi, 2021. "An intersectional approach to analyse gender productivity and open access: a bibliometric analysis of the Italian National Research Council," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1647-1673, February.
    4. Jamal El-Ouahi & Vincent Larivière, 2023. "On the lack of women researchers in the Middle East and North Africa," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4321-4348, August.
    5. Ho Fai Chan & Benno Torgler, 2020. "Gender differences in performance of top cited scientists by field and country," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2421-2447, December.
    6. Hamid R. Jamali & Alireza Abbasi, 2023. "Gender gaps in Australian research publishing, citation and co-authorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2879-2893, May.
    7. Nakajima, Kazuki & Liu, Ruodan & Shudo, Kazuyuki & Masuda, Naoki, 2023. "Quantifying gender imbalance in East Asian academia: Research career and citation practice," Journal of Informetrics, Elsevier, vol. 17(4).
    8. Sánchez-Jiménez, Rodrigo & Guerrero-Castillo, Pablo & Guerrero-Bote, Vicente P. & Halevi, Gali & De-Moya-Anegón, Félix, 2024. "Analysis of the distribution of authorship by gender in scientific output: A global perspective," Journal of Informetrics, Elsevier, vol. 18(3).
    9. Hajibabaei, Anahita & Schiffauerova, Andrea & Ebadi, Ashkan, 2022. "Gender-specific patterns in the artificial intelligence scientific ecosystem," Journal of Informetrics, Elsevier, vol. 16(2).
    10. Antonio De Nicola & Gregorio D’Agostino, 2021. "Assessment of gender divide in scientific communities," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3807-3840, May.
    11. Parminder Bakshi-Hamm & Andreas Hamm, 2022. "Knowledge Production: Analysing Gender- and Country-Dependent Factors in Research Topics through Term Communities," Publications, MDPI, vol. 10(4), pages 1-37, November.
    12. Jyoti Paswan & Vivek Kumar Singh, 2020. "Gender and research publishing analyzed through the lenses of discipline, institution types, impact and international collaboration: a case study from India," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 497-515, April.
    13. Marek Kwiek & Wojciech Roszka, 2022. "Are female scientists less inclined to publish alone? The gender solo research gap," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1697-1735, April.
    14. Arjun Prakash & Jeevan John Varghese & Shruti Aggarwal, 2024. "Gender of gender studies: examining regional and gender-based disparities in scholarly publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4471-4493, July.
    15. Sabrina J. Mayer & Justus M. K. Rathmann, 2018. "How does research productivity relate to gender? Analyzing gender differences for multiple publication dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1663-1693, December.
    16. Emre Özel, 2024. "What is Gender Bias in Grant Peer review?," Working Papers halshs-03862027, HAL.
    17. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    18. Kwiek, Marek & Szymula, Łukasz, 2024. "Growth of Science and Women: Methodological Challenges of Using Structured Big Data," SocArXiv w34pr, Center for Open Science.
    19. Abramo, Giovanni & Aksnes, Dag W. & D’Angelo, Ciriaco Andrea, 2021. "Gender differences in research performance within and between countries: Italy vs Norway," Journal of Informetrics, Elsevier, vol. 15(2).
    20. Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:1:d:10.1007_s11192-021-04209-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.