IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0092896.html
   My bibliography  Save this article

Imbalance in Individual Researcher's Peer Review Activities Quantified for Four British Ecological Society Journals, 2003-2010

Author

Listed:
  • Owen L Petchey
  • Jeremy W Fox
  • Lindsay Haddon

Abstract

Researchers contribute to the scientific peer review system by providing reviews, and “withdraw” from it by submitting manuscripts that are subsequently reviewed. So far as we are aware, there has been no quantification of the balance of individual's contributions and withdrawals. We compared the number of reviews provided by individual researchers (i.e., their contribution) to the number required by their submissions (i.e. their withdrawals) in a large and anonymised database provided by the British Ecological Society. The database covered the Journal of Ecology, Journal of Animal Ecology, Journal of Applied Ecology, and Functional Ecology from 2003–2010. The majority of researchers (64%) did not have balanced contributions and withdrawals. Depending on assumptions, 12% to 44% contributed more than twice as much as required; 20% to 52% contributed less than half as much as required. Balance, or lack thereof, varied little in relation to the number of years a researcher had been active (reviewing or submitting). Researchers who contributed less than required did not lack the opportunity to review. Researchers who submitted more were more likely to accept invitations to review. These finding suggest overall that peer review of the four analysed journals is not in crisis, but only due to the favourable balance of over- and under-contributing researchers. These findings are limited to the four journals analysed, and therefore cannot include researcher's other peer review activities, which if included might change the proportions reported. Relatively low effort was required to assemble, check, and analyse the data. Broader analyses of individual researcher's peer review activities would contribute to greater quality, efficiency, and fairness in the peer review system.

Suggested Citation

  • Owen L Petchey & Jeremy W Fox & Lindsay Haddon, 2014. "Imbalance in Individual Researcher's Peer Review Activities Quantified for Four British Ecological Society Journals, 2003-2010," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-4, March.
  • Handle: RePEc:plo:pone00:0092896
    DOI: 10.1371/journal.pone.0092896
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0092896
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0092896&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0092896?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hagen, Nils T., 2013. "Harmonic coauthor credit: A parsimonious quantification of the byline hierarchy," Journal of Informetrics, Elsevier, vol. 7(4), pages 784-791.
    2. Tim Vines & Loren Rieseberg & Harry Smith, 2010. "No crisis in supply of peer reviewers," Nature, Nature, vol. 468(7327), pages 1041-1041, December.
    3. Waltman, Ludo, 2012. "An empirical analysis of the use of alphabetical authorship in scientific publishing," Journal of Informetrics, Elsevier, vol. 6(4), pages 700-711.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Jinseok & Kim, Jinmo, 2015. "Rethinking the comparison of coauthorship credit allocation schemes," Journal of Informetrics, Elsevier, vol. 9(3), pages 667-673.
    2. Zhai, Li & Yan, Xiangbin, 2022. "A directed collaboration network for exploring the order of scientific collaboration," Journal of Informetrics, Elsevier, vol. 16(4).
    3. Rahman, Mohammad Tariqur & Regenstein, Joe Mac & Kassim, Noor Lide Abu & Haque, Nazmul, 2017. "The need to quantify authors’ relative intellectual contributions in a multi-author paper," Journal of Informetrics, Elsevier, vol. 11(1), pages 275-281.
    4. Xie, Qing & Zhang, Xinyuan & Song, Min, 2021. "A network embedding-based scholar assessment indicator considering four facets: Research topic, author credit allocation, field-normalized journal impact, and published time," Journal of Informetrics, Elsevier, vol. 15(4).
    5. Hagen, Nils T., 2014. "Counting and comparing publication output with and without equalizing and inflationary bias," Journal of Informetrics, Elsevier, vol. 8(2), pages 310-317.
    6. Hagen, Nils T., 2015. "Contributory inequality alters assessment of academic output gap between comparable countries," Journal of Informetrics, Elsevier, vol. 9(3), pages 629-641.
    7. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    8. Jinseok Kim & Jana Diesner, 2014. "A network-based approach to coauthorship credit allocation," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 587-602, October.
    9. Pär Sundling, 2023. "Author contributions and allocation of authorship credit: testing the validity of different counting methods in the field of chemical biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2737-2762, May.
    10. Hagen, Nils T., 2014. "Reversing the byline hierarchy: The effect of equalizing bias on the accreditation of primary, secondary and senior authors," Journal of Informetrics, Elsevier, vol. 8(3), pages 618-627.
    11. Carla Mara Hilário & Maria Cláudia Cabrini Grácio & Daniel Martínez-Ávila & Dietmar Wolfram, 2023. "Authorship order as an indicator of similarity between article discourse and author citation identity in informetrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5389-5410, October.
    12. Matthias Weber, 2016. "The Effects of Listing Authors in Alphabetical Order: A survey of the Empirical Evidence," Bank of Lithuania Occasional Paper Series 12, Bank of Lithuania.
    13. Thelwall, Mike & Bailey, Carol & Makita, Meiko & Sud, Pardeep & Madalli, Devika P., 2019. "Gender and research publishing in India: Uniformly high inequality?," Journal of Informetrics, Elsevier, vol. 13(1), pages 118-131.
    14. María Bordons & Borja González-Albo & Javier Aparicio & Luz Moreno, 2015. "The influence of R&D intensity of countries on the impact of international collaborative research: evidence from Spain," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1385-1400, February.
    15. Sameer Kumar & Kuru Ratnavelu, 2016. "Perceptions of Scholars in the Field of Economics on Co-Authorship Associations: Evidence from an International Survey," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-18, June.
    16. Gita Ghiasi & Matthew Harsh & Andrea Schiffauerova, 2018. "Inequality and collaboration patterns in Canadian nanotechnology: implications for pro-poor and gender-inclusive policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 785-815, May.
    17. Xuan Zhen Liu & Hui Fang, 2014. "Scientific group leaders’ authorship preferences: an empirical investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 909-925, February.
    18. Wang, Jiang-Pan & Guo, Qiang & Zhou, Lei & Liu, Jian-Guo, 2019. "Dynamic credit allocation for researchers," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 520(C), pages 208-216.
    19. Mike Thelwall, 2020. "Female citation impact superiority 1996–2018 in six out of seven English‐speaking nations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(8), pages 979-990, August.
    20. Javier E., Contreras-Reyes, 2016. "Credit allocation based on journal impact factor and coauthorship contribution," MPRA Paper 71294, University Library of Munich, Germany.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0092896. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.