IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i10d10.1007_s11192-023-04790-7.html
   My bibliography  Save this article

Do reviewers get their deserved acknowledgments from the authors of manuscripts?

Author

Listed:
  • Pengfei Jia

    (Dalian University of Technology)

  • Weixi Xie

    (Dalian University of Technology)

  • Guangyao Zhang

    (Dalian University of Technology)

  • Xianwen Wang

    (Dalian University of Technology)

Abstract

As the gatekeeper of science, reviewers play an essential role in academic publishing by improving the quality of papers and maintaining research integrity. In this research, we examined whether reviewers receive gratitude from authors for their reviewed manuscript. We analyzed over 46 million papers from 2001 to 2020 and found that although the proportion of acknowledges to reviewers in different subject areas has increased in recent years, the overall proportion of acknowledges to reviewers is low, with the lowest proportion being the field of Health Sciences and the highest in the field of Social Sciences. We also discovered that the proportion of acknowledged reviewers from different regions varied, with America, Europe and Oceania having a generally higher proportion than Asia. Our results indicate that the scientific community is generally unaware of the contributions made by reviewers, and reviewers have not received the acknowledgments they deserve. Additionally, we found that a small number of journals had more papers acknowledging reviewers. Through regression analysis, we found that although authors acknowledged the reviewer's contribution, their decision to write down acknowledgements were influenced by their language proficiency.

Suggested Citation

  • Pengfei Jia & Weixi Xie & Guangyao Zhang & Xianwen Wang, 2023. "Do reviewers get their deserved acknowledgments from the authors of manuscripts?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5687-5703, October.
    • Handle: RePEc:spr:scient:v:128:y:2023:i:10:d:10.1007_s11192-023-04790-7
    DOI: 10.1007/s11192-023-04790-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04790-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-023-04790-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cristian Mejia & Yuya Kajikawa, 2018. "Using acknowledgement data to characterize funding organizations by the types of research sponsored: the case of robotics research," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 883-904, March.
    2. Bradford Demarest & Guo Freeman & Cassidy R. Sugimoto, 2014. "The reviewer in the mirror: examining gendered and ethnicized notions of reciprocity in peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 717-735, October.
    3. Lutz Bornmann & Rüdiger Mutz & Hans-Dieter Daniel, 2010. "A Reliability-Generalization Study of Journal Peer Reviews: A Multilevel Meta-Analysis of Inter-Rater Reliability and Its Determinants," PLOS ONE, Public Library of Science, vol. 5(12), pages 1-10, December.
    4. Costas, Rodrigo & van Leeuwen, Thed N. & van Raan, Anthony F.J., 2013. "Effects of the durability of scientific literature at the group level: Case study of chemistry research groups in the Netherlands," Research Policy, Elsevier, vol. 42(4), pages 886-894.
    5. Adèle Paul-Hus & Nadine Desrochers & Rodrigo Costas, 2016. "Characterization, description, and considerations for the use of funding acknowledgement data in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 167-182, July.
    6. Niccolò Casnici & Francisco Grimaldo & Nigel Gilbert & Flaminio Squazzoni, 2017. "Attitudes of referees in a multidisciplinary journal: An empirical analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(7), pages 1763-1771, July.
    7. Adèle Paul-Hus & Adrián A Díaz-Faes & Maxime Sainte-Marie & Nadine Desrochers & Rodrigo Costas & Vincent Larivière, 2017. "Beyond funding: Acknowledgement patterns in biomedical, natural and social sciences," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-14, October.
    8. Min Song & Keun Young Kang & Tatsawan Timakum & Xinyuan Zhang, 2020. "Examining influential factors for acknowledgements classification using supervised learning," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-21, February.
    9. Paul-Hus, Adèle & Mongeon, Philippe & Sainte-Marie, Maxime & Larivière, Vincent, 2017. "The sum of it all: Revealing collaboration patterns by combining authorship and acknowledgements," Journal of Informetrics, Elsevier, vol. 11(1), pages 80-87.
    10. Giangiacomo Bravo & Francisco Grimaldo & Emilia López-Iñesta & Bahar Mehmani & Flaminio Squazzoni, 2019. "The effect of publishing peer review reports on referee behavior in five scholarly journals," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    11. Adrian Mulligan & Louise Hall & Ellen Raphael, 2013. "Peer review in a changing world: An international study measuring the attitudes of researchers," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(1), pages 132-161, January.
    12. C. Sean Burns & Charles W. Fox, 2017. "Language and socioeconomics predict geographic variation in peer review outcomes at an ecology journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1113-1127, November.
    13. Elise S. Brezis & Aliaksandr Birukou, 2020. "Arbitrariness in the peer review process," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 393-411, April.
    14. Paula Stephan & Reinhilde Veugelers & Jian Wang, 2017. "Reviewers are blinkered by bibliometrics," Nature, Nature, vol. 544(7651), pages 411-412, April.
    15. Lutz Bornmann & Irina Nast & Hans-Dieter Daniel, 2008. "Do editors and referees look for signs of scientific misconduct when reviewing manuscripts? A quantitative content analysis of studies that examined review criteria and reasons for accepting and rejec," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(3), pages 415-432, December.
    16. Adrian Mulligan & Louise Hall & Ellen Raphael, 2013. "Peer review in a changing world: An international study measuring the attitudes of researchers," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 132-161, January.
    17. Rose, Michael E. & Georg, Co-Pierre, 2021. "What 5,000 acknowledgements tell us about informal collaboration in financial economics," Research Policy, Elsevier, vol. 50(6).
    18. Bianchi, Federico & Grimaldo, Francisco & Squazzoni, Flaminio, 2019. "The F3-index. Valuing reviewers for scholarly journals," Journal of Informetrics, Elsevier, vol. 13(1), pages 78-86.
    19. David N. Laband, 1990. "Is There Value-Added from the Review Process in Economics?: Preliminary Evidence from Authors," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 105(2), pages 341-352.
    20. Xianwen Wang & Di Liu & Kun Ding & Xinran Wang, 2012. "Science funding and research output: a study on 10 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 591-599, May.
    21. Janine Huisman & Jeroen Smits, 2017. "Duration and quality of the peer review process: the author’s perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 633-650, October.
    22. Nina Smirnova & Philipp Mayr, 2023. "A comprehensive analysis of acknowledgement texts in Web of Science: a case study on four scientific domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 709-734, January.
    23. M. Keith Chen, 2013. "The Effect of Language on Economic Behavior: Evidence from Savings Rates, Health Behaviors, and Retirement Assets," American Economic Review, American Economic Association, vol. 103(2), pages 690-731, April.
    24. Yaoyu Wei & Lei Lei, 2018. "Institution bias in the New England Journal of Medicine? A bibliometric analysis of publications (1997–2016)," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1771-1775, December.
    25. Marco Seeber & Alberto Bacchelli, 2017. "Does single blind peer review hinder newcomers?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 567-585, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Katherine W. McCain, 2024. "Collaboration at the phylum level: coauthorship and acknowledgment patterns in the world of the water bears (phylum Tardigrada)," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(10), pages 6089-6125, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen Lou & Jiangen He & Lingxin Zhang & Zhijie Zhu & Yongjun Zhu, 2023. "Support behind the scenes: the relationship between acknowledgement, coauthor, and citation in Nobel articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5767-5790, October.
    2. Katherine W. McCain, 2024. "Collaboration at the phylum level: coauthorship and acknowledgment patterns in the world of the water bears (phylum Tardigrada)," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(10), pages 6089-6125, October.
    3. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    4. Nina Smirnova & Philipp Mayr, 2024. "Embedding models for supervised automatic extraction and classification of named entities in scientific acknowledgements," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 7261-7285, November.
    5. Nina Smirnova & Philipp Mayr, 2023. "A comprehensive analysis of acknowledgement texts in Web of Science: a case study on four scientific domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 709-734, January.
    6. Zhang, Guangyao & Xu, Shenmeng & Sun, Yao & Jiang, Chunlin & Wang, Xianwen, 2022. "Understanding the peer review endeavor in scientific publishing," Journal of Informetrics, Elsevier, vol. 16(2).
    7. Bianchi, Federico & Grimaldo, Francisco & Squazzoni, Flaminio, 2019. "The F3-index. Valuing reviewers for scholarly journals," Journal of Informetrics, Elsevier, vol. 13(1), pages 78-86.
    8. Alberto Baccini & Eugenio Petrovich, 2022. "Normative versus strategic accounts of acknowledgment data: The case of the top-five journals of economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 603-635, January.
    9. Sun, Zhuanlan, 2024. "Textual features of peer review predict top-cited papers: An interpretable machine learning perspective," Journal of Informetrics, Elsevier, vol. 18(2).
    10. Wenqing Wu & Haixu Xi & Chengzhi Zhang, 2024. "Are the confidence scores of reviewers consistent with the review content? Evidence from top conference proceedings in AI," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4109-4135, July.
    11. Min Song & Keun Young Kang & Tatsawan Timakum & Xinyuan Zhang, 2020. "Examining influential factors for acknowledgements classification using supervised learning," PLOS ONE, Public Library of Science, vol. 15(2), pages 1-21, February.
    12. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    13. Heo, Go Eun & Ko, Young Soo & Xie, Qing & Song, Min, 2023. "High acknowledgement index: Characterizing research supporters with factors of acknowledgement affecting paper citation counts," Journal of Informetrics, Elsevier, vol. 17(4).
    14. Zhuanlan Sun & C. Clark Cao & Sheng Liu & Yiwei Li & Chao Ma, 2024. "Behavioral consequences of second-person pronouns in written communications between authors and reviewers of scientific papers," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    15. Narjes Vara & Mahdieh Mirzabeigi & Hajar Sotudeh & Seyed Mostafa Fakhrahmad, 2022. "Application of k-means clustering algorithm to improve effectiveness of the results recommended by journal recommender system," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3237-3252, June.
    16. Lili Miao & Vincent Larivi`ere & Feifei Wang & Yong-Yeol Ahn & Cassidy R. Sugimoto, 2023. "Cooperation and interdependence in global science funding," Papers 2308.08630, arXiv.org, revised Feb 2024.
    17. J. A. Garcia & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2021. "The interplay between the reviewer’s incentives and the journal’s quality standard," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3041-3061, April.
    18. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    19. Marcel Knöchelmann, 2019. "Open Science in the Humanities, or: Open Humanities?," Publications, MDPI, vol. 7(4), pages 1-17, November.
    20. Rodríguez Sánchez, Isabel & Makkonen, Teemu & Williams, Allan M., 2019. "Peer review assessment of originality in tourism journals: critical perspective of key gatekeepers," Annals of Tourism Research, Elsevier, vol. 77(C), pages 1-11.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:10:d:10.1007_s11192-023-04790-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.