IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v18y2024i3s1751157724000609.html
   My bibliography  Save this article

How the readability of manuscript before journal submission advantages peer review process: Evidence from biomedical scientific publications

Author

Listed:
  • Sun, Zhuanlan
  • He, Dongjin
  • Li, Yiwei

Abstract

The practice of uploading preprints of scientific manuscripts prior to journal submission has become increasingly popular. As such, it is essential to understand the impact of the preprint version of a manuscript on the peer review process to facilitate the development of open peer review practices. In the current research, we analyze a dataset comprising 1,078 biomedical papers published in Nature Communications and eLife in 2019, along with their manuscript information posted on preprint servers and their peer review histories. Our investigation focuses on the relationship between the readability of manuscript before journal submission, as represented by preprints, and the sentimental features expressed by reviewers. Based on empirical analysis utilizing a linear regression model, it has been found that reviewers are inclined to express positive sentiments towards preprints characterized by technical language, as indicated by low value on the readability indices. Additional subgroup analysis suggests that this positive effect is more pronounced in papers with lower social and scientific impact, as indicated by online attention scores and scholarly views after publication, respectively. Overall, results of our analysis reveals that the utilization of technical language characterized by lower readability level in academic papers does not seem to hinder the peer review process in biomedical science, which has significant implications for the open peer review practice.

Suggested Citation

  • Sun, Zhuanlan & He, Dongjin & Li, Yiwei, 2024. "How the readability of manuscript before journal submission advantages peer review process: Evidence from biomedical scientific publications," Journal of Informetrics, Elsevier, vol. 18(3).
    • Handle: RePEc:eee:infome:v:18:y:2024:i:3:s1751157724000609
    DOI: 10.1016/j.joi.2024.101547
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157724000609
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2024.101547?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sun, Zhuanlan & Clark Cao, C. & Ma, Chao & Li, Yiwei, 2023. "The academic status of reviewers predicts their language use," Journal of Informetrics, Elsevier, vol. 17(4).
    2. Aria, Massimo & Cuccurullo, Corrado, 2017. "bibliometrix: An R-tool for comprehensive science mapping analysis," Journal of Informetrics, Elsevier, vol. 11(4), pages 959-975.
    3. Sun, Zhuanlan, 2024. "Textual features of peer review predict top-cited papers: An interpretable machine learning perspective," Journal of Informetrics, Elsevier, vol. 18(2).
    4. Michail Kovanis & Raphaël Porcher & Philippe Ravaud & Ludovic Trinquart, 2016. "The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-14, November.
    5. Porwal, Priya & Devare, Manoj H., 2024. "Scientific impact analysis: Unraveling the link between linguistic properties and citations," Journal of Informetrics, Elsevier, vol. 18(3).
    6. Ewen Callaway, 2017. "Heavyweight funders back central site for life-sciences preprints," Nature, Nature, vol. 542(7641), pages 283-284, February.
    7. Song, Ningyuan & Chen, Kejun & Zhao, Yuehua, 2023. "Understanding writing styles of scientific papers in the IS-LS domain: Evidence from abstracts over the past three decades," Journal of Informetrics, Elsevier, vol. 17(1).
    8. Ewen Callaway, 2013. "Preprints come to life," Nature, Nature, vol. 503(7475), pages 180-180, November.
    9. Zhang, Ning & He, Guangye & Shi, Dongbo & Zhao, Zhenyue & Li, Jiang, 2022. "Does a gender-neutral name associate with the research impact of a scientist?," Journal of Informetrics, Elsevier, vol. 16(1).
    10. Lei Lei & Sheng Yan, 2016. "Readability and citations in information science: evidence from abstracts and articles of four journals (2003–2012)," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1155-1169, September.
    11. Zhuanlan Sun & C. Clark Cao & Sheng Liu & Yiwei Li & Chao Ma, 2024. "Behavioral consequences of second-person pronouns in written communications between authors and reviewers of scientific papers," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    12. Lorenz Graf-Vlachy, 2022. "Is the readability of abstracts decreasing in management research?," Review of Managerial Science, Springer, vol. 16(4), pages 1063-1084, May.
    13. Alberto Falk Delgado & Gregory Garretson & Anna Falk Delgado, 2019. "The language of peer review reports on articles published in the BMJ, 2014–2017: an observational study," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1225-1235, September.
    14. Shan Wang & Xiaojun Liu & Jie Zhou, 2022. "Readability is decreasing in language and linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4697-4729, August.
    15. Richard Sever & Michael Eisen & John Inglis, 2019. "Plan U: Universal access to scientific and medical research via funder preprint mandates," PLOS Biology, Public Library of Science, vol. 17(6), pages 1-4, June.
    16. Sun, Zhuanlan & Pang, Ka Lok & Li, Yiwei, 2024. "The fading of status bias during the open peer review process," Journal of Informetrics, Elsevier, vol. 18(3).
    17. Zhou-min Yuan & Mingxin Yao, 2022. "Is academic writing becoming more positive? A large-scale diachronic case study of Science research articles across 25 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6191-6207, November.
    18. Tan Jin & Huiqiong Duan & Xiaofei Lu & Jing Ni & Kai Guo, 2021. "Do research articles with more readable abstracts receive higher online attention? Evidence from Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8471-8490, October.
    19. Lu, Chao & Bu, Yi & Dong, Xianlei & Wang, Jie & Ding, Ying & Larivière, Vincent & Sugimoto, Cassidy R. & Paul, Logan & Zhang, Chengzhi, 2019. "Analyzing linguistic complexity and scientific impact," Journal of Informetrics, Elsevier, vol. 13(3), pages 817-829.
    20. Sun, Zhuanlan & Liu, Sheng & Li, Yiwei & Ma, Chao, 2023. "Expedited editorial decision in COVID-19 pandemic," Journal of Informetrics, Elsevier, vol. 17(1).
    21. Dolnicar, Sara & Chapple, Alexander, 2015. "The readability of articles in tourism journals," Annals of Tourism Research, Elsevier, vol. 52(C), pages 161-166.
    22. Giangiacomo Bravo & Francisco Grimaldo & Emilia López-Iñesta & Bahar Mehmani & Flaminio Squazzoni, 2019. "The effect of publishing peer review reports on referee behavior in five scholarly journals," Nature Communications, Nature, vol. 10(1), pages 1-8, December.
    23. Rodrigo Costas & Zohreh Zahedi & Paul Wouters, 2015. "Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(10), pages 2003-2019, October.
    24. Chao Lu & Yi Bu & Jie Wang & Ying Ding & Vetle Torvik & Matthew Schnaars & Chengzhi Zhang, 2019. "Examining scientific writing styles from the perspective of linguistic complexity," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 70(5), pages 462-475, May.
    25. Ante, Lennart, 2022. "The relationship between readability and scientific impact: Evidence from emerging technology discourses," Journal of Informetrics, Elsevier, vol. 16(1).
    26. Khaled Moustafa, 2016. "Improving PDF readability of scientific papers on computer screens," Behaviour and Information Technology, Taylor & Francis Journals, vol. 35(4), pages 319-323, April.
    27. David Card & Stefano DellaVigna, 2014. "Page Limits on Economics Articles: Evidence from Two Journals," Journal of Economic Perspectives, American Economic Association, vol. 28(3), pages 149-168, Summer.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xi Zhao & Li Li & Wei Xiao, 2023. "The diachronic change of research article abstract difficulty across disciplines: a cognitive information-theoretic approach," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    2. Song, Ningyuan & Chen, Kejun & Zhao, Yuehua, 2023. "Understanding writing styles of scientific papers in the IS-LS domain: Evidence from abstracts over the past three decades," Journal of Informetrics, Elsevier, vol. 17(1).
    3. Sun, Zhuanlan & Pang, Ka Lok & Li, Yiwei, 2024. "The fading of status bias during the open peer review process," Journal of Informetrics, Elsevier, vol. 18(3).
    4. Sun, Zhuanlan, 2024. "Textual features of peer review predict top-cited papers: An interpretable machine learning perspective," Journal of Informetrics, Elsevier, vol. 18(2).
    5. Tan Jin & Huiqiong Duan & Xiaofei Lu & Jing Ni & Kai Guo, 2021. "Do research articles with more readable abstracts receive higher online attention? Evidence from Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8471-8490, October.
    6. Ju Wen & Lei Lei, 2022. "Adjectives and adverbs in life sciences across 50 years: implications for emotions and readability in academic texts," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4731-4749, August.
    7. Dengsheng Wu & Huidong Wu & Jianping Li, 2024. "Citation advantage of positive words: predictability, temporal evolution, and universality in varied quality journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4275-4293, July.
    8. Don Watson & Manfred Krug & Claus-Christian Carbon, 2022. "The relationship between citations and the linguistic traits of specific academic discourse communities identified by using social network analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1755-1781, April.
    9. Zhuanlan Sun & C. Clark Cao & Sheng Liu & Yiwei Li & Chao Ma, 2024. "Behavioral consequences of second-person pronouns in written communications between authors and reviewers of scientific papers," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    10. Ante, Lennart, 2022. "The relationship between readability and scientific impact: Evidence from emerging technology discourses," Journal of Informetrics, Elsevier, vol. 16(1).
    11. Xueying Liu & Haoran Zhu, 2023. "Linguistic positivity in soft and hard disciplines: temporal dynamics, disciplinary variation, and the relationship with research impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 3107-3127, May.
    12. Sun, Zhuanlan & Clark Cao, C. & Ma, Chao & Li, Yiwei, 2023. "The academic status of reviewers predicts their language use," Journal of Informetrics, Elsevier, vol. 17(4).
    13. Kun Sun & Haitao Liu & Wenxin Xiong, 2021. "The evolutionary pattern of language in scientific writings: A case study of Philosophical Transactions of Royal Society (1665–1869)," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1695-1724, February.
    14. Gui Wang & Hui Wang & Xinyi Sun & Nan Wang & Li Wang, 2023. "Linguistic complexity in scientific writing: A large-scale diachronic study from 1821 to 1920," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 441-460, January.
    15. Shan Wang & Xiaojun Liu & Jie Zhou, 2022. "Readability is decreasing in language and linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4697-4729, August.
    16. Lu, Wei & Liu, Zhifeng & Huang, Yong & Bu, Yi & Li, Xin & Cheng, Qikai, 2020. "How do authors select keywords? A preliminary study of author keyword selection behavior," Journal of Informetrics, Elsevier, vol. 14(4).
    17. Buljan, Ivan & Garcia-Costa, Daniel & Grimaldo, Francisco & Klein, Richard A. & Bakker, Marjan & Marušić, Ana, 2024. "Development and application of a comprehensive glossary for the identification of statistical and methodological concepts in peer review reports," Journal of Informetrics, Elsevier, vol. 18(3).
    18. Dowling, Michael & Hammami, Helmi & Zreik, Ousayna, 2018. "Easy to read, easy to cite?," Economics Letters, Elsevier, vol. 173(C), pages 100-103.
    19. Bikun Chen & Dannan Deng & Zhouyan Zhong & Chengzhi Zhang, 2020. "Exploring linguistic characteristics of highly browsed and downloaded academic articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1769-1790, March.
    20. van den Besselaar, Peter & Mom, Charlie, 2022. "The effect of writing style on success in grant applications," Journal of Informetrics, Elsevier, vol. 16(1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:18:y:2024:i:3:s1751157724000609. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.