IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v18y2024i2s1751157724000178.html
   My bibliography  Save this article

Does the handling time of scientific papers relate to their academic impact and social attention? Evidence from Nature, Science, and PNAS

Author

Listed:
  • Xie, Yundong
  • Wu, Qiang
  • Wang, Yezhu
  • Hou, Li
  • Liu, Yuanyuan

Abstract

The time required for peer review is a crucial factor for researchers when deciding where to submit their manuscripts, as it is also considered an important predictor of paper impact. This paper analyses the handling time of academic papers at the individual paper level, focusing on three key indicators: editorial handling time, processing handling time, and total handling time. Unlike previous studies that primarily examined the simple correlation between handling time and academic impact of academic papers, this paper uses a negative binomial regression model to analyse the data while controlling for various factors related to total citations. Further, we explore the relationship between handling time and social attention. The dataset used in this study comprises 49,881 papers classified as ‘articles’ and published between 2011 and 2020 in three prestigious journals: Nature, Science, and PNAS. Our main findings reveal significant negative associations between the three measures of handling time and both impact and attention, except that processing handling time and attention have a significant positive relationship. Additionally, heterogeneity analyses indicate that these relationships are affected by the journal, subject, and affiliation. This empirical analysis of handling time's effect on academic impact and social attention expands upon the insights gained from previous research and may stimulate changes in some journal editorial policies to accelerate publishing speed.

Suggested Citation

  • Xie, Yundong & Wu, Qiang & Wang, Yezhu & Hou, Li & Liu, Yuanyuan, 2024. "Does the handling time of scientific papers relate to their academic impact and social attention? Evidence from Nature, Science, and PNAS," Journal of Informetrics, Elsevier, vol. 18(2).
    • Handle: RePEc:eee:infome:v:18:y:2024:i:2:s1751157724000178
    DOI: 10.1016/j.joi.2024.101504
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157724000178
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2024.101504?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Carlos B. Amat, 2008. "Editorial and publication delay of papers submitted to 14 selected Food Research journals. Influence of online posting," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(3), pages 379-389, March.
    2. Lester R. Lusher & Winnie Yang & Scott E. Carrell, 2021. "Congestion on the Information Superhighway: Does Economics Have a Working Papers Problem?," NBER Working Papers 29153, National Bureau of Economic Research, Inc.
    3. Björk, Bo-Christer & Solomon, David, 2013. "The publishing delay in scholarly peer-reviewed journals," Journal of Informetrics, Elsevier, vol. 7(4), pages 914-923.
    4. Si Shen & Ronald Rousseau & Dongbo Wang & Danhao Zhu & Huoyu Liu & Ruilun Liu, 2015. "Editorial delay and its relation to subsequent citations: the journals Nature, Science and Cell," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1867-1873, December.
    5. Mario de Marchi & Maurizio Rocchi, 2001. "The editorial policies of scientific journals: Testing an impact factor model," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(2), pages 395-404, June.
    6. repec:bla:jamist:v:63:y:2012:i:1:p:98-107 is not listed on IDEAS
    7. Ciriaco Andrea D’Angelo & Nees Jan Eck, 2020. "Collecting large-scale publication data at the level of individual researchers: a practical proposal for author name disambiguation," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 883-907, May.
    8. repec:bla:jamest:v:51:y:2000:i:2:p:158-165 is not listed on IDEAS
    9. Wen-Yau Cathy Lin, 2021. "Effects of open access and articles-in-press mechanisms on publishing lag and first-citation speed: a case on energy and fuels journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4841-4869, June.
    10. Kong, Ling & Wang, Dongbo, 2020. "Comparison of citations and attention of cover and non-cover papers," Journal of Informetrics, Elsevier, vol. 14(4).
    11. Ruilu Yang & Qiang Wu & Yundong Xie, 2023. "Are scientific articles involving corporations associated with higher citations and views? an analysis of the top journals in business research," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5659-5685, October.
    12. Zehra Taşkın & Abdülkadir Taşkın & Güleda Doğan & Emanuel Kulczycki, 2022. "Factors affecting time to publication in information science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7499-7515, December.
    13. Alfredo Yegros Yegros & Carlos B. Amat, 2009. "Editorial delay of food research papers is influenced by authors’ experience but not by country of origin of the manuscripts," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 367-380, November.
    14. Zhenquan Lin & Shanci Hou & Jinshan Wu, 2016. "The correlation between editorial delay and the ratio of highly cited papers in Nature, Science and Physical Review Letters," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1457-1464, June.
    15. Bornmann, Lutz & Williams, Richard, 2013. "How to calculate the practical significance of citation impact differences? An empirical example from evaluative institutional bibliometrics using adjusted predictions and marginal effects," Journal of Informetrics, Elsevier, vol. 7(2), pages 562-574.
    16. Syed Hasan & Robert Breunig, 2021. "Article length and citation outcomes," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7583-7608, September.
    17. Ma, Chao & Li, Yiwei & Guo, Feng & Si, Kao, 2019. "The citation trap: Papers published at year-end receive systematically fewer citations," Journal of Economic Behavior & Organization, Elsevier, vol. 166(C), pages 667-687.
    18. Paul Sebo & Jean Pascal Fournier & Claire Ragot & Pierre-Henri Gorioux & François R. Herrmann & Hubert Maisonneuve, 2019. "Factors associated with publication speed in general medical journals: a retrospective study of bibliometric data," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1037-1058, May.
    19. Vieira, E.S. & Gomes, J.A.N.F., 2010. "Citations to scientific articles: Its distribution and dependence on the article features," Journal of Informetrics, Elsevier, vol. 4(1), pages 1-13.
    20. Pedro Cosme Costa Vieira, 2008. "An economics journals' ranking that takes into account the number of pages and co-authors," Applied Economics, Taylor & Francis Journals, vol. 40(7), pages 853-861.
    21. Guang Yu & Rui Guo & Yi-Jun Li, 2006. "The influence of publication delays on three ISI indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(3), pages 511-527, December.
    22. Dalibor Fiala & Cecília Havrilová & Martin Dostal & Ján Paralič, 2016. "Editorial Board Membership, Time to Accept, and the Effect on the Citation Counts of Journal Articles," Publications, MDPI, vol. 4(3), pages 1-8, July.
    23. Richard Williams, 2012. "Using the margins command to estimate and interpret adjusted predictions and marginal effects," Stata Journal, StataCorp LP, vol. 12(2), pages 308-331, June.
    24. Sandra Rousseau & Ronald Rousseau, 2012. "Interactions between journal attributes and authors' willingness to wait for editorial decisions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(6), pages 1213-1225, June.
    25. Battiston, Pietro & Sacco, Pier Luigi & Stanca, Luca, 2022. "Cover effects on citations uncovered: Evidence from Nature," Journal of Informetrics, Elsevier, vol. 16(2).
    26. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    27. Maarten L. Buis, 2010. "Stata tip 87: Interpretation of interactions in nonlinear models," Stata Journal, StataCorp LP, vol. 10(2), pages 305-308, June.
    28. Abdullah Gök & John Rigby & Philip Shapira, 2016. "The impact of research funding on scientific outputs: Evidence from six smaller European countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 715-730, March.
    29. Donner, Paul, 2018. "Effect of publication month on citation impact," Journal of Informetrics, Elsevier, vol. 12(1), pages 330-343.
    30. Guo, Xiaolong & Li, Xiaoxiao & Yu, Yugang, 2021. "Publication delay adjusted impact factor: The effect of publication delay of articles on journal impact factor," Journal of Informetrics, Elsevier, vol. 15(1).
    31. repec:bla:jamist:v:63:y:2012:i:6:p:1213-1225 is not listed on IDEAS
    32. Zhentao Liang & Jin Mao & Gang Li, 2023. "Bias against scientific novelty: A prepublication perspective," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 99-114, January.
    33. Elise S. Brezis & Aliaksandr Birukou, 2020. "Arbitrariness in the peer review process," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 393-411, April.
    34. Estevao Alves-Silva & Ana Carolina Figueira Porto & Carine Firmino & Henrique Venancio Silva & Ingrid Becker & Liegy Resende & Livia Borges & Luana Pfeffer & Marcela Silvano & Melina Santos Galdiano &, 2016. "Are the impact factor and other variables related to publishing time in ecology journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1445-1453, September.
    35. Yezhu Wang & Yundong Xie & Dong Wang & Lu Guo & Rongting Zhou, 2022. "Do cover papers get better citations and usage counts? An analysis of 42 journals in cell biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3793-3813, July.
    36. Fereshteh Didegah & Timothy D. Bowman & Kim Holmberg, 2018. "On the differences between citations and altmetrics: An investigation of factors driving altmetrics versus citations for finnish articles," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(6), pages 832-843, June.
    37. Jingda Ding & Dehui Du, 2023. "A study of the correlation between publication delays and measurement indicators of journal articles in the social network environment—based on online data in PLOS," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1711-1743, March.
    38. Dongbo Shi & Ronald Rousseau & Liu Yang & Jiang Li, 2017. "A journal's impact factor is influenced by changes in publication delays of citing journals," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(3), pages 780-789, March.
    39. Guang Yu & Rui Guo & Da-Ren Yu, 2006. "The influence of the publication delay on journal rankings according to the impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(2), pages 201-211, May.
    40. David J. Solomon & Bo-Christer Björk, 2012. "Publication fees in open access publishing: Sources of funding and factors influencing choice of journal," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(1), pages 98-107, January.
    41. Emre Sarigöl & David Garcia & Ingo Scholtes & Frank Schweitzer, 2017. "Quantifying the effect of editor–author relations on manuscript handling times," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 609-631, October.
    42. Bayar, Onur & Chemmanur, Thomas J., 2021. "A model of the editorial process in academic journals," Research Policy, Elsevier, vol. 50(9).
    43. Sun, Zhuanlan & Liu, Sheng & Li, Yiwei & Ma, Chao, 2023. "Expedited editorial decision in COVID-19 pandemic," Journal of Informetrics, Elsevier, vol. 17(1).
    44. Maciej J. Mrowinski & Agata Fronczak & Piotr Fronczak & Olgica Nedic & Marcel Ausloos, 2016. "Review time in peer review: quantitative analysis and modelling of editorial workflows," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(1), pages 271-286, April.
    45. Minxian Zheng & Kuangji Zhao & Shikui Zhao & Yantong Zhang, 2020. "Effecting variables of journal’s ranking in forestry field," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 135-151, October.
    46. Marco Pautasso & Hanno Schäfer, 2010. "Peer review delay and selectivity in ecology journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 307-315, August.
    47. Mark J. McCabe & Christopher M. Snyder, 2005. "Open Access and Academic Journal Quality," American Economic Review, American Economic Association, vol. 95(2), pages 453-459, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Minxian Zheng & Kuangji Zhao & Shikui Zhao & Yantong Zhang, 2020. "Effecting variables of journal’s ranking in forestry field," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 135-151, October.
    2. Jingda Ding & Dehui Du, 2023. "A study of the correlation between publication delays and measurement indicators of journal articles in the social network environment—based on online data in PLOS," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1711-1743, March.
    3. Hou, Li & Wu, Qiang & Xie, Yundong, 2024. "Does open identity of peer reviewers positively relate to citations?," Journal of Informetrics, Elsevier, vol. 18(1).
    4. Yezhu Wang & Yundong Xie & Dong Wang & Lu Guo & Rongting Zhou, 2022. "Do cover papers get better citations and usage counts? An analysis of 42 journals in cell biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3793-3813, July.
    5. Estevao Alves-Silva & Ana Carolina Figueira Porto & Carine Firmino & Henrique Venancio Silva & Ingrid Becker & Liegy Resende & Livia Borges & Luana Pfeffer & Marcela Silvano & Melina Santos Galdiano &, 2016. "Are the impact factor and other variables related to publishing time in ecology journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1445-1453, September.
    6. Si Shen & Ronald Rousseau & Dongbo Wang & Danhao Zhu & Huoyu Liu & Ruilun Liu, 2015. "Editorial delay and its relation to subsequent citations: the journals Nature, Science and Cell," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1867-1873, December.
    7. Lokman Tutuncu, 2023. "All-pervading insider bias alters review time in Turkish university journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3743-3791, June.
    8. Kong, Ling & Wang, Dongbo, 2020. "Comparison of citations and attention of cover and non-cover papers," Journal of Informetrics, Elsevier, vol. 14(4).
    9. Dalibor Fiala & Cecília Havrilová & Martin Dostal & Ján Paralič, 2016. "Editorial Board Membership, Time to Accept, and the Effect on the Citation Counts of Journal Articles," Publications, MDPI, vol. 4(3), pages 1-8, July.
    10. Geoffrey S. Shideler & Rafael J. Araújo, 2017. "Reviewer interest in a manuscript may predict its future citation potential," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1171-1176, November.
    11. Emre Sarigöl & David Garcia & Ingo Scholtes & Frank Schweitzer, 2017. "Quantifying the effect of editor–author relations on manuscript handling times," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 609-631, October.
    12. Mingyang Wang & Zhenyu Wang & Guangsheng Chen, 2019. "Which can better predict the future success of articles? Bibliometric indices or alternative metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1575-1595, June.
    13. Liu, Jialin & Chen, Hongkan & Liu, Zhibo & Bu, Yi & Gu, Weiye, 2022. "Non-linearity between referencing behavior and citation impact: A large-scale, discipline-level analysis," Journal of Informetrics, Elsevier, vol. 16(3).
    14. Janine Huisman & Jeroen Smits, 2017. "Duration and quality of the peer review process: the author’s perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 633-650, October.
    15. Tsung-An Chen & Ming-Hwai Lin & Yu-Chun Chen & Tzeng-Ji Chen, 2024. "The Time from Submission to Publication in Primary Health Care Journals: A Cross-Sectional Study," Publications, MDPI, vol. 12(2), pages 1-10, April.
    16. Zhentao Liang & Jin Mao & Gang Li, 2023. "Bias against scientific novelty: A prepublication perspective," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 99-114, January.
    17. Barbara Dluhosch, 2018. "Trade, Inequality, and Subjective Well-Being: Getting at the Roots of the Backlash Against Globalization," LIS Working papers 741, LIS Cross-National Data Center in Luxembourg.
    18. Wen-Yau Cathy Lin, 2021. "Effects of open access and articles-in-press mechanisms on publishing lag and first-citation speed: a case on energy and fuels journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4841-4869, June.
    19. Zhenquan Lin & Shanci Hou & Jinshan Wu, 2016. "The correlation between editorial delay and the ratio of highly cited papers in Nature, Science and Physical Review Letters," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1457-1464, June.
    20. Paul Sebo & Jean Pascal Fournier & Claire Ragot & Pierre-Henri Gorioux & François R. Herrmann & Hubert Maisonneuve, 2019. "Factors associated with publication speed in general medical journals: a retrospective study of bibliometric data," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1037-1058, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:18:y:2024:i:2:s1751157724000178. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.