IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v114y2018i3d10.1007_s11192-017-2630-5.html
   My bibliography  Save this article

Journal peer review: a bar or bridge? An analysis of a paper’s revision history and turnaround time, and the effect on citation

Author

Listed:
  • J. Rigby

    (The University of Manchester)

  • D. Cox

    (The University of Manchester)

  • K. Julian

    (The University of Manchester)

Abstract

Journal peer review lies at the heart of academic quality control. This article explores the journal peer review process and seeks to examine how the reviewing process might itself contribute to papers, leading them to be more highly cited and to achieve greater recognition. Our work builds on previous observations and views expressed in the literature about (a) the role of actors involved in the research and publication process that suggest that peer review is inherent in the research process and (b) on the contribution reviewers themselves might make to the content and increased citation of papers. Using data from the journal peer review process of a single journal in the Social Sciences field (Business, Management and Accounting), we examine the effects of peer review on papers submitted to that journal including the effect upon citation, a novel step in the study of the outcome of peer review. Our detailed analysis suggests, contrary to initial assumptions, that it is not the time taken to revise papers but the actual number of revisions that leads to greater recognition for papers in terms of citation impact. Our study provides evidence, albeit limited to the case of a single journal, that the peer review process may constitute a form of knowledge production and is not the simple correction of errors contained in submitted papers.

Suggested Citation

  • J. Rigby & D. Cox & K. Julian, 2018. "Journal peer review: a bar or bridge? An analysis of a paper’s revision history and turnaround time, and the effect on citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1087-1105, March.
    • Handle: RePEc:spr:scient:v:114:y:2018:i:3:d:10.1007_s11192-017-2630-5
    DOI: 10.1007/s11192-017-2630-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2630-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2630-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Björk, Bo-Christer & Solomon, David, 2013. "The publishing delay in scholarly peer-reviewed journals," Journal of Informetrics, Elsevier, vol. 7(4), pages 914-923.
    2. Zheng Ma & Yuntao Pan & Zhenglu Yu & Jingting Wang & Jia Jia & Yishan Wu, 2013. "A quantitative study on the effectiveness of peer review for academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 1-13, April.
    3. Niccolò Casnici & Francisco Grimaldo & Nigel Gilbert & Pierpaolo Dondio & Flaminio Squazzoni, 2017. "Assessing peer review by gauging the fate of rejected manuscripts: the case of the Journal of Artificial Societies and Social Simulation," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 533-546, October.
    4. Donald O. Case & Georgeann M. Higgins, 2000. "How can we investigate citation behavior? A study of reasons for citing literature in communication," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 51(7), pages 635-645.
    5. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    6. Niccolò Casnici & Francisco Grimaldo & Nigel Gilbert & Flaminio Squazzoni, 2017. "Attitudes of referees in a multidisciplinary journal: An empirical analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(7), pages 1763-1771, July.
    7. Bruno S. Frey, 2003. "Publishing as prostitution? — Choosing between one’s own ideas and academic success," Springer Books, in: Roger D. Congleton & Kai A. Konrad & Arye L. Hillman (ed.), 40 Years of Research on Rent Seeking 2, pages 749-767, Springer.
    8. Rigby, J. & Edler, J., 2005. "Peering inside research networks: Some observations on the effect of the intensity of collaboration on the variability of research quality," Research Policy, Elsevier, vol. 34(6), pages 784-794, August.
    9. Eline Poelmans & Sandra Rousseau, 2015. "Factors determining authors’ willingness to wait for editorial decisions from economic history journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1347-1374, February.
    10. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2015. "The relationship between the number of authors of a publication, its citations and the impact factor of the publishing journal: Evidence from Italy," Journal of Informetrics, Elsevier, vol. 9(4), pages 746-761.
    11. Lowell L. Hargens & Jerald R. Herting, 2006. "Analyzing the association between referees' recommendations and editors' decisions," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(1), pages 15-26, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sun, Zhuanlan, 2024. "Textual features of peer review predict top-cited papers: An interpretable machine learning perspective," Journal of Informetrics, Elsevier, vol. 18(2).
    2. Shan Jiang, 2021. "Understanding authors' psychological reactions to peer reviews: a text mining approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6085-6103, July.
    3. Bianchi, Federico & García-Costa, Daniel & Grimaldo, Francisco & Squazzoni, Flaminio, 2022. "Measuring the effect of reviewers on manuscript change: A study on a sample of submissions to Royal Society journals (2006–2017)," Journal of Informetrics, Elsevier, vol. 16(3).
    4. Jingda Ding & Dehui Du, 2023. "A study of the correlation between publication delays and measurement indicators of journal articles in the social network environment—based on online data in PLOS," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1711-1743, March.
    5. Bianchi, Federico & Grimaldo, Francisco & Squazzoni, Flaminio, 2019. "The F3-index. Valuing reviewers for scholarly journals," Journal of Informetrics, Elsevier, vol. 13(1), pages 78-86.
    6. Balázs Győrffy & Andrea Magda Nagy & Péter Herman & Ádám Török, 2018. "Factors influencing the scientific performance of Momentum grant holders: an evaluation of the first 117 research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 409-426, October.
    7. Daniel A. Charen & Nolan A. Maher & Nicole Zubizarreta & Jashvant Poeran & Calin S. Moucha & Shai Shemesh, 2020. "Evaluation of publication delays in the orthopedic surgery manuscript review process from 2010 to 2015," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1127-1135, August.
    8. J. A. Garcia & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2019. "The optimal amount of information to provide in an academic manuscript," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1685-1705, December.
    9. Akbaritabar, Aliakbar & Stephen, Dimity & Squazzoni, Flaminio, 2022. "A study of referencing changes in preprint-publication pairs across multiple fields," Journal of Informetrics, Elsevier, vol. 16(2).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Justus Haucap & Nima Moshgbar & W. Benedikt Schmal, 2021. "The impact of the German 'DEAL' on competition in the academic publishing market," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 2027-2049, December.
    2. Bianchi, Federico & Grimaldo, Francisco & Squazzoni, Flaminio, 2019. "The F3-index. Valuing reviewers for scholarly journals," Journal of Informetrics, Elsevier, vol. 13(1), pages 78-86.
    3. Rodrigo Dorantes-Gilardi & Aurora A. Ramírez-Álvarez & Diana Terrazas-Santamaría, 2023. "Is there a differentiated gender effect of collaboration with super-cited authors? Evidence from junior researchers in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2317-2336, April.
    4. Paul Sebo & Jean Pascal Fournier & Claire Ragot & Pierre-Henri Gorioux & François R. Herrmann & Hubert Maisonneuve, 2019. "Factors associated with publication speed in general medical journals: a retrospective study of bibliometric data," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1037-1058, May.
    5. Püttmann, Vitus & Thomsen, Stephan L. & Trunzer, Johannes, 2020. "Zur Relevanz von Ausstattungsunterschieden für Forschungsleistungsvergleiche: Ein Diskussionsbeitrag für die Wirtschaftswissenschaften in Deutschland," Hannover Economic Papers (HEP) dp-679, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät, revised Mar 2021.
    6. Eric W. K. Tsang & Bruno S. Frey, 2006. "The as-is journal review process: Let authors own their ideas," CREMA Working Paper Series 2006-09, Center for Research in Economics, Management and the Arts (CREMA).
    7. Janine Huisman & Jeroen Smits, 2017. "Duration and quality of the peer review process: the author’s perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 633-650, October.
    8. João Ricardo Faria & Damien Besancenot & Andreas J. Novak, 2011. "Paradigm Depletion, Knowledge Production And Research Effort: Considering Thomas Kuhn'S Ideas," Metroeconomica, Wiley Blackwell, vol. 62(4), pages 587-604, November.
    9. J. A. Garcia & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2019. "The optimal amount of information to provide in an academic manuscript," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1685-1705, December.
    10. Eline Poelmans & Sandra Rousseau, 2015. "Factors determining authors’ willingness to wait for editorial decisions from economic history journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1347-1374, February.
    11. Damien Besancenot & Kim Huynh & Joao Faria, 2012. "Search and research: the influence of editorial boards on journals’ quality," Theory and Decision, Springer, vol. 73(4), pages 687-702, October.
    12. Lucas Rodriguez Forti & Luiz A. Solino & Judit K. Szabo, 2021. "Trade-off between urgency and reduced editorial capacity affect publication speed in ecological and medical journals during 2020," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-9, December.
    13. Akbaritabar, Aliakbar & Stephen, Dimity & Squazzoni, Flaminio, 2022. "A study of referencing changes in preprint-publication pairs across multiple fields," Journal of Informetrics, Elsevier, vol. 16(2).
    14. Sun, Zhuanlan, 2024. "Textual features of peer review predict top-cited papers: An interpretable machine learning perspective," Journal of Informetrics, Elsevier, vol. 18(2).
    15. Lokman Tutuncu, 2023. "All-pervading insider bias alters review time in Turkish university journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3743-3791, June.
    16. Berlemann, Michael & Haucap, Justus, 2015. "Which factors drive the decision to opt out of individual research rankings? An empirical study of academic resistance to change," Research Policy, Elsevier, vol. 44(5), pages 1108-1115.
    17. Justus Haucap & Tobias Hartwich & André Uhde, 2005. "Besonderheiten und Wettbewerbsprobleme des Marktes für wissenschaftliche Fachzeitschriften," Vierteljahrshefte zur Wirtschaftsforschung / Quarterly Journal of Economic Research, DIW Berlin, German Institute for Economic Research, vol. 74(3), pages 85-107.
    18. Minxian Zheng & Kuangji Zhao & Shikui Zhao & Yantong Zhang, 2020. "Effecting variables of journal’s ranking in forestry field," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 135-151, October.
    19. Estevao Alves-Silva & Ana Carolina Figueira Porto & Carine Firmino & Henrique Venancio Silva & Ingrid Becker & Liegy Resende & Livia Borges & Luana Pfeffer & Marcela Silvano & Melina Santos Galdiano &, 2016. "Are the impact factor and other variables related to publishing time in ecology journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1445-1453, September.
    20. Berlemann, Michael & Haucap, Justus, 2012. "Which factors drive the decision to boycott and opt out of research rankings? A note," DICE Discussion Papers 72, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:114:y:2018:i:3:d:10.1007_s11192-017-2630-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.