IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v95y2013i1d10.1007_s11192-012-0879-2.html
   My bibliography  Save this article

A quantitative study on the effectiveness of peer review for academic journals

Author

Listed:
  • Zheng Ma

    (Institute of Scientific and Technical Information of China
    ISTIC-Thomson Reuters Joint Lab for Scientometrics Research)

  • Yuntao Pan

    (Institute of Scientific and Technical Information of China
    ISTIC-Thomson Reuters Joint Lab for Scientometrics Research)

  • Zhenglu Yu

    (Institute of Scientific and Technical Information of China)

  • Jingting Wang

    (Institute of Scientific and Technical Information of China)

  • Jia Jia

    (Peking University)

  • Yishan Wu

    (Institute of Scientific and Technical Information of China)

Abstract

Peer review is a classic method in the field of quality analysis, but the effectiveness of peer reviewing has never been researched using quantity analysis indicators. A new indicator for academic journals, Effectiveness of Peer Review (EPR), is defined for evaluating the effectiveness of peer reviewing. If the assumption is valid, EPR could be a simple indicator of such effectiveness. In a sample experiment, 28 academic journals were tested, and the EPR indicator was able to reflect accurately the academic impact of those journals.

Suggested Citation

  • Zheng Ma & Yuntao Pan & Zhenglu Yu & Jingting Wang & Jia Jia & Yishan Wu, 2013. "A quantitative study on the effectiveness of peer review for academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 1-13, April.
    • Handle: RePEc:spr:scient:v:95:y:2013:i:1:d:10.1007_s11192-012-0879-2
    DOI: 10.1007/s11192-012-0879-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-012-0879-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-012-0879-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anthony F. J. van Raan, 2004. "Sleeping Beauties in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 59(3), pages 467-472, March.
    2. Spiro Stefanou & Kristiaan Kerstens, 2008. "Applied production analysis unveiled in open peer review: introductory remarks," Journal of Productivity Analysis, Springer, vol. 30(1), pages 1-6, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    2. Aurora A. C. Teixeira & Pedro Cosme Vieira & Ana Patrícia Abreu, 2017. "Sleeping Beauties and their princes in innovation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 541-580, February.
    3. J. Rigby & D. Cox & K. Julian, 2018. "Journal peer review: a bar or bridge? An analysis of a paper’s revision history and turnaround time, and the effect on citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1087-1105, March.
    4. Niccolò Casnici & Francisco Grimaldo & Nigel Gilbert & Pierpaolo Dondio & Flaminio Squazzoni, 2017. "Assessing peer review by gauging the fate of rejected manuscripts: the case of the Journal of Artificial Societies and Social Simulation," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 533-546, October.
    5. J. A. Garcia & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2019. "The optimal amount of information to provide in an academic manuscript," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1685-1705, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kosmulski, Marek, 2009. "New seniority-independent Hirsch-type index," Journal of Informetrics, Elsevier, vol. 3(4), pages 341-347.
    2. Leo Egghe, 2007. "Probabilities for encountering genius, basic, ordinary or insignificant papers based on the cumulative nth citation distribution," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(1), pages 167-181, January.
    3. Thomas R. Anderson & Robin K. S. Hankin & Peter D. Killworth, 2008. "Beyond the Durfee square: Enhancing the h-index to score total publication output," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(3), pages 577-588, September.
    4. Zeng, Carl J. & Qi, Eric P. & Li, Simon S. & Stanley, H. Eugene & Ye, Fred Y., 2017. "Statistical characteristics of breakthrough discoveries in science using the metaphor of black and white swans," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 487(C), pages 40-46.
    5. Min, Chao & Sun, Jianjun & Pei, Lei & Ding, Ying, 2016. "Measuring delayed recognition for papers: Uneven weighted summation and total citations," Journal of Informetrics, Elsevier, vol. 10(4), pages 1153-1165.
    6. Thomas Heinze, 2013. "Creative accomplishments in science: definition, theoretical considerations, examples from science history, and bibliometric findings," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 927-940, June.
    7. Aurora A. C. Teixeira & Pedro Cosme Vieira & Ana Patrícia Abreu, 2017. "Sleeping Beauties and their princes in innovation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 541-580, February.
    8. Norio Ohba & Kumiko Nakao, 2012. "Sleeping beauties in ophthalmology," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 253-264, November.
    9. Hu, Zewen & Wu, Yishan, 2014. "Regularity in the time-dependent distribution of the percentage of never-cited papers: An empirical pilot study based on the six journals," Journal of Informetrics, Elsevier, vol. 8(1), pages 136-146.
    10. Liang, Liming & Zhong, Zhen & Rousseau, Ronald, 2015. "Uncited papers, uncited authors and uncited topics: A case study in library and information science," Journal of Informetrics, Elsevier, vol. 9(1), pages 50-58.
    11. Tóth, István & Lázár, Zsolt I. & Varga, Levente & Járai-Szabó, Ferenc & Papp, István & Florian, Răzvan V. & Ercsey-Ravasz, Mária, 2021. "Mitigating ageing bias in article level metrics using citation network analysis," Journal of Informetrics, Elsevier, vol. 15(1).
    12. Du, Jian & Li, Peixin & Haunschild, Robin & Sun, Yinan & Tang, Xiaoli, 2020. "Paper-patent citation linkages as early signs for predicting delayed recognized knowledge: Macro and micro evidence," Journal of Informetrics, Elsevier, vol. 14(2).
    13. Jianhua Hou & Xiucai Yang, 2019. "Patent sleeping beauties: evolutionary trajectories and identification methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 187-215, July.
    14. Jiang Li & Fred Y. Ye, 2012. "The phenomenon of all-elements-sleeping-beauties in scientific literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 795-799, September.
    15. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    16. Colavizza, Giovanni & Franceschet, Massimo, 2016. "Clustering citation histories in the Physical Review," Journal of Informetrics, Elsevier, vol. 10(4), pages 1037-1051.
    17. James Hartley & Yuh-Shan Ho, 2017. "Who woke the sleeping beauties in psychology?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1065-1068, August.
    18. Wang, Jian & Hicks, Diana, 2015. "Scientific teams: Self-assembly, fluidness, and interdependence," Journal of Informetrics, Elsevier, vol. 9(1), pages 197-207.
    19. Peter Kokol & Helena Blažun Vošner & Jernej Završnik, 2020. "Do simultaneous inventions sleep? A case study on nursing sleeping papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2827-2832, December.
    20. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:95:y:2013:i:1:d:10.1007_s11192-012-0879-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.