Examining the Predictive Validity of NIH Peer Review Scores
Author
Abstract
Suggested Citation
DOI: 10.1371/journal.pone.0126938
Download full text from publisher
References listed on IDEAS
- John P A Ioannidis, 2005. "Why Most Published Research Findings Are False," PLOS Medicine, Public Library of Science, vol. 2(8), pages 1-1, August.
- Alison Abbott & David Cyranoski & Nicola Jones & Brendan Maher & Quirin Schiermeier & Richard Van Noorden, 2010. "Metrics: Do metrics matter?," Nature, Nature, vol. 465(7300), pages 860-862, June.
- Terrence A. Brooks, 1985. "Private acts and public objects: An investigation of citer motivations," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 36(4), pages 223-229, July.
- McMillan, G. Steven & Narin, Francis & Deeds, David L., 2000. "An analysis of the critical role of public science in innovation: the case of biotechnology," Research Policy, Elsevier, vol. 29(1), pages 1-8, January.
- Hendrik P. van Dalen & Kène Henkens, 2012.
"Intended and unintended consequences of a publish‐or‐perish culture: A worldwide survey,"
Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(7), pages 1282-1293, July.
- Hendrik P. van Dalen & Kène Henkens, 2012. "Intended and unintended consequences of a publish-or-perish culture: A worldwide survey," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(7), pages 1282-1293, July.
- van Dalen, H.P. & Henkens, C.J.I.M., 2012. "Intended and Unintended Consequences of a Publish-or-Perish Culture : A Worldwide Survey," Other publications TiSEM ea850a8f-b067-4fc7-9dbe-b, Tilburg University, School of Economics and Management.
- van Dalen, H.P. & Henkens, C.J.I.M., 2012. "Intended and Unintended Consequences of a Publish-or-Perish Culture : A Worldwide Survey," Discussion Paper 2012-003, Tilburg University, Center for Economic Research.
- Katz, David A, 1973. "Faculty Salaries, Promotion, and Productivity at a Large University," American Economic Review, American Economic Association, vol. 63(3), pages 469-477, June.
- James S. Fairweather, 2005. "Beyond the Rhetoric: Trends in the Relative Value of Teaching and Research in Faculty Salaries," The Journal of Higher Education, Taylor & Francis Journals, vol. 76(4), pages 401-422, July.
- Peter A. Lawrence, 2003. "The politics of publication," Nature, Nature, vol. 422(6929), pages 259-261, March.
- Neal S Young, 2008. "Why Current Publication May Distort Science," Working Papers id:1757, eSocialSciences.
- repec:bla:germec:v:9:y:2008:i::p:457-472 is not listed on IDEAS
- Neal S Young & John P A Ioannidis & Omar Al-Ubaydli, 2008. "Why Current Publication Practices May Distort Science," PLOS Medicine, Public Library of Science, vol. 5(10), pages 1-5, October.
- Moore, William J & Newman, Robert J & Turnbull, Geoffrey K, 2001. "Reputational Capital and Academic Pay," Economic Inquiry, Western Economic Association International, vol. 39(4), pages 663-671, October.
- C. Glenn Begley & Lee M. Ellis, 2012. "Raise standards for preclinical cancer research," Nature, Nature, vol. 483(7391), pages 531-533, March.
- Daniele Fanelli, 2010. "Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-7, April.
- Stuart Macdonald & Jacqueline Kam, 2007. "Ring a Ring o’ Roses: Quality Journals and Gamesmanship in Management Studies," Journal of Management Studies, Wiley Blackwell, vol. 44(4), pages 640-655, June.
- Ted I. K. Youn & Tanya M. Price, 2009. "Learning from the Experience of Others: The Evolution of Faculty Tenure and Promotion Rules in Comprehensive Institutions," The Journal of Higher Education, Taylor & Francis Journals, vol. 80(2), pages 204-237, March.
- Daniele Fanelli, 2012. "Negative results are disappearing from most disciplines and countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 891-904, March.
- Moore, William J & Newman, Robert J & Turnbull, Geoffrey K, 1998. "Do Academic Salaries Decline with Seniority?," Journal of Labor Economics, University of Chicago Press, vol. 16(2), pages 352-366, April.
- Michael Graber & Andrey Launov & Klaus Wälde, 2008.
"Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland,"
German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 457-472, November.
- Graber Michael & Wälde Klaus, 2008. "Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland," German Economic Review, De Gruyter, vol. 9(4), pages 457-472, December.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Elena A. Erosheva & Patrícia Martinková & Carole J. Lee, 2021. "When zero may not be zero: A cautionary note on the use of inter‐rater reliability in evaluating grant peer review," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(3), pages 904-919, July.
- Kevin W. Boyack & Caleb Smith & Richard Klavans, 2018. "Toward predicting research proposal success," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 449-461, February.
- Gemma Elizabeth Derrick & Alessandra Zimmermann & Helen Greaves & Jonathan Best & Richard Klavans, 2024. "Targeted, actionable and fair: Reviewer reports as feedback and its effect on ECR career choices," Research Evaluation, Oxford University Press, vol. 32(4), pages 648-657.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Joeri K Tijdink & Anton C M Vergouwen & Yvo M Smulders, 2013. "Publication Pressure and Burn Out among Dutch Medical Professors: A Nationwide Survey," PLOS ONE, Public Library of Science, vol. 8(9), pages 1-6, September.
- Omar Al-Ubaydli & John A. List, 2015.
"Do Natural Field Experiments Afford Researchers More or Less Control than Laboratory Experiments? A Simple Model,"
NBER Working Papers
20877, National Bureau of Economic Research, Inc.
- Omar Al-Ubaydli & John List, 2015. "Do Natural Field Experiments Afford Researchers More or Less Control than Laboratory Experiments? A Simple Model," Artefactual Field Experiments 00458, The Field Experiments Website.
- Mangirdas Morkunas & Elzė Rudienė & Lukas Giriūnas & Laura Daučiūnienė, 2020. "Assessment of Factors Causing Bias in Marketing- Related Publications," Publications, MDPI, vol. 8(4), pages 1-16, October.
- van Aert, Robbie Cornelis Maria, 2018. "Dissertation R.C.M. van Aert," MetaArXiv eqhjd, Center for Open Science.
- Daniele Fanelli & Vincent Larivière, 2016. "Researchers’ Individual Publication Rate Has Not Increased in a Century," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-12, March.
- Michael J. Hilmer & Michael R. Ransom & Christiana E. Hilmer, 2015.
"Fame and the fortune of academic economists: How the market rewards influential research in economics,"
Southern Economic Journal, John Wiley & Sons, vol. 82(2), pages 430-452, October.
- Hilmer, Christiana E. & Hilmer, Michael J. & Ransom, Michael R., 2012. "Fame and the Fortune of Academic Economists: How the Market Rewards Influential Research in Economics," IZA Discussion Papers 6960, Institute of Labor Economics (IZA).
- Robbie C M van Aert & Marcel A L M van Assen, 2017. "Bayesian evaluation of effect size after replicating an original study," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-23, April.
- Oliver Braganza, 2020. "A simple model suggesting economically rational sample-size choice drives irreproducibility," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-19, March.
- Daniele Fanelli & Rodrigo Costas & Vincent Larivière, 2015. "Misconduct Policies, Academic Culture and Career Stage, Not Gender or Pressures to Publish, Affect Scientific Integrity," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-18, June.
- Ilya Prakhov & Victor Rudakov, 2018. "The Determinants of Faculty Pay in Russian Universities: Incentive Contracts," HSE Working papers WP BRP 47/EDU/2018, National Research University Higher School of Economics.
- Frederique Bordignon, 2020. "Self-correction of science: a comparative study of negative citations and post-publication peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1225-1239, August.
- Dell'Anno, Roberto & Caferra, Rocco & Morone, Andrea, 2020.
"A “Trojan Horse” in the peer-review process of fee-charging economic journals,"
Journal of Informetrics, Elsevier, vol. 14(3).
- Rocco Caferra & Roberto Dell'Anno & Andrea Morone, 2020. "A "Trojan Horse" in the peer-review process of fee-charging economic journals," Framed Field Experiments 00701, The Field Experiments Website.
- Colin F. Camerer & Anna Dreber & Felix Holzmeister & Teck-Hua Ho & Jürgen Huber & Magnus Johannesson & Michael Kirchler & Gideon Nave & Brian A. Nosek & Thomas Pfeiffer & Adam Altmejd & Nick Buttrick , 2018.
"Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015,"
Nature Human Behaviour, Nature, vol. 2(9), pages 637-644, September.
- Camerer, Colin & Dreber, Anna & Holzmeister, Felix & Ho, Teck Hua & Huber, Juergen & Johannesson, Magnus & Kirchler, Michael & Nave, Gideon & Nosek, Brian A. & Pfeiffer, Thomas, 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," SocArXiv 4hmb6_v1, Center for Open Science.
- Camerer, Colin F. & Dreber, Anna & Holzmeister, Felix & Ho, Teck-Hua & Huber, Jürgen & Johannesson, Magnus & Kirchler, Michael & Nave, Gideon & Nosek, Brian A. & Pfeiffer, Thomas & Altmejd, Adam & But, 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Munich Reprints in Economics 62818, University of Munich, Department of Economics.
- Camerer, Colin & Dreber, Anna & Holzmeister, Felix & Ho, Teck Hua & Huber, Juergen & Johannesson, Magnus & Kirchler, Michael & Nave, Gideon & Nosek, Brian A. & Pfeiffer, Thomas, 2018. "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," SocArXiv 4hmb6, Center for Open Science.
- Daniele Fanelli, 2012. "Negative results are disappearing from most disciplines and countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 891-904, March.
- Christian Heise & Joshua M. Pearce, 2020. "From Open Access to Open Science: The Path From Scientific Reality to Open Scientific Communication," SAGE Open, , vol. 10(2), pages 21582440209, May.
- Necker, Sarah, 2014. "Scientific misbehavior in economics," Research Policy, Elsevier, vol. 43(10), pages 1747-1759.
- Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021.
"The effects of citation-based research evaluation schemes on self-citation behavior,"
Journal of Informetrics, Elsevier, vol. 15(4).
- Giovanni Abramo & Ciriaco Andrea D'Angelo & Leonardo Grilli, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Papers 2102.05358, arXiv.org.
- David L. Anderson & John Tressler, 2011.
"Ranking Economics Departments In Terms Of Residual Productivity: New Zealand Economics Departments, 2000–2006,"
Australian Economic Papers, Wiley Blackwell, vol. 50(4), pages 157-168, December.
- David L. Anderson & John Tressler, 2009. "Ranking Economics Departments in Terms of Residual Productivity: New Zealand Economics Departments, 2000-2006," Working Papers in Economics 09/03, University of Waikato, revised 05 Sep 2011.
- William Moore & Robert Newman & Geoffrey Turnbull, 2007. "The Experience-Earnings Profile: Productivity-Augmenting or Purely Contractual? Evidence from the UK," Journal of Labor Research, Springer, vol. 28(3), pages 417-435, July.
- Marlo M Vernon & E Andrew Balas & Shaher Momani, 2018. "Are university rankings useful to improve research? A systematic review," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0126938. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.