Saint Matthew strikes again: An agent-based model of peer review and the scientific community structure
Author
Abstract
Suggested Citation
DOI: 10.1016/j.joi.2011.12.005
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Viner, Neil & Powell, Philip & Green, Rod, 2004. "Institutionalized biases in the award of research grants: a preliminary analysis revisiting the principle of accumulative advantage," Research Policy, Elsevier, vol. 33(3), pages 443-454, April.
- Flaminio Squazzoni & Károly Takács, 2011. "Social Simulation That 'Peers into Peer Review'," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 14(4), pages 1-3.
- Christine Wennerås & Agnes Wold, 1997. "Nepotism and sexism in peer-review," Nature, Nature, vol. 387(6631), pages 341-343, May.
- David N. Laband, 1990. "Is There Value-Added from the Review Process in Economics?: Preliminary Evidence from Authors," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 105(2), pages 341-352.
- Riccardo Boero & Giangiacomo Bravo & Marco Castellani & Flaminio Squazzoni, 2010. "Why Bother with What Others Tell You? An Experimental Data-Driven Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 13(3), pages 1-6.
- Bornmann, Lutz & Daniel, Hans-Dieter, 2007. "Gatekeepers of science—Effects of external reviewers’ attributes on the assessments of fellowship applications," Journal of Informetrics, Elsevier, vol. 1(1), pages 83-91.
- S. Thurner & R. Hanel, 2011. "Peer-review in a world with rational scientists: Toward selection of the average," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 84(4), pages 707-711, December.
- Jonathan Grant & Simon Burden & Gillian Breen, 1997. "No evidence of sexism in peer review," Nature, Nature, vol. 390(6659), pages 438-438, December.
- N. Gilbert, 1997. "A Simulation of the Structure of Academic Science," Sociological Research Online, , vol. 2(2), pages 91-105, June.
- Riccardo Boero & Flaminio Squazzoni, 2005. "Does Empirical Embeddedness Matter? Methodological Issues on Agent-Based Models for Analytical Social Science," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 8(4), pages 1-6.
- Bornmann, Lutz & Leydesdorff, Loet & Van den Besselaar, Peter, 2010. "A meta-evaluation of scientific research proposals: Different ways of comparing rejected to awarded applications," Journal of Informetrics, Elsevier, vol. 4(3), pages 211-220.
- Matthew RE Symonds & Neil J Gemmell & Tamsin L Braisher & Kylie L Gorringe & Mark A Elgar, 2006. "Gender Differences in Publication Output: Towards an Unbiased Metric of Research Performance," PLOS ONE, Public Library of Science, vol. 1(1), pages 1-5, December.
- Laband, David N & Piette, Michael J, 1994. "Favoritism versus Search for Good Papers: Empirical Evidence Regarding the Behavior of Journal Editors," Journal of Political Economy, University of Chicago Press, vol. 102(1), pages 194-203, February.
- Bornmann, Lutz & Daniel, Hans-Dieter, 2007. "Convergent validation of peer review decisions using the h index," Journal of Informetrics, Elsevier, vol. 1(3), pages 204-213.
- Upali W. Jayasinghe & Herbert W. Marsh & Nigel Bond, 2006. "A new reader trial approach to peer review in funding research grants: An Australian experiment," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(3), pages 591-606, December.
- Marsh, Herbert W. & Jayasinghe, Upali W. & Bond, Nigel W., 2011. "Gender differences in peer reviews of grant applications: A substantive-methodological synergy in support of the null hypothesis model," Journal of Informetrics, Elsevier, vol. 5(1), pages 167-180.
- Paul J Roebber & David M Schultz, 2011. "Peer Review, Program Officers and Science Funding," PLOS ONE, Public Library of Science, vol. 6(4), pages 1-6, April.
- Paul Ormerod & Greg Wiltshire, 2009. "‘Binge’ drinking in the UK: a social network phenomenon," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 8(2), pages 135-152, December.
- Bornmann, Lutz & Mutz, Rüdiger & Daniel, Hans-Dieter, 2008. "How to detect indications of potential sources of bias in peer review: A generalized latent variable modeling approach exemplified by a gender study," Journal of Informetrics, Elsevier, vol. 2(4), pages 280-287.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Tol, Richard S.J., 2013.
"The Matthew effect for cohorts of economists,"
Journal of Informetrics, Elsevier, vol. 7(2), pages 522-527.
- Richard S. J. Tol, 2013. "The Matthew Effect for Cohorts of Economists," Working Paper Series 5513, Department of Economics, University of Sussex Business School.
- Abramo, Giovanni & D'Angelo, CiriacoAndrea & Di Costa, Flavia, 2024. "The moderating role of personal characteristics of authors in the publications’ quality for quantity trade-off," Journal of Informetrics, Elsevier, vol. 18(1).
- Bravo, Giangiacomo & Farjam, Mike & Grimaldo Moreno, Francisco & Birukou, Aliaksandr & Squazzoni, Flaminio, 2018. "Hidden connections: Network effects on editorial decisions in four computer science journals," Journal of Informetrics, Elsevier, vol. 12(1), pages 101-112.
- Zheng Xie & Zonglin Xie & Miao Li & Jianping Li & Dongyun Yi, 2017. "Modeling the coevolution between citations and coauthorship of scientific papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 483-507, July.
- Pawel Sobkowicz, 2015. "Innovation Suppression and Clique Evolution in Peer-Review-Based, Competitive Research Funding Systems: An Agent-Based Model," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(2), pages 1-13.
- Katchanov, Yurij L. & Markova, Yulia V. & Shmatko, Natalia A., 2023. "Empirical demonstration of the Matthew effect in scientific research careers," Journal of Informetrics, Elsevier, vol. 17(4).
- Federico Bianchi & Francisco Grimaldo & Giangiacomo Bravo & Flaminio Squazzoni, 2018. "The peer review game: an agent-based model of scientists facing resource constraints and institutional pressures," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1401-1420, September.
- Thomas Feliciani & Junwen Luo & Lai Ma & Pablo Lucas & Flaminio Squazzoni & Ana Marušić & Kalpana Shankar, 2019. "A scoping review of simulation models of peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 555-594, October.
- Lukac, Martin & Grow, André, 2020. "Reputation systems and recruitment in online labor markets: insights from an agent-based model," LSE Research Online Documents on Economics 114454, London School of Economics and Political Science, LSE Library.
- Simone Righi & Károly Takács, 2017.
"The miracle of peer review and development in science: an agent-based model,"
Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 587-607, October.
- Simone Righi & Karoly Takacs, 2016. "The Miracle of Peer Review and Development inScience: An Agent-Based Model," Center for the Analysis of Public Policies (CAPP) 0144, Universita di Modena e Reggio Emilia, Dipartimento di Economia "Marco Biagi".
- Martin Lukac & André Grow, 2021. "Reputation systems and recruitment in online labor markets: insights from an agent-based model," Journal of Computational Social Science, Springer, vol. 4(1), pages 207-229, May.
- Zhao, Zhi-Dan & Chen, Jiahao & Lu, Yichuan & Zhao, Na & Jiang, Dazhi & Wang, Bing-Hong, 2021. "Dynamic patterns of open review process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 582(C).
- Yun Liu & Mengya Zhang & Gupeng Zhang & Xiongxiong You, 2022. "Scientific elites versus other scientists: who are better at taking advantage of the research collaboration network?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3145-3166, June.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
- Mario Paolucci & Francisco Grimaldo, 2014. "Mechanism change in a simulation of peer review: from junk support to elitism," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 663-688, June.
- Flaminio Squazzoni, 2010. "The impact of agent-based models in the social sciences after 15 years of incursions," History of Economic Ideas, Fabrizio Serra Editore, Pisa - Roma, vol. 18(2), pages 197-234.
- Marjolijn N. Wijnen & Jorg J. M. Massen & Mariska E. Kret, 2021. "Gender bias in the allocation of student grants," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5477-5488, July.
- Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
- Pleun Arensbergen & Inge van der Weijden & Peter Besselaar, 2012. "Gender differences in scientific productivity: a persisting phenomenon?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 857-868, December.
- Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021.
"The funding-productivity-gender nexus in science, a multistage analysis,"
Research Policy, Elsevier, vol. 50(3).
- Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2019. "Nurturing knowledge? The impact of funding and family on scientific performance," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201913, University of Turin.
- Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2019. "Nurturing knowledge? The impact of funding and family on scientific performance," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 201902, University of Turin.
- Materia, V.C. & Pascucci, S. & Kolympiris, C., 2015. "Understanding the selection processes of public research projects in agriculture: The role of scientific merit," Food Policy, Elsevier, vol. 56(C), pages 87-99.
- Georgina Santos & Stéphanie Dang Van Phu, 2019. "Gender and Academic Rank in the UK," Sustainability, MDPI, vol. 11(11), pages 1-46, June.
- Albert Banal-Estañol & Qianshuo Liu & Inés Macho-Stadler & David Pérez-Castrillo, 2021.
"Similar-to-me Effects in the Grant Application Process: Applicants, Panelists, and the Likelihood of Obtaining Funds,"
Working Papers
1289, Barcelona School of Economics.
- Albert Banal-Estañol & Qianshuo Liu & Inés Macho-Stadler & Pérez-Castrillo, 2021. "Similar-to-me effects in the grant application process: Applicants, panelists, and the likelihood of obtaining funds," Economics Working Papers 1801, Department of Economics and Business, Universitat Pompeu Fabra.
- J. A. Garcia & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia, 2021. "The interplay between the reviewer’s incentives and the journal’s quality standard," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3041-3061, April.
- van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
- Bruno Frey, 2005. "Problems with Publishing: Existing State and Solutions," European Journal of Law and Economics, Springer, vol. 19(2), pages 173-190, April.
- Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019.
"Evaluation in research funding agencies: Are structurally diverse teams biased against?,"
Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
- David Pérez-Castrillo & Inés Macho-Stadler & Albert Banal-Estañol, 2016. "Evaluation in Research Funding Agencies: Are Structurally Diverse Teams Biased Against?," Working Papers 890, Barcelona School of Economics.
- Di Vaio, Gianfranco & Waldenström, Daniel & Weisdorf, Jacob, 2012.
"Citation success: Evidence from economic history journal publications,"
Explorations in Economic History, Elsevier, vol. 49(1), pages 92-104.
- Gianfranco Di Vaio & Daniel Waldenström & Jacob Weisdorf, 2009. "Citation Success: Evidence from Economic History Journal Publications," Discussion Papers 10-01, University of Copenhagen. Department of Economics.
- Gianfranco Di Vaio & Daniel Waldenström & Jacob Weisdorf, 2011. "Citation Success: Evidence from Economic History Journal Publications," Working Papers 0017, Utrecht University, Centre for Global Economic History.
- Waldenström, Daniel & Di Vaio, Gianfranco & Weisdorf, Jacob, 2010. "Citation Success: Evidence from Economic History Journal Publications," Working Paper Series 819, Research Institute of Industrial Economics, revised 20 Oct 2010.
- Jang C. Jin & E. Kwan Choi, 2014.
"Citations of Most Often Cited Economists: Do Scholarly Books Matter More than Quality Journals?,"
Pacific Economic Review, Wiley Blackwell, vol. 19(1), pages 8-24, February.
- Jin, Jang C & Choi, E Kwan, 2014. "Citations of Most Often Cited Economists: Do Scholarly Books Matter More than Quality Journals?," Staff General Research Papers Archive 37372, Iowa State University, Department of Economics.
- Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
- repec:dau:papers:123456789/8741 is not listed on IDEAS
- Glenn Ellison, 2002.
"The Slowdown of the Economics Publishing Process,"
Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
- Glenn Ellison, 2000. "The Slowdown of the Economics Publishing Process," NBER Working Papers 7804, National Bureau of Economic Research, Inc.
- Dan Johnson, 1997. "Getting Noticed in Economics: The Determinants of Academic Citations," The American Economist, Sage Publications, vol. 41(1), pages 43-52, March.
- Feliciani, Thomas & Morreau, Michael & Luo, Junwen & Lucas, Pablo & Shankar, Kalpana, 2022. "Designing grant-review panels for better funding decisions: Lessons from an empirically calibrated simulation model," Research Policy, Elsevier, vol. 51(4).
More about this item
Keywords
Peer review; Referees; Referee reliability; Matthew effect; Agent-based model;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:6:y:2012:i:2:p:265-275. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.