IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v61y2023i4d10.1007_s10614-022-10250-w.html
   My bibliography  Save this article

Incentives for Research Effort: An Evolutionary Model of Publication Markets with Double-Blind and Open Review

Author

Listed:
  • Mantas Radzvilas

    (University of Konstanz)

  • Francesco De Pretis

    (University of Modena and Reggio Emilia)

  • William Peden

    (Erasmus University Rotterdam)

  • Daniele Tortoli

    (University of Modena and Reggio Emilia)

  • Barbara Osimani

    (Marche Polytechnic University)

Abstract

Contemporary debates about scientific institutions and practice feature many proposed reforms. Most of these require increased efforts from scientists. But how do scientists’ incentives for effort interact? How can scientific institutions encourage scientists to invest effort in research? We explore these questions using a game-theoretic model of publication markets. We employ a base game between authors and reviewers, before assessing some of its tendencies by means of analysis and simulations. We compare how the effort expenditures of these groups interact in our model under a variety of settings, such as double-blind and open review systems. We make a number of findings, including that open review can increase the effort of authors in a range of circumstances and that these effects can manifest in a policy-relevant period of time. However, we find that open review’s impact on authors’ efforts is sensitive to the strength of several other influences.

Suggested Citation

  • Mantas Radzvilas & Francesco De Pretis & William Peden & Daniele Tortoli & Barbara Osimani, 2023. "Incentives for Research Effort: An Evolutionary Model of Publication Markets with Double-Blind and Open Review," Computational Economics, Springer;Society for Computational Economics, vol. 61(4), pages 1433-1476, April.
    • Handle: RePEc:kap:compec:v:61:y:2023:i:4:d:10.1007_s10614-022-10250-w
    DOI: 10.1007/s10614-022-10250-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-022-10250-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-022-10250-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Blume, Lawrence E., 2003. "How noise matters," Games and Economic Behavior, Elsevier, vol. 44(2), pages 251-271, August.
    2. Blume Lawrence E., 1993. "The Statistical Mechanics of Strategic Interaction," Games and Economic Behavior, Elsevier, vol. 5(3), pages 387-424, July.
    3. Mattsson, Lars-Goran & Weibull, Jorgen W., 2002. "Probabilistic choice and procedurally bounded rationality," Games and Economic Behavior, Elsevier, vol. 41(1), pages 61-78, October.
    4. Curtis R. Taylor & Huseyin Yildirim, 2011. "Subjective Performance and the Value of Blind Evaluation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(2), pages 762-794.
    5. Zacharias Maniadis & Fabio Tufano, 2017. "The Research Reproducibility Crisis and Economics of Science," Economic Journal, Royal Economic Society, vol. 127(605), pages 200-208, October.
    6. Hofbauer, Josef & Sandholm, William H., 2007. "Evolution in games with randomly disturbed payoffs," Journal of Economic Theory, Elsevier, vol. 132(1), pages 47-69, January.
    7. Daniel S. Hamermesh, 2013. "Six Decades of Top Economics Publishing: Who and How?," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 162-172, March.
    8. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    9. Marianne A. Ferber & Michelle Teiman, 1980. "Are Women Economists at a Disadvantage in Publishing Journal Articles?," Eastern Economic Journal, Eastern Economic Association, vol. 6(3-4), pages 189-193, Aug-Oct.
    10. Ronald L. Wasserstein & Nicole A. Lazar, 2016. "The ASA's Statement on p -Values: Context, Process, and Purpose," The American Statistician, Taylor & Francis Journals, vol. 70(2), pages 129-133, May.
    11. Alós-Ferrer, Carlos & Netzer, Nick, 2010. "The logit-response dynamics," Games and Economic Behavior, Elsevier, vol. 68(2), pages 413-427, March.
    12. Raelin, Joseph A., 2008. "Refereeing the Game of Peer Review," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 7(1), pages 124-129.
    13. Josef Hofbauer & William H. Sandholm, 2002. "On the Global Convergence of Stochastic Fictitious Play," Econometrica, Econometric Society, vol. 70(6), pages 2265-2294, November.
    14. Jeffrey T Leek & Margaret A Taub & Fernando J Pineda, 2011. "Cooperation between Referees and Authors Increases Peer Review Accuracy," PLOS ONE, Public Library of Science, vol. 6(11), pages 1-11, November.
    15. Lahkar, Ratul & Riedel, Frank, 2015. "The logit dynamic for games with continuous strategy sets," Games and Economic Behavior, Elsevier, vol. 91(C), pages 268-282.
    16. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, April.
    17. , H., 2010. "Local stability under evolutionary game dynamics," Theoretical Economics, Econometric Society, vol. 5(1), January.
    18. Sandholm, William H., 2010. "Decompositions and potentials for normal form games," Games and Economic Behavior, Elsevier, vol. 70(2), pages 446-456, November.
    19. Bernd Pulverer, 2010. "Transparency showcases strength of peer review," Nature, Nature, vol. 468(7320), pages 29-31, November.
    20. Ahmad Yaman Abdin & Muhammad Jawad Nasim & Yannick Ney & Claus Jacob, 2021. "The Pioneering Role of Sci in Post Publication Public Peer Review (P4R)," Publications, MDPI, vol. 9(1), pages 1-12, March.
    21. Federico Bianchi & Francisco Grimaldo & Giangiacomo Bravo & Flaminio Squazzoni, 2018. "The peer review game: an agent-based model of scientists facing resource constraints and institutional pressures," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1401-1420, September.
    22. David Card & Stefano DellaVigna, 2020. "What Do Editors Maximize? Evidence from Four Economics Journals," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 195-217, March.
    23. Leonid Tiokhin & Karthik Panchanathan & Daniel Lakens & Simine Vazire & Thomas Morgan & Kevin Zollman, 2021. "Honest signaling in academic publishing," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-19, February.
    24. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Sandholm, William H., 2019. "An introduction to ABED: Agent-based simulation of evolutionary game dynamics," Games and Economic Behavior, Elsevier, vol. 118(C), pages 434-462.
    25. Candogan, Ozan & Ozdaglar, Asuman & Parrilo, Pablo A., 2013. "Dynamics in near-potential games," Games and Economic Behavior, Elsevier, vol. 82(C), pages 66-90.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mantas Radzvilas & Francesco De Pretis & William Peden & Daniele Tortoli & Barbara Osimani, 2020. "Double blind vs. open review: an evolutionary game logit-simulating the behavior of authors and reviewers," Papers 2011.07797, arXiv.org.
    2. Staudigl, Mathias, 2012. "Stochastic stability in asymmetric binary choice coordination games," Games and Economic Behavior, Elsevier, vol. 75(1), pages 372-401.
    3. Lahkar, Ratul & Mukherjee, Sayan & Roy, Souvik, 2022. "Generalized perturbed best response dynamics with a continuum of strategies," Journal of Economic Theory, Elsevier, vol. 200(C).
    4. Mertikopoulos, Panayotis & Sandholm, William H., 2018. "Riemannian game dynamics," Journal of Economic Theory, Elsevier, vol. 177(C), pages 315-364.
    5. Jakub Bielawski & Thiparat Chotibut & Fryderyk Falniowski & Michal Misiurewicz & Georgios Piliouras, 2022. "Unpredictable dynamics in congestion games: memory loss can prevent chaos," Papers 2201.10992, arXiv.org, revised Jan 2022.
    6. RatulLahkar & Sayan Mukherjee & Souvik Roy, 2021. "Generalized Perturbed Best Response Dynamics with a Continuum of Strategies," Working Papers 51, Ashoka University, Department of Economics.
    7. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.
    8. Alós-Ferrer, Carlos & Netzer, Nick, 2010. "The logit-response dynamics," Games and Economic Behavior, Elsevier, vol. 68(2), pages 413-427, March.
    9. Hwang, Sung-Ha & Rey-Bellet, Luc, 2021. "Positive feedback in coordination games: Stochastic evolutionary dynamics and the logit choice rule," Games and Economic Behavior, Elsevier, vol. 126(C), pages 355-373.
    10. Carlos Alós-Ferrer & Nick Netzer, 2015. "Robust stochastic stability," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 58(1), pages 31-57, January.
    11. , & , H. & ,, 2015. "Sampling best response dynamics and deterministic equilibrium selection," Theoretical Economics, Econometric Society, vol. 10(1), January.
    12. Golman, Russell, 2012. "Homogeneity bias in models of discrete choice with bounded rationality," Journal of Economic Behavior & Organization, Elsevier, vol. 82(1), pages 1-11.
    13. Candogan, Ozan & Ozdaglar, Asuman & Parrilo, Pablo A., 2013. "Dynamics in near-potential games," Games and Economic Behavior, Elsevier, vol. 82(C), pages 66-90.
    14. Dai Zusai, 2018. "Evolutionary dynamics in heterogeneous populations: a general framework for an arbitrary type distribution," Papers 1805.04897, arXiv.org, revised May 2019.
    15. Ratul Lahkar & Sayan Mukherjee & Souvik Roy, 2022. "A Deterministic Approximation Approach to the Continuum Logit Dynamic with an Application to Supermodular Games," Working Papers 79, Ashoka University, Department of Economics.
    16. Dai Zusai, 2017. "Nonaggregable evolutionary dynamics under payoff heterogeneity," DETU Working Papers 1702, Department of Economics, Temple University.
    17. Cheung, Man-Wah & Lahkar, Ratul, 2018. "Nonatomic potential games: the continuous strategy case," Games and Economic Behavior, Elsevier, vol. 108(C), pages 341-362.
    18. Philip N. Brown & Joshua H. Seaton & Jason R. Marden, 2023. "Robust Networked Multiagent Optimization: Designing Agents to Repair Their Own Utility Functions," Dynamic Games and Applications, Springer, vol. 13(1), pages 187-207, March.
    19. Sandholm, William H. & Staudigl, Mathias, 2016. "Large Deviations and Stochastic Stability in the Small Noise Double Limit, II: The Logit Model," Center for Mathematical Economics Working Papers 506, Center for Mathematical Economics, Bielefeld University.
    20. Lahkar, Ratul & Riedel, Frank, 2015. "The logit dynamic for games with continuous strategy sets," Games and Economic Behavior, Elsevier, vol. 91(C), pages 268-282.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:61:y:2023:i:4:d:10.1007_s10614-022-10250-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.