IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20060115.html
   My bibliography  Save this paper

Evolution of Strategies in Repeated Games with Discounting

Author

Listed:
  • Matthijs van Veelen

    (Universiteit van Amsterdam)

Abstract

In repeated games there is in general a large set of equilibria. We also know that in the repeated prisoners dilemma there is a profusion of neutrally stable strategies, but no strategy that is evolutionarily stable. This paper investigates whether and how neutrally stable strategies can be upset in a process of mutation and selection. While neutral stability excludes that mutants have a selective advantage themselves, it does not rule out the possibility that mutants that are neutral can enter a population and create a selective advantage for a second mutant. This will be called an indirect invasion and the central results show that, for high enough continuation probability, there is no strategy that is robust against indirect invasions. Such stepping stone paths out of equilibrium generally exist both in the direction of more and in the direction of less cooperation.

Suggested Citation

  • Matthijs van Veelen, 2007. "Evolution of Strategies in Repeated Games with Discounting," Tinbergen Institute Discussion Papers 06-115/1, Tinbergen Institute.
    • Handle: RePEc:tin:wpaper:20060115
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/06115.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. James W. Friedman, 1971. "A Non-cooperative Equilibrium for Supergames," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 38(1), pages 1-12.
    2. Bendor, Jonathan & Swistak, Piotr, 1997. "The Evolutionary Stability of Cooperation," American Political Science Review, Cambridge University Press, vol. 91(2), pages 290-307, June.
    3. Drew Fudenberg & Eric Maskin, 2008. "The Folk Theorem In Repeated Games With Discounting Or With Incomplete Information," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 11, pages 209-230, World Scientific Publishing Co. Pte. Ltd..
    4. Samuelson, Larry & Swinkels, Jeroen M., 2003. "Evolutionary stability and lexicographic preferences," Games and Economic Behavior, Elsevier, vol. 44(2), pages 332-342, August.
    5. Abreu, Dilip, 1988. "On the Theory of Infinitely Repeated Games with Discounting," Econometrica, Econometric Society, vol. 56(2), pages 383-396, March.
    6. Binmore, Kenneth G. & Samuelson, Larry, 1992. "Evolutionary stability in repeated games played by finite automata," Journal of Economic Theory, Elsevier, vol. 57(2), pages 278-305, August.
    7. Rubinstein, Ariel, 1979. "Equilibrium in supergames with the overtaking criterion," Journal of Economic Theory, Elsevier, vol. 21(1), pages 1-9, August.
    8. Jonathan Bendor & Piotr Swistak, 1998. "Evolutionary Equilibria: Characterization Theorems and Their Implications," Theory and Decision, Springer, vol. 45(2), pages 99-159, October.
    9. Fudenberg, Drew & Maskin, Eric, 1990. "Evolution and Cooperation in Noisy Repeated Games," American Economic Review, American Economic Association, vol. 80(2), pages 274-279, May.
    10. Binmore, Ken & Samuelson, Larry, 1997. "Muddling Through: Noisy Equilibrium Selection," Journal of Economic Theory, Elsevier, vol. 74(2), pages 235-265, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matthijs van Veelen, 2020. "The evolution of morality," Tinbergen Institute Discussion Papers 20-063/I, Tinbergen Institute.
    2. Saral, Ali Seyhun, 2020. "Evolution of Conditional Cooperation in Prisoner's Dilemma," OSF Preprints wcpkz, Center for Open Science.
    3. Matthijs van Veelen & Benjamin Allen & Moshe Hoffman & Burton Simon & Carl Veller, 2016. "Inclusive Fitness," Tinbergen Institute Discussion Papers 16-055/I, Tinbergen Institute.
    4. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Sandholm, William H., 2019. "An introduction to ABED: Agent-based simulation of evolutionary game dynamics," Games and Economic Behavior, Elsevier, vol. 118(C), pages 434-462.
    5. Matthijs van Veelen, 2010. "But Some Neutrally Stable Strategies are More Neutrally Stable than Others," Tinbergen Institute Discussion Papers 10-033/1, Tinbergen Institute.
    6. van Veelen, Matthijs & García, Julián, 2019. "In and out of equilibrium II: Evolution in repeated games with discounting and complexity costs," Games and Economic Behavior, Elsevier, vol. 115(C), pages 113-130.
    7. Shun Kurokawa & Joe Yuichiro Wakano & Yasuo Ihara, 2018. "Evolution of Groupwise Cooperation: Generosity, Paradoxical Behavior, and Non-Linear Payoff Functions," Games, MDPI, vol. 9(4), pages 1-24, December.
    8. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. García, Julián & van Veelen, Matthijs, 2016. "In and out of equilibrium I: Evolution of strategies in repeated games with discounting," Journal of Economic Theory, Elsevier, vol. 161(C), pages 161-189.
    2. van Veelen, Matthijs & García, Julián, 2019. "In and out of equilibrium II: Evolution in repeated games with discounting and complexity costs," Games and Economic Behavior, Elsevier, vol. 115(C), pages 113-130.
    3. Zhang, Huanren, 2018. "Errors can increase cooperation in finite populations," Games and Economic Behavior, Elsevier, vol. 107(C), pages 203-219.
    4. Matthijs van Veelen, 2002. "Altruism, Fairness and Evolution: the Case for Repeated Stochastic Games," Tinbergen Institute Discussion Papers 02-111/1, Tinbergen Institute.
    5. Spagnolo, Giancarlo, 2005. "Managerial incentives and collusive behavior," European Economic Review, Elsevier, vol. 49(6), pages 1501-1523, August.
    6. Drew Fudenberg & David G. Rand & Anna Dreber, 2012. "Slow to Anger and Fast to Forgive: Cooperation in an Uncertain World," American Economic Review, American Economic Association, vol. 102(2), pages 720-749, April.
    7. Abreu, Dilip & Dutta, Prajit K & Smith, Lones, 1994. "The Folk Theorem for Repeated Games: A NEU Condition," Econometrica, Econometric Society, vol. 62(4), pages 939-948, July.
    8. Ueda, Masahiko, 2023. "Memory-two strategies forming symmetric mutual reinforcement learning equilibrium in repeated prisoners’ dilemma game," Applied Mathematics and Computation, Elsevier, vol. 444(C).
    9. Matthijs van Veelen & Benjamin Allen & Moshe Hoffman & Burton Simon & Carl Veller, 2016. "Inclusive Fitness," Tinbergen Institute Discussion Papers 16-055/I, Tinbergen Institute.
    10. Luca Lambertini, 2000. "Technology and Cartel Stability under Vertical Differentiation," German Economic Review, Verein für Socialpolitik, vol. 1(4), pages 421-442, November.
    11. Benjamin M Zagorsky & Johannes G Reiter & Krishnendu Chatterjee & Martin A Nowak, 2013. "Forgiver Triumphs in Alternating Prisoner's Dilemma," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-8, December.
    12. Olivier GOSSNER, 2020. "The Robustness of Incomplete Penal Codes in Repeated Interactions," Working Papers 2020-29, Center for Research in Economics and Statistics.
    13. Stefano Demichelis & Jorgen W. Weibull, 2008. "Language, Meaning, and Games: A Model of Communication, Coordination, and Evolution," American Economic Review, American Economic Association, vol. 98(4), pages 1292-1311, September.
    14. Demichelis, Stefano & Weibull, Jörgen, 2006. "Efficiency, communication and honesty," SSE/EFI Working Paper Series in Economics and Finance 645, Stockholm School of Economics, revised 28 Nov 2006.
    15. Richard Jankowski, 1990. "Punishment in Iterated Chicken and Prisoner's Dilemma Games," Rationality and Society, , vol. 2(4), pages 449-470, October.
    16. Balanquit, Romeo, 2010. "Tolerance, Cooperation, and Equilibrium Restoration in Repeated Games," MPRA Paper 21877, University Library of Munich, Germany.
    17. Pablo Hernandez-Lagos & Dylan Minor & Dana Sisak, 2017. "Do people who care about others cooperate more? Experimental evidence from relative incentive pay," Experimental Economics, Springer;Economic Science Association, vol. 20(4), pages 809-835, December.
    18. Opp, Marcus M., 2010. "Tariff wars in the Ricardian Model with a continuum of goods," Journal of International Economics, Elsevier, vol. 80(2), pages 212-225, March.
    19. Tarui, Nori, 2007. "Inequality and outside options in common-property resource use," Journal of Development Economics, Elsevier, vol. 83(1), pages 214-239, May.
    20. Dou, Winston Wei & Ji, Yan & Wu, Wei, 2021. "Competition, profitability, and discount rates," Journal of Financial Economics, Elsevier, vol. 140(2), pages 582-620.

    More about this item

    Keywords

    Repeated games; evolutionary stability; robust against indirect invasions.;
    All these keywords.

    JEL classification:

    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20060115. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.