IDEAS home Printed from https://ideas.repec.org/p/els/esrcls/051.html
   My bibliography  Save this paper

Learning Through Reinforcement and Replicator Dynamics

Author

Listed:
  • Tilman Börgers
  • Rajiv Sarin

Abstract

This paper considers a version of Bush and Mosteller's stochastic learning theory in the context of games. We compare this model of learning to a model of biological evolution. The purpose is to investigate analogies between learning and evolution. We and that in the continuous time limit the biological model coincides with the deterministic, continuous time replicator process. We give conditions under which the same is true for the learning model. For the case that these conditions do not hold, we show that the replicator process continues to play an important role in characterising the continuous time limit of the learning model, but that a di®erent e®ect (\Probability Matching") enters as well.

Suggested Citation

  • Tilman Börgers & Rajiv Sarin, "undated". "Learning Through Reinforcement and Replicator Dynamics," ELSE working papers 051, ESRC Centre on Economics Learning and Social Evolution.
    • Handle: RePEc:els:esrcls:051
    as

    Download full text from publisher

    File URL: ftp://ftp.repec.org/RePEc/els/esrcls/replic.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Samuelson, L., 1989. "Evolutionnary Stability In Asymmetric Games," Papers 11-8-2, Pennsylvania State - Department of Economics.
    2. Mookherjee Dilip & Sopher Barry, 1994. "Learning Behavior in an Experimental Matching Pennies Game," Games and Economic Behavior, Elsevier, vol. 7(1), pages 62-91, July.
    3. Cabrales, Antonio & Sobel, Joel, 1992. "On the limit points of discrete selection dynamics," Journal of Economic Theory, Elsevier, vol. 57(2), pages 407-419, August.
    4. Ritzberger, Klaus & Weibull, Jorgen W, 1995. "Evolutionary Selection in Normal-Form Games," Econometrica, Econometric Society, vol. 63(6), pages 1371-1399, November.
    5. Gilboa, Itzhak & Matsui, Akihiko, 1992. "A model of random matching," Journal of Mathematical Economics, Elsevier, vol. 21(2), pages 185-197.
    6. E. Akin & V. Losert, 2010. "Evolutionary Dynamics of zero-sum games," Levine's Working Paper Archive 424, David K. Levine.
    7. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    8. Boylan Richard T., 1995. "Continuous Approximation of Dynamical Systems with Randomly Matched Individuals," Journal of Economic Theory, Elsevier, vol. 66(2), pages 615-625, August.
    9. L. Samuelson & J. Zhang, 2010. "Evolutionary Stability in Asymmetric Games," Levine's Working Paper Archive 453, David K. Levine.
    10. Dekel, Eddie & Scotchmer, Suzanne, 1992. "On the evolution of optimizing behavior," Journal of Economic Theory, Elsevier, vol. 57(2), pages 392-406, August.
    11. Samuelson, Larry & Zhang, Jianbo, 1992. "Evolutionary stability in asymmetric games," Journal of Economic Theory, Elsevier, vol. 57(2), pages 363-391, August.
    12. Cabrales, Antonio, 2000. "Stochastic Replicator Dynamics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(2), pages 451-481, May.
    13. John G. Cross, 1973. "A Stochastic Learning Model of Economic Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 87(2), pages 239-266.
    14. Boylan, Richard T., 1992. "Laws of large numbers for dynamical systems with randomly matched individuals," Journal of Economic Theory, Elsevier, vol. 57(2), pages 473-504, August.
    15. Schmalensee, Richard, 1975. "Alternative models of bandit selection," Journal of Economic Theory, Elsevier, vol. 10(3), pages 333-342, June.
    16. P. Taylor & L. Jonker, 2010. "Evolutionarily Stable Strategies and Game Dynamics," Levine's Working Paper Archive 457, David K. Levine.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weibull, Jörgen W., 1997. "What have we learned from Evolutionary Game Theory so far?," Working Paper Series 487, Research Institute of Industrial Economics, revised 26 Oct 1998.
    2. Demichelis, Stefano & Ritzberger, Klaus, 2003. "From evolutionary to strategic stability," Journal of Economic Theory, Elsevier, vol. 113(1), pages 51-75, November.
    3. Ponti, Giovanni, 2000. "Continuous-time evolutionary dynamics: theory and practice," Research in Economics, Elsevier, vol. 54(2), pages 187-214, June.
    4. Ken Binmore & Larry Samuelson, "undated". "Evolutionary Drift and Equilibrium Selection," ELSE working papers 011, ESRC Centre on Economics Learning and Social Evolution.
    5. Schlag, Karl H., 1998. "Why Imitate, and If So, How?, : A Boundedly Rational Approach to Multi-armed Bandits," Journal of Economic Theory, Elsevier, vol. 78(1), pages 130-156, January.
    6. Squintani, Francesco & Valimaki, Juuso, 2002. "Imitation and Experimentation in Changing Contests," Journal of Economic Theory, Elsevier, vol. 104(2), pages 376-404, June.
    7. Yannick Viossat, 2015. "Evolutionary dynamics and dominated strategies," Economic Theory Bulletin, Springer;Society for the Advancement of Economic Theory (SAET), vol. 3(1), pages 91-113, April.
    8. Fabrizio Germano, 2007. "Stochastic Evolution of Rules for Playing Finite Normal Form Games," Theory and Decision, Springer, vol. 62(4), pages 311-333, May.
    9. Sasaki, Yuya, 2004. "The Equivalence Of Evolutionary Games And Distributed Monte Carlo Learning," Economics Research Institute, ERI Series 28338, Utah State University, Economics Department.
    10. Izquierdo, Luis R. & Izquierdo, Segismundo S. & Gotts, Nicholas M. & Polhill, J. Gary, 2007. "Transient and asymptotic dynamics of reinforcement learning in games," Games and Economic Behavior, Elsevier, vol. 61(2), pages 259-276, November.
    11. Hopkins, Ed, 1999. "Learning, Matching, and Aggregation," Games and Economic Behavior, Elsevier, vol. 26(1), pages 79-110, January.
    12. Viossat, Yannick, 2008. "Evolutionary dynamics may eliminate all strategies used in correlated equilibrium," Mathematical Social Sciences, Elsevier, vol. 56(1), pages 27-43, July.
    13. Cabrales, Antonio, 1999. "Adaptive Dynamics and the Implementation Problem with Complete Information," Journal of Economic Theory, Elsevier, vol. 86(2), pages 159-184, June.
    14. DeMichelis, Stefano & Germano, Fabrizio, 2000. "On the Indices of Zeros of Nash Fields," Journal of Economic Theory, Elsevier, vol. 94(2), pages 192-217, October.
    15. Weibull, Jorgen W., 1998. "Evolution, rationality and equilibrium in games," European Economic Review, Elsevier, vol. 42(3-5), pages 641-649, May.
    16. Berger, Ulrich & Hofbauer, Josef, 2006. "Irrational behavior in the Brown-von Neumann-Nash dynamics," Games and Economic Behavior, Elsevier, vol. 56(1), pages 1-6, July.
    17. Hofbauer, Josef & Weibull, Jorgen W., 1996. "Evolutionary Selection against Dominated Strategies," Journal of Economic Theory, Elsevier, vol. 71(2), pages 558-573, November.
    18. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.
    19. Huw Dixon & Ernesto Somma, "undated". "Coordination and Equilibrium selection in mean defined supermodular games under payoff monotonic selection dynamics," Discussion Papers 99/37, Department of Economics, University of York.
    20. Yannick Viossat, 2005. "Replicator Dynamics and Correlated Equilibrium: Elimination of All Strategies in the Support of Correlated Equilibria," Working Papers hal-00242977, HAL.

    More about this item

    Keywords

    Games; Learning; Evolution;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:els:esrcls:051. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: s. malkani (email available below). General contact details of provider: https://edirc.repec.org/data/elucluk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.