IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0246588.html
   My bibliography  Save this article

Learning, exploitation and bias in games

Author

Listed:
  • John M McNamara
  • Alasdair I Houston
  • Olof Leimar

Abstract

We focus on learning during development in a group of individuals that play a competitive game with each other. The game has two actions and there is negative frequency dependence. We define the distribution of actions by group members to be an equilibrium configuration if no individual can improve its payoff by unilaterally changing its action. We show that at this equilibrium, one action is preferred in the sense that those taking the preferred action have a higher payoff than those taking the other, more prosocial, action. We explore the consequences of a simple ‘unbiased’ reinforcement learning rule during development, showing that groups reach an approximate equilibrium distribution, so that some achieve a higher payoff than others. Because there is learning, an individual’s behaviour can influence the future behaviour of others. We show that, as a consequence, there is the potential for an individual to exploit others by influencing them to be the ones to take the non-preferred action. Using an evolutionary simulation, we show that population members can avoid being exploited by over-valuing rewards obtained from the preferred option during learning, an example of a bias that is ‘rational’.

Suggested Citation

  • John M McNamara & Alasdair I Houston & Olof Leimar, 2021. "Learning, exploitation and bias in games," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-14, February.
  • Handle: RePEc:plo:pone00:0246588
    DOI: 10.1371/journal.pone.0246588
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0246588
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0246588&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0246588?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Heifetz, Aviad & Shannon, Chris & Spiegel, Yossi, 2007. "What to maximize if you must," Journal of Economic Theory, Elsevier, vol. 133(1), pages 31-57, March.
    2. Guth, Werner, 1995. "An Evolutionary Approach to Explaining Cooperative Behavior by Reciprocal Incentives," International Journal of Game Theory, Springer;Game Theory Society, vol. 24(4), pages 323-344.
    3. John M. McNamara & Catherine E. Gasson & Alasdair I Houston, 1999. "Incorporating rules for responding into evolutionary games," Nature, Nature, vol. 401(6751), pages 368-371, September.
    4. Samuelson, Larry, 2001. "Introduction to the Evolution of Preferences," Journal of Economic Theory, Elsevier, vol. 97(2), pages 225-230, April.
    5. Aviad Heifetz & Chris Shannon & Yossi Spiegel, 2007. "The Dynamic Evolution of Preferences," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 32(2), pages 251-286, August.
    6. John M. McNamara & Polly Doodson, 2015. "Reputation can enhance or suppress cooperation through positive feedback," Nature Communications, Nature, vol. 6(1), pages 1-7, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Burkhard C. Schipper, 2021. "The evolutionary stability of optimism, pessimism, and complete ignorance," Theory and Decision, Springer, vol. 90(3), pages 417-454, May.
    2. Ingela Alger & Laurent Lehmann, 2023. "Evolution of Semi-Kantian Preferences in Two-Player Assortative Interactions with Complete and Incomplete Information and Plasticity," Dynamic Games and Applications, Springer, vol. 13(4), pages 1288-1319, December.
    3. Norman, Thomas W.L., 2012. "Equilibrium selection and the dynamic evolution of preferences," Games and Economic Behavior, Elsevier, vol. 74(1), pages 311-320.
    4. Florian Gauer & Christoph Kuzmics, 2020. "Cognitive Empathy In Conflict Situations," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(4), pages 1659-1678, November.
    5. Wu, Jiabin, 2016. "Political Institutions and Preference Evolution," MPRA Paper 69597, University Library of Munich, Germany.
    6. repec:grz:wpaper:2016-02 is not listed on IDEAS
    7. Thomas Norman, 2004. "Dynamically Stable Preferences," Economics Series Working Papers 207, University of Oxford, Department of Economics.
    8. Król, Michał, 2012. "Product differentiation decisions under ambiguous consumer demand and pessimistic expectations," International Journal of Industrial Organization, Elsevier, vol. 30(6), pages 593-604.
    9. Edward Castronova, 2023. "Preference evolution, attention, and happiness," Kyklos, Wiley Blackwell, vol. 76(2), pages 301-315, May.
    10. Newton, Jonathan, 2017. "Shared intentions: The evolution of collaboration," Games and Economic Behavior, Elsevier, vol. 104(C), pages 517-534.
    11. Heifetz, Aviad & Shannon, Chris & Spiegel, Yossi, 2007. "What to maximize if you must," Journal of Economic Theory, Elsevier, vol. 133(1), pages 31-57, March.
    12. Joseph Y. Halpern & Yuval Heller & Eyal Winter, 2022. "The Benefits of Coarse Preferences," Papers 2201.10141, arXiv.org, revised Jun 2023.
    13. Ioannis Kordonis & Alexandros C. Charalampidis & George P. Papavassilopoulos, 2018. "Pretending in Dynamic Games, Alternative Outcomes and Application to Electricity Markets," Dynamic Games and Applications, Springer, vol. 8(4), pages 844-873, December.
    14. Possajennikov Alex, 2010. "On Delegation in Contests and the Survival of Payoff Maximizing Behavior," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 10(1), pages 1-13, June.
    15. Guttman, Joel M., 2013. "On the evolution of conditional cooperation," European Journal of Political Economy, Elsevier, vol. 30(C), pages 15-34.
    16. Alger, Ingela & Weibull, Jörgen W. & Lehmann, Laurent, 2020. "Evolution of preferences in structured populations: Genes, guns, and culture," Journal of Economic Theory, Elsevier, vol. 185(C).
    17. Alger, Ingela, 2022. "Evolutionarily stable preferences," TSE Working Papers 22-1355, Toulouse School of Economics (TSE), revised Dec 2022.
    18. Werner Güth & Loreto Erviti & Anthony Ziegelmeyer, 2011. "Asymmetric information without common priors: an indirect evolutionary analysis of quantity competition," Journal of Evolutionary Economics, Springer, vol. 21(5), pages 843-852, December.
    19. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.
    20. Roee Teper, 2014. "The Endowment Effect as a Blessing," Working Paper 5862, Department of Economics, University of Pittsburgh.
    21. Wu, Jiabin, 2017. "Political institutions and the evolution of character traits," Games and Economic Behavior, Elsevier, vol. 106(C), pages 260-276.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0246588. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.