IDEAS home Printed from https://ideas.repec.org/p/not/notcdx/2016-11.html
   My bibliography  Save this paper

Learning to Coordinate: Co-Evolution and Correlated Equilibrium

Author

Listed:
  • Alejandro Lee-Penagos

    (School of Economics, University of Nottingham)

Abstract

In a coordination game such as the Battle of the Sexes, agents can condition their plays on external signals that can, in theory, lead to a Correlated Equilibrium that can improve the overall payoffs of the agents. Here we explore whether boundedly rational, adaptive agents can learn to coordinate in such an environment. We find that such agents are able to coordinate, often in complex ways, even without an external signal. Furthermore, when a signal is present, Correlated Equilibrium are rare. Thus, even in a world of simple learning agents, coordination behavior can take on some surprising forms.

Suggested Citation

  • Alejandro Lee-Penagos, 2016. "Learning to Coordinate: Co-Evolution and Correlated Equilibrium," Discussion Papers 2016-11, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    • Handle: RePEc:not:notcdx:2016-11
    as

    Download full text from publisher

    File URL: https://www.nottingham.ac.uk/cedex/documents/papers/cedex-discussion-paper-2016-11.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sau-Him Lau & Vai-Lam Mui, 2008. "Using Turn Taking to Mitigate Coordination and Conflict Problems in the Repeated Battle of the Sexes Game," Theory and Decision, Springer, vol. 65(2), pages 153-183, September.
    2. Johne Bone & Michalis Drouvelis & Indrajit Ray, 2013. "Coordination in 2 x 2 Games by Following Recommendations from Correlated Equilibria," Discussion Papers 12-04, Department of Economics, University of Birmingham.
    3. Arifovic, Jasmina, 1994. "Genetic algorithm learning and the cobweb model," Journal of Economic Dynamics and Control, Elsevier, vol. 18(1), pages 3-28, January.
    4. Axelrod, Robert, 1986. "An Evolutionary Approach to Norms," American Political Science Review, Cambridge University Press, vol. 80(4), pages 1095-1111, December.
    5. Aumann, Robert J, 1987. "Correlated Equilibrium as an Expression of Bayesian Rationality," Econometrica, Econometric Society, vol. 55(1), pages 1-18, January.
    6. Sergiu Hart & Andreu Mas-Colell, 2013. "A Simple Adaptive Procedure Leading To Correlated Equilibrium," World Scientific Book Chapters, in: Simple Adaptive Strategies From Regret-Matching to Uncoupled Dynamics, chapter 2, pages 17-46, World Scientific Publishing Co. Pte. Ltd..
    7. Miller, John H. & Butts, Carter T. & Rode, David, 2002. "Communication and cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 47(2), pages 179-195, February.
    8. Gode, Dhananjay K & Sunder, Shyam, 1993. "Allocative Efficiency of Markets with Zero-Intelligence Traders: Market as a Partial Substitute for Individual Rationality," Journal of Political Economy, University of Chicago Press, vol. 101(1), pages 119-137, February.
    9. Christos Ioannou, 2014. "Coevolution of finite automata with errors," Journal of Evolutionary Economics, Springer, vol. 24(3), pages 541-571, July.
    10. Duffy, John, 2006. "Agent-Based Models and Human Subject Experiments," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011, Elsevier.
    11. Ioannou, Christos A. & Romero, Julian, 2014. "A generalized approach to belief learning in repeated games," Games and Economic Behavior, Elsevier, vol. 87(C), pages 178-203.
    12. John Duffy & Nick Feltovich, 2010. "Correlated Equilibria, Good And Bad: An Experimental Study," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 51(3), pages 701-721, August.
    13. Miller, John H., 1996. "The coevolution of automata in the repeated Prisoner's Dilemma," Journal of Economic Behavior & Organization, Elsevier, vol. 29(1), pages 87-112, January.
    14. Kollman, Ken & Miller, John H & Page, Scott E, 1997. "Political Institutions and Sorting in a Tiebout Model," American Economic Review, American Economic Association, vol. 87(5), pages 977-992, December.
    15. Arifovic, Jasmina & Boitnott, Joshua F. & Duffy, John, 2019. "Learning correlated equilibria: An evolutionary approach," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 171-190.
    16. Timothy Cason & Tridib Sharma, 2007. "Recommended play and correlated equilibria: an experimental study," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(1), pages 11-27, October.
    17. Johne Bone & Michalis Drouvelis & Indrajit Ray, 2013. "Coordination in 2 x 2 Games by Following Recommendations from Correlated Equilibria," Discussion Papers 12-04r, Department of Economics, University of Birmingham.
    18. Anbarcı, Nejat & Feltovich, Nick & Gürdal, Mehmet Y., 2018. "Payoff inequity reduces the effectiveness of correlated-equilibrium recommendations," European Economic Review, Elsevier, vol. 108(C), pages 172-190.
    19. Eilon Solan & Rakesh V. Vohra, 2002. "Correlated equilibrium payoffs and public signalling in absorbing games," International Journal of Game Theory, Springer;Game Theory Society, vol. 31(1), pages 91-121.
    20. Rubinstein, Ariel, 1986. "Finite automata play the repeated prisoner's dilemma," Journal of Economic Theory, Elsevier, vol. 39(1), pages 83-96, June.
    21. Robert Axelrod, 1980. "Effective Choice in the Prisoner's Dilemma," Journal of Conflict Resolution, Peace Science Society (International), vol. 24(1), pages 3-25, March.
    22. Robert Axelrod, 1980. "More Effective Choice in the Prisoner's Dilemma," Journal of Conflict Resolution, Peace Science Society (International), vol. 24(3), pages 379-403, September.
    23. Dean Corbae & John Duffy, 2000. "Contagion: An Experimental Study," Econometric Society World Congress 2000 Contributed Papers 1005, Econometric Society.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Christopher Roby, 2021. "Can loss framing improve coordination in the minimum effort game?," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 16(3), pages 557-588, July.
    2. Alejandro Lee-Penagos, 2016. "Modelling Contributions in Public Good Games with Punishment," Discussion Papers 2016-15, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Friedman, Daniel & Rabanal, Jean Paul & Rud, Olga A. & Zhao, Shuchen, 2022. "On the empirical relevance of correlated equilibrium," Journal of Economic Theory, Elsevier, vol. 205(C).
    2. Konstantinos Georgalos & Indrajit Ray & Sonali SenGupta, 2020. "Nash versus coarse correlation," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1178-1204, December.
    3. Antonio Cabrales & Michalis Drouvelis & Zeynep Gurguy & Indrajit Ray, 2017. "Transparency is Overrated: Communicating in a Coordination Game with Private Information," CESifo Working Paper Series 6781, CESifo.
    4. Siebert, Jan & Yang, Guanzhong, 2017. "Discoordination and miscoordination caused by sunspots in the laboratory," Working Papers on East Asian Studies 114/2017, University of Duisburg-Essen, Institute of East Asian Studies IN-EAST.
    5. Ozdogan, Ayca & Saglam, Ismail, 2021. "Correlated equilibrium under costly disobedience," Mathematical Social Sciences, Elsevier, vol. 114(C), pages 98-104.
    6. John Duffy & Ernest K. Lai & Wooyoung Lim, 2017. "Coordination via correlation: an experimental study," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 64(2), pages 265-304, August.
    7. Siebert, Jan & Yang, Guanzhong, 2021. "Coordination problems triggered by sunspots in the laboratory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    8. Arifovic, Jasmina & Boitnott, Joshua F. & Duffy, John, 2019. "Learning correlated equilibria: An evolutionary approach," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 171-190.
    9. Zhang, Huanren, 2018. "Errors can increase cooperation in finite populations," Games and Economic Behavior, Elsevier, vol. 107(C), pages 203-219.
    10. Marcelle Caroline Thimotheo de Brito & Amaro O. Pereira Junior & Mario Veiga Ferraz Pereira & Julio César Cahuano Simba & Sergio Granville, 2022. "Competitive Behavior of Hydroelectric Power Plants under Uncertainty in Spot Market," Energies, MDPI, vol. 15(19), pages 1-22, October.
    11. Konstantinos Georgalos & Indrajit Ray & Sonali Sen Gupta, 2017. "Coarse correlation and coordination in a game," Working Papers 151235570, Lancaster University Management School, Economics Department.
    12. Georgalos, Konstantinos & Ray, Indrajit & Gupta, Sonali Sen, 2019. "Nash vs. Coarse Correlation," Cardiff Economics Working Papers E2019/3, Cardiff University, Cardiff Business School, Economics Section.
    13. Cabrales, Antonio & Drouvelis, Michalis & Gurguc, Zeynep & Ray, Indrajit, 2018. "Do we need to listen to all stakeholders?: communicating in a coordination game with private information," Cardiff Economics Working Papers E2018/23, Cardiff University, Cardiff Business School, Economics Section.
    14. Masaki Aoyagi & Naoko Nishimura & Yoshitaka Okano, 2022. "Voluntary redistribution mechanism in asymmetric coordination games," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 444-482, April.
    15. Arifovic, Jasmina & Jiang, Janet Hua, 2019. "Strategic uncertainty and the power of extrinsic signals– evidence from an experimental study of bank runs," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 1-17.
    16. Chiara Scarampi & Richard Fairchild & Luca Fumarco & Alberto Palermo & Neal Hinvest, 2021. "Social Metacognition: A Correlational Device for Strategic Interactions," Working Papers 2111, Tulane University, Department of Economics.
    17. John Duffy & Ernest Lai & Wooyoung Lim, 2013. "Language and Coordination: An Experimental Study," Working Paper 514, Department of Economics, University of Pittsburgh, revised Dec 2013.
    18. Verena Kurz & Andreas Orland & Kinga Posadzy, 2018. "Fairness versus efficiency: how procedural fairness concerns affect coordination," Experimental Economics, Springer;Economic Science Association, vol. 21(3), pages 601-626, September.
    19. Timothy N. Cason & Tridib Sharma & Radovan Vadovic, 2019. "Corelated beliefs: Predicting outcomes in 2X2 games," Purdue University Economics Working Papers 1321, Purdue University, Department of Economics.
    20. Cason, Timothy N. & Sharma, Tridib & Vadovič, Radovan, 2020. "Correlated beliefs: Predicting outcomes in 2 × 2 games," Games and Economic Behavior, Elsevier, vol. 122(C), pages 256-276.

    More about this item

    Keywords

    Battle of the Sexes; Correlated Equilibrium; Evolutionary Game Theory; Learning Algorithms; Coordination Games; Adaptive Agents;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:not:notcdx:2016-11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jose V Guinot Saporta (email available below). General contact details of provider: https://edirc.repec.org/data/cdnotuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.