IDEAS home Printed from https://ideas.repec.org/a/eee/apmaco/v458y2023ics0096300323004034.html
   My bibliography  Save this article

Cooperative behavior under the influence of multiple experienced guiders in Prisoner’s dilemma game

Author

Listed:
  • You, Tao
  • Yang, Haochun
  • Wang, Jian
  • Zhang, Peng
  • Chen, Jinchao
  • Zhang, Ying

Abstract

In evolutionary game theory, the emergence and maintenance of group cooperative behavior is usually challenged by the lure of high-payoff defection behavior.Recently, besides imitation rules, the adaptive ability of individuals under limited information is also the key to adjust strategies, for example, individuals based on reinforcement learning rules by judging whether previous performance is satisfactory. In realistic scenarios, individuals with rich experience usually lead those who are inexperienced and play a guiding role in the group. Here we propose a multi-guider game model. Players on each layer of the network play different roles and follow different strategy update rules. Specifically, guiders use reinforcement learning rules to update their strategies in the upper network, and guided players use payoff-based imitation rules to update their strategies in the lower network. As the evolution progresses, guided players in the lower layer begin to reference the experienced guiders in the upper layer to update their strategies. A large number of Monte Carlo simulation results show that inexperienced individuals in the group are able to learn from the experience of others with the experienced guidance of multiple guiders. In addition to the improvement of group decision-making, the cooperative behavior can also be maintained at a higher level in the simulation of social dilemma.

Suggested Citation

  • You, Tao & Yang, Haochun & Wang, Jian & Zhang, Peng & Chen, Jinchao & Zhang, Ying, 2023. "Cooperative behavior under the influence of multiple experienced guiders in Prisoner’s dilemma game," Applied Mathematics and Computation, Elsevier, vol. 458(C).
  • Handle: RePEc:eee:apmaco:v:458:y:2023:i:c:s0096300323004034
    DOI: 10.1016/j.amc.2023.128234
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0096300323004034
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.amc.2023.128234?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xuelong Li & Marko Jusup & Zhen Wang & Huijia Li & Lei Shi & Boris Podobnik & H. Eugene Stanley & Shlomo Havlin & Stefano Boccaletti, 2018. "Punishment diminishes the benefits of network reciprocity in social dilemma experiments," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(1), pages 30-35, January.
    2. Li, Wen-Jing & Chen, Zhi & Jin, Ke-Zhong & Wang, Jun & Yuan, Lin & Gu, Changgui & Jiang, Luo-Luo & Perc, Matjaž, 2022. "Options for mobility and network reciprocity to jointly yield robust cooperation in social dilemmas," Applied Mathematics and Computation, Elsevier, vol. 435(C).
    3. Ritzberger, Klaus & Weibull, Jorgen W, 1995. "Evolutionary Selection in Normal-Form Games," Econometrica, Econometric Society, vol. 63(6), pages 1371-1399, November.
    4. Takahiro Ezaki & Yutaka Horita & Masanori Takezawa & Naoki Masuda, 2016. "Reinforcement Learning Explains Conditional Cooperation and Its Moody Cousin," PLOS Computational Biology, Public Library of Science, vol. 12(7), pages 1-13, July.
    5. Matjaž Perc & Zhen Wang, 2010. "Heterogeneous Aspirations Promote Cooperation in the Prisoner's Dilemma Game," PLOS ONE, Public Library of Science, vol. 5(12), pages 1-8, December.
    6. Martin A. Nowak & Karl Sigmund, 2005. "Evolution of indirect reciprocity," Nature, Nature, vol. 437(7063), pages 1291-1298, October.
    7. You, Tao & Zhang, Hailun & Zhang, Ying & Li, Qing & Zhang, Peng & Yang, Mei, 2022. "The influence of experienced guider on cooperative behavior in the Prisoner’s dilemma game," Applied Mathematics and Computation, Elsevier, vol. 426(C).
    8. Song, Zhao & Guo, Hao & Jia, Danyang & Perc, Matjaž & Li, Xuelong & Wang, Zhen, 2021. "Third party interventions mitigate conflicts on interdependent networks," Applied Mathematics and Computation, Elsevier, vol. 403(C).
    9. Dirk Helbing, 2013. "Globally networked risks and how to respond," Nature, Nature, vol. 497(7447), pages 51-59, May.
    10. Sergey V. Buldyrev & Roni Parshani & Gerald Paul & H. Eugene Stanley & Shlomo Havlin, 2010. "Catastrophic cascade of failures in interdependent networks," Nature, Nature, vol. 464(7291), pages 1025-1028, April.
    11. Wettergren, Thomas A., 2021. "Replicator dynamics of an N-player snowdrift game with delayed payoffs," Applied Mathematics and Computation, Elsevier, vol. 404(C).
    12. Jia, Danyang & Li, Tong & Zhao, Yang & Zhang, Xiaoqin & Wang, Zhen, 2022. "Empty nodes affect conditional cooperation under reinforcement learning," Applied Mathematics and Computation, Elsevier, vol. 413(C).
    13. Unai Alvarez-Rodriguez & Federico Battiston & Guilherme Ferraz Arruda & Yamir Moreno & Matjaž Perc & Vito Latora, 2021. "Evolutionary dynamics of higher-order interactions in social networks," Nature Human Behaviour, Nature, vol. 5(5), pages 586-595, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ding, Zhen-Wei & Zheng, Guo-Zhong & Cai, Chao-Ran & Cai, Wei-Ran & Chen, Li & Zhang, Ji-Qiang & Wang, Xu-Ming, 2023. "Emergence of cooperation in two-agent repeated games with reinforcement learning," Chaos, Solitons & Fractals, Elsevier, vol. 175(P1).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. You, Tao & Zhang, Hailun & Zhang, Ying & Li, Qing & Zhang, Peng & Yang, Mei, 2022. "The influence of experienced guider on cooperative behavior in the Prisoner’s dilemma game," Applied Mathematics and Computation, Elsevier, vol. 426(C).
    2. Bai, Pengzhou & Qiang, Bingzhuang & Zou, Kuan & Huang, Changwei, 2024. "Preferential selection based on adaptive attractiveness induce by reinforcement learning promotes cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 180(C).
    3. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    4. Dong, Zhengcheng & Tian, Meng & Liang, Jiaqi & Fang, Yanjun & Lu, Yuxin, 2019. "Research on the connection radius of dependency links in interdependent spatial networks against cascading failures," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 555-564.
    5. Ping Zhu & Guiyi Wei, 2014. "Stochastic Heterogeneous Interaction Promotes Cooperation in Spatial Prisoner's Dilemma Game," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-10, April.
    6. Wang, Wei & Li, Wenyao & Lin, Tao & Wu, Tao & Pan, Liming & Liu, Yanbing, 2022. "Generalized k-core percolation on higher-order dependent networks," Applied Mathematics and Computation, Elsevier, vol. 420(C).
    7. Wang, Zi-Ren & Deng, Zheng-Hong & Wang, Huan-Bo & Li, HuXiong & X, Fei-Wang, 2022. "Uneven Resources network promotes cooperation in the prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 413(C).
    8. Li, WenYao & Xue, Xiaoyu & Pan, Liming & Lin, Tao & Wang, Wei, 2022. "Competing spreading dynamics in simplicial complex," Applied Mathematics and Computation, Elsevier, vol. 412(C).
    9. Yang, Luhe & Zhang, Lianzhong & Yang, Duoxing, 2022. "Asymmetric micro-dynamics in spatial anonymous public goods game," Applied Mathematics and Computation, Elsevier, vol. 415(C).
    10. repec:spo:wpmain:info:hdl:2441/1nlv566svi86iqtetenms15tc4 is not listed on IDEAS
    11. Wang, Qiuling & Du, Chunpeng, 2019. "Impact of expansion of priority range on cooperation in the prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 129(C), pages 77-80.
    12. Arnaud Mignan & Ziqi Wang, 2020. "Exploring the Space of Possibilities in Cascading Disasters with Catastrophe Dynamics," IJERPH, MDPI, vol. 17(19), pages 1-21, October.
    13. Hu, Qi & Jin, Tao & Jiang, Yulian & Liu, Xingwen, 2024. "Reputation incentives with public supervision promote cooperation in evolutionary games," Applied Mathematics and Computation, Elsevier, vol. 466(C).
    14. Quan, Ji & Chen, Xinyue & Wang, Xianjia, 2024. "Repeated prisoner's dilemma games in multi-player structured populations with crosstalk," Applied Mathematics and Computation, Elsevier, vol. 473(C).
    15. Pan, Qiuhui & Shi, Shu & Zhang, Yu & He, Mingfeng, 2013. "Cooperation in spatial prisoner’s dilemma game with delayed decisions," Chaos, Solitons & Fractals, Elsevier, vol. 56(C), pages 166-174.
    16. Isamu Okada, 2020. "A Review of Theoretical Studies on Indirect Reciprocity," Games, MDPI, vol. 11(3), pages 1-17, July.
    17. repec:spo:wpmain:info:hdl:2441/5qr7f0k4sk8rbq4do5u6v70rm0 is not listed on IDEAS
    18. Chen, Qin & Pan, Qiuhui & He, Mingfeng, 2022. "The influence of quasi-cooperative strategy on social dilemma evolution," Chaos, Solitons & Fractals, Elsevier, vol. 161(C).
    19. Gianluca Pescaroli & David Alexander, 2018. "Understanding Compound, Interconnected, Interacting, and Cascading Risks: A Holistic Framework," Risk Analysis, John Wiley & Sons, vol. 38(11), pages 2245-2257, November.
    20. Alessandro Di Stefano & Marialisa Scatà & Aurelio La Corte & Pietro Liò & Emanuele Catania & Ermanno Guardo & Salvatore Pagano, 2015. "Quantifying the Role of Homophily in Human Cooperation Using Multiplex Evolutionary Game Theory," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-21, October.
    21. Jin, Jiahua & Chu, Chen & Shen, Chen & Guo, Hao & Geng, Yini & Jia, Danyang & Shi, Lei, 2018. "Heterogeneous fitness promotes cooperation in the spatial prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 106(C), pages 141-146.
    22. Wang, Weiping & Yang, Saini & Hu, Fuyu & Stanley, H. Eugene & He, Shuai & Shi, Mimi, 2018. "An approach for cascading effects within critical infrastructure systems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 510(C), pages 164-177.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:apmaco:v:458:y:2023:i:c:s0096300323004034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/applied-mathematics-and-computation .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.