IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v176y2023ics0960077923010391.html
   My bibliography  Save this article

The coupling effect between the environment and strategies drives the emergence of group cooperation

Author

Listed:
  • Di, Changyan
  • Zhou, Qingguo
  • Shen, Jun
  • Wang, Jinqiang
  • Zhou, Rui
  • Wang, Tianyi

Abstract

The emergence of cooperation is a central issue in understanding collective behavior and evolution. The eco-evolutionary game model introduces a human–environment coupling mechanism, revealing that the feedback between strategies and the relevant environment is a key element in sustaining long-term cooperation. Previous theoretical studies have observed periodic oscillations between cooperative and defective actions under certain conditions. However, such investigations assume cooperators hold a benefit advantage over defectors, which does not fundamentally illuminate how cooperation emerges. Our paper emphasizes that understanding this issue requires considering inherent human memory characteristics. We refine the eco-evolutionary game model using reinforcement learning, constructing a multi-agent system that couples environment and memory-based decision-making. Comprehensive analyses encompass collective and individual perspectives. Our findings show that with the memory mechanism, oscillations between collective cooperation and defection can still occur, even if defection remains a strict Nash equilibrium. Cooperation emerges from the group’s random exploratory actions in depleted environments, altering the environment’s trends. A positive feedback loop forms among the environment, individual rewards, and actions, stabilizing cooperation as a favorable individual strategy at that point. However, established group cooperation leads individuals seeking optimal behavior to transition from cooperators to defectors through exploration, resulting in cooperation collapse. Subsequently, the memory mechanism reengages, diluting defectors’ expected payoffs and initiating a new round of exploratory behavior within the group. Our results unveil the micro-level mechanisms driving cyclic oscillations, enhancing our understanding of the environment-strategy interplay.

Suggested Citation

  • Di, Changyan & Zhou, Qingguo & Shen, Jun & Wang, Jinqiang & Zhou, Rui & Wang, Tianyi, 2023. "The coupling effect between the environment and strategies drives the emergence of group cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 176(C).
  • Handle: RePEc:eee:chsofr:v:176:y:2023:i:c:s0960077923010391
    DOI: 10.1016/j.chaos.2023.114138
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077923010391
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2023.114138?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yan, Fang & Hou, Xiaorong & Tian, Tingting & Chen, Xiaojie, 2023. "Nonlinear model reference adaptive control approach for governance of the commons in a feedback-evolving game," Chaos, Solitons & Fractals, Elsevier, vol. 174(C).
    2. Andreoni, James, 1995. "Cooperation in Public-Goods Experiments: Kindness or Confusion?," American Economic Review, American Economic Association, vol. 85(4), pages 891-904, September.
    3. Palfrey, Thomas R. & Prisbrey, Jeffrey E., 1996. "Altuism, reputation and noise in linear public goods experiments," Journal of Public Economics, Elsevier, vol. 61(3), pages 409-427, September.
    4. Martin A. Nowak & Akira Sasaki & Christine Taylor & Drew Fudenberg, 2004. "Emergence of cooperation and evolutionary stability in finite populations," Nature, Nature, vol. 428(6983), pages 646-650, April.
    5. Li, Bin-Quan & Wu, Zhi-Xi & Guan, Jian-Yue, 2022. "Alternating rotation of coordinated and anti-coordinated action due to environmental feedback and noise," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
    6. Palfrey, Thomas R & Prisbrey, Jeffrey E, 1997. "Anomalous Behavior in Public Goods Experiments: How Much and Why?," American Economic Review, American Economic Association, vol. 87(5), pages 829-846, December.
    7. Andrew R. Tilman & Joshua B. Plotkin & Erol Akçay, 2020. "Evolutionary games with environmental feedbacks," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    8. Maxwell N. Burton-Chellew & Stuart A. West, 2021. "Payoff-based learning best explains the rate of decline in cooperation across 237 public-goods games," Nature Human Behaviour, Nature, vol. 5(10), pages 1330-1338, October.
    9. Martin A. Nowak & Karl Sigmund, 2005. "Evolution of indirect reciprocity," Nature, Nature, vol. 437(7063), pages 1291-1298, October.
    10. David G. Rand & Alexander Peysakhovich & Gordon T. Kraft-Todd & George E. Newman & Owen Wurzbacher & Martin A. Nowak & Joshua D. Greene, 2014. "Social heuristics shape intuitive cooperation," Nature Communications, Nature, vol. 5(1), pages 1-12, May.
    11. He, Nanrong & Chen, Xiaojie & Szolnoki, Attila, 2019. "Central governance based on monitoring and reporting solves the collective-risk social dilemma," Applied Mathematics and Computation, Elsevier, vol. 347(C), pages 334-341.
    12. Xiaojie Chen & Attila Szolnoki, 2018. "Punishment and inspection for governing the commons in a feedback-evolving game," PLOS Computational Biology, Public Library of Science, vol. 14(7), pages 1-15, July.
    13. Cao, Lixuan & Wu, Bin, 2021. "Eco-evolutionary dynamics with payoff-dependent environmental feedback," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    14. Perc, Matjaž & Grigolini, Paolo, 2013. "Collective behavior and evolutionary games – An introduction," Chaos, Solitons & Fractals, Elsevier, vol. 56(C), pages 1-5.
    15. Geng, Yini & Liu, Yifan & Lu, Yikang & Shen, Chen & Shi, Lei, 2022. "Reinforcement learning explains various conditional cooperation," Applied Mathematics and Computation, Elsevier, vol. 427(C).
    16. Liu, Yongkui & Li, Zhi & Chen, Xiaojie & Wang, Long, 2010. "Memory-based prisoner’s dilemma on square lattices," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(12), pages 2390-2396.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gao, Yan & Li, Minlan & Hu, Yuanyuan & Wang, Rui-Wu & Wang, Chao, 2024. "Evolutionary dynamics in voluntary prisoner’s dilemma game with environmental feedbacks," Chaos, Solitons & Fractals, Elsevier, vol. 181(C).
    2. Yan, Fang & Hou, Xiaorong & Tian, Tingting & Chen, Xiaojie, 2023. "Nonlinear model reference adaptive control approach for governance of the commons in a feedback-evolving game," Chaos, Solitons & Fractals, Elsevier, vol. 174(C).
    3. Anna Conte & M. Vittoria Levati & Natalia Montinari, 2019. "Experience in public goods experiments," Theory and Decision, Springer, vol. 86(1), pages 65-93, February.
    4. Ma, Xiaojian & Quan, Ji & Wang, Xianjia, 2023. "Evolution of cooperation with nonlinear environment feedback in repeated public goods game," Applied Mathematics and Computation, Elsevier, vol. 452(C).
    5. Yang, Luhe & Zhang, Lianzhong, 2021. "Environmental feedback in spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 142(C).
    6. Zhao, Zhengwu & Zhang, Chunyan, 2023. "The mechanisms of labor division from the perspective of task urgency and game theory," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 630(C).
    7. Martin G. Kocher & Peter Martinsson & Kristian Ove R. Myrseth & Conny E. Wollbrant, 2017. "Strong, bold, and kind: self-control and cooperation in social dilemmas," Experimental Economics, Springer;Economic Science Association, vol. 20(1), pages 44-69, March.
    8. Cheng, Fei & Chen, Tong & Chen, Qiao, 2020. "Rewards based on public loyalty program promote cooperation in public goods game," Applied Mathematics and Computation, Elsevier, vol. 378(C).
    9. Alós-Ferrer, Carlos & Garagnani, Michele, 2020. "The cognitive foundations of cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 71-85.
    10. Arbel, Yuval & Bar-El, Ronen & Tobol, Yossef, 2016. "Fundraising to a real-life public good – evidence from the laboratory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 65(C), pages 27-37.
    11. Simon Gaechter & Benedikt Herrmann, 2008. "Reciprocity, culture, and human cooperation: Previous insights and a new cross-cultural experiment," Discussion Papers 2008-14, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    12. Urs Fischbacher & Simon G�chter, 2005. "Heterogeneous social preferences and the dynamics of free riding in public goods," IEW - Working Papers 261, Institute for Empirical Research in Economics - University of Zurich.
    13. Pablo Brañas-Garza & Maria Paz Espinosa, 2011. "Unraveling Public Good Games," Games, MDPI, vol. 2(4), pages 1-18, November.
    14. Ding, Rui & Wang, Xianjia & Liu, Yang & Zhao, Jinhua & Gu, Cuiling, 2023. "Evolutionary games with environmental feedbacks under an external incentive mechanism," Chaos, Solitons & Fractals, Elsevier, vol. 169(C).
    15. Heinrich H. Nax & Ryan O. Murphy & Stefano Duca & Dirk Helbing, 2017. "Contribution-Based Grouping under Noise," Games, MDPI, vol. 8(4), pages 1-23, November.
    16. Li, Bin-Quan & Wu, Zhi-Xi & Guan, Jian-Yue, 2022. "Alternating rotation of coordinated and anti-coordinated action due to environmental feedback and noise," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
    17. Pablo Brañas-Garza & Maria Paz Espinosa, 2011. "Unraveling Public Good Games," Games, MDPI, vol. 2(4), pages 1-18, November.
    18. Urs Fischbacher & Simon G�chter, 2005. "Heterogeneous social preferences and the dynamics of free riding in public goods," IEW - Working Papers 261, Institute for Empirical Research in Economics - University of Zurich.
    19. Burton-Chellew, Maxwell, 2022. "The restart effect in social dilemmas shows humans are self-interested not altruistic," SocArXiv hgznu, Center for Open Science.
    20. Martinsson, Peter & Myrseth, Kristian Ove R. & Wollbrant, Conny, 2014. "Social dilemmas: When self-control benefits cooperation," Journal of Economic Psychology, Elsevier, vol. 45(C), pages 213-236.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:176:y:2023:i:c:s0960077923010391. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.