IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v419y2015icp14-22.html
   My bibliography  Save this article

Evolution of cooperation driven by incremental learning

Author

Listed:
  • Li, Pei
  • Duan, Haibin

Abstract

It has been shown that the details of microscopic rules in structured populations can have a crucial impact on the ultimate outcome in evolutionary games. So alternative formulations of strategies and their revision processes exploring how strategies are actually adopted and spread within the interaction network need to be studied. In the present work, we formulate the strategy update rule as an incremental learning process, wherein knowledge is refreshed according to one’s own experience learned from the past (self-learning) and that gained from social interaction (social-learning). More precisely, we propose a continuous version of strategy update rules, by introducing the willingness to cooperate W, to better capture the flexibility of decision making behavior. Importantly, the newly gained knowledge including self-learning and social learning is weighted by the parameter ω, establishing a strategy update rule involving innovative element. Moreover, we quantify the macroscopic features of the emerging patterns to inspect the underlying mechanisms of the evolutionary process using six cluster characteristics. In order to further support our results, we examine the time evolution course for these characteristics. Our results might provide insights for understanding cooperative behaviors and have several important implications for understanding how individuals adjust their strategies under real-life conditions.

Suggested Citation

  • Li, Pei & Duan, Haibin, 2015. "Evolution of cooperation driven by incremental learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 419(C), pages 14-22.
  • Handle: RePEc:eee:phsmap:v:419:y:2015:i:c:p:14-22
    DOI: 10.1016/j.physa.2014.09.062
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437114008395
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2014.09.062?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chunyan Zhang & Jianlei Zhang & Guangming Xie & Long Wang & Matjaž Perc, 2011. "Evolution of Interactions and Cooperation in the Spatial Prisoner's Dilemma Game," PLOS ONE, Public Library of Science, vol. 6(10), pages 1-7, October.
    2. A. Szolnoki & M. Perc, 2009. "Promoting cooperation in social dilemmas via simple coevolutionary rules," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 67(3), pages 337-344, February.
    3. Francisco C. Santos & Marta D. Santos & Jorge M. Pacheco, 2008. "Social diversity promotes the emergence of cooperation in public goods games," Nature, Nature, vol. 454(7201), pages 213-216, July.
    4. Christoph Hauert & Michael Doebeli, 2004. "Spatial structure often inhibits the evolution of cooperation in the snowdrift game," Nature, Nature, vol. 428(6983), pages 643-646, April.
    5. Challet, D. & Zhang, Y.-C., 1997. "Emergence of cooperation and organization in an evolutionary game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 246(3), pages 407-418.
    6. Xiaojie Chen & Yongkui Liu & Yonghui Zhou & Long Wang & Matjaž Perc, 2012. "Adaptive and Bounded Investment Returns Promote Cooperation in Spatial Public Goods Games," PLOS ONE, Public Library of Science, vol. 7(5), pages 1-8, May.
    7. Shijun Wang & Máté S Szalay & Changshui Zhang & Peter Csermely, 2008. "Learning and Innovative Elements of Strategy Adoption Rules Expand Cooperative Network Topologies," PLOS ONE, Public Library of Science, vol. 3(4), pages 1-9, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Jinqiu & Luo, Chao, 2019. "The effect of preferential teaching and memory on cooperation clusters in interdependent networks," Applied Mathematics and Computation, Elsevier, vol. 363(C), pages 1-1.
    2. Quan, Ji & Yang, Xiukang & Wang, Xianjia, 2018. "Spatial public goods game with continuous contributions based on Particle Swarm Optimization learning and the evolution of cooperation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 505(C), pages 973-983.
    3. Amado, André & Huang, Weini & Campos, Paulo R.A. & Ferreira, Fernando Fagundes, 2015. "Learning process in public goods games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 430(C), pages 21-31.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Du, Faqi & Fu, Feng, 2013. "Quantifying the impact of noise on macroscopic organization of cooperation in spatial games," Chaos, Solitons & Fractals, Elsevier, vol. 56(C), pages 35-44.
    2. Qian, Jia-Li & Zhou, Yin-Xiang & Hao, Qing-Yi, 2024. "The emergence of cooperative behavior based on random payoff and heterogeneity of concerning social image," Chaos, Solitons & Fractals, Elsevier, vol. 179(C).
    3. Hong, Lijun & Geng, Yini & Du, Chunpeng & Shen, Chen & Shi, Lei, 2021. "Average payoff-driven or imitation? A new evidence from evolutionary game theory in finite populations," Applied Mathematics and Computation, Elsevier, vol. 394(C).
    4. Chen, Wei & Wu, Te & Li, Zhiwu & Wang, Long, 2016. "Friendship-based partner switching promotes cooperation in heterogeneous populations," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 443(C), pages 192-199.
    5. Kokubo, Satoshi & Wang, Zhen & Tanimoto, Jun, 2015. "Spatial reciprocity for discrete, continuous and mixed strategy setups," Applied Mathematics and Computation, Elsevier, vol. 259(C), pages 552-568.
    6. Zou, Kuan & Han, Wenchen & Zhang, Lan & Huang, Changwei, 2024. "The spatial public goods game on hypergraphs with heterogeneous investment," Applied Mathematics and Computation, Elsevier, vol. 466(C).
    7. Chen, Zhuo & Gao, Jianxi & Cai, Yunze & Xu, Xiaoming, 2011. "Evolution of cooperation among mobile agents," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 390(9), pages 1615-1622.
    8. Wang, Hanchen & Sun, Yichun & Zheng, Lei & Du, Wenbo & Li, Yumeng, 2018. "The public goods game on scale-free networks with heterogeneous investment," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 509(C), pages 396-404.
    9. Chengzhang Ma & Wei Cao & Wangheng Liu & Rong Gui & Ya Jia, 2013. "Direct Sum Matrix Game with Prisoner's Dilemma and Snowdrift Game," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-7, December.
    10. Haodong Niu & Keyu Li & Juan Wang, 2023. "Paid Access to Information Promotes the Emergence of Cooperation in the Spatial Prisoner’s Dilemma," Mathematics, MDPI, vol. 11(4), pages 1-15, February.
    11. Liu, Chengwei & Wang, Juan & Li, Xiaopeng & Xia, Chengyi, 2020. "The link weight adjustment considering historical strategy promotes the cooperation in the spatial prisoner’s dilemma game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 554(C).
    12. Zhang, Jun & Hu, Bin & Huang, Yi Jie & Deng, Zheng Hong & Wu, Tao, 2020. "The evolution of cooperation affected by aspiration-driven updating rule in multi-games with voluntary participation," Chaos, Solitons & Fractals, Elsevier, vol. 139(C).
    13. Hu, Xiang & Liu, Xingwen, 2021. "Unfixed-neighbor-mechanism promotes cooperation in evolutionary snowdrift game on lattice," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 572(C).
    14. Bandyopadhyay, Abhirup & Kar, Samarjit, 2018. "Coevolution of cooperation and network structure in social dilemmas in evolutionary dynamic complex network," Applied Mathematics and Computation, Elsevier, vol. 320(C), pages 710-730.
    15. Shang, Lihui & Sun, Sihao & Ai, Jun & Su, Zhan, 2022. "Cooperation enhanced by the interaction diversity for the spatial public goods game on regular lattices," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 593(C).
    16. Li, Yan & Ye, Hang, 2015. "Effect of migration based on strategy and cost on the evolution of cooperation," Chaos, Solitons & Fractals, Elsevier, vol. 76(C), pages 156-165.
    17. Jorge Peña & Yannick Rochat, 2012. "Bipartite Graphs as Models of Population Structures in Evolutionary Multiplayer Games," PLOS ONE, Public Library of Science, vol. 7(9), pages 1-13, September.
    18. Ping Zhu & Guiyi Wei, 2014. "Stochastic Heterogeneous Interaction Promotes Cooperation in Spatial Prisoner's Dilemma Game," PLOS ONE, Public Library of Science, vol. 9(4), pages 1-10, April.
    19. Qinghu Liao & Wenwen Dong & Boxin Zhao, 2023. "A New Strategy to Solve “the Tragedy of the Commons” in Sustainable Grassland Ecological Compensation: Experience from Inner Mongolia, China," Sustainability, MDPI, vol. 15(12), pages 1-24, June.
    20. Lv, Shaojie & Wang, Xianjia, 2020. "The impact of heterogeneous investments on the evolution of cooperation in public goods game with exclusion," Applied Mathematics and Computation, Elsevier, vol. 372(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:419:y:2015:i:c:p:14-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.