IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v387y2008i22p5609-5615.html
   My bibliography  Save this article

Promoting cooperation by local contribution under stochastic win-stay-lose-shift mechanism

Author

Listed:
  • Chen, Xiaojie
  • Fu, Feng
  • Wang, Long

Abstract

We introduce a stochastic win-stay-lose-shift (WSLS) mechanism into evolutionary Prisoner’s Dilemma on small-world networks. At each time step, after playing with all its immediate neighbors, each individual gets a score to evaluate its performance in the game. The score is a linear combination of an individual’s total payoff (i.e., individual gain from the group) and local contribution to its neighbors (i.e., individual donation to the group). If one’s actual score is not larger than its desired score aspiration, it switches current strategy to the opposite one with the probability depending on the difference between the two scores. Under this stochastic WSLS regime, we assume that each focal individual gains its fixed score aspiration under the condition of full cooperation in its neighborhood, and find that cooperation is significantly enhanced under some certain parameters of the model by studying the evolution of cooperation. We also explore the influences of different values of learning rate and intensity of deterministic switch on the evolution of cooperation. Simulation results show that cooperation level monotonically increases with the relative weight of the local contribution to the score. For much low intensity of deterministic switch, cooperation is to a large extent independent of learning rate, and full cooperation can be reached when relative weight is not less than 0.5. Otherwise, cooperation level is affected by the value of learning rate. Besides, we find that the cooperation level is not sensitive to the topological parameters. To explain these simulation results, we provide corresponding analytical results based on mean-field approximation, and find out that simulation results are in close agreement with the analytical ones. Our work may be helpful in understanding the cooperative behavior in social systems based on this stochastic WSLS mechanism.

Suggested Citation

  • Chen, Xiaojie & Fu, Feng & Wang, Long, 2008. "Promoting cooperation by local contribution under stochastic win-stay-lose-shift mechanism," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 387(22), pages 5609-5615.
  • Handle: RePEc:eee:phsmap:v:387:y:2008:i:22:p:5609-5615
    DOI: 10.1016/j.physa.2008.05.043
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437108004925
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2008.05.043?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    2. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Cong & Xu, Hedong & Fan, Suohai, 2020. "Synergistic effects of self-optimization and imitation rules on the evolution of cooperation in the investor sharing game," Applied Mathematics and Computation, Elsevier, vol. 370(C).
    2. Lee, Hsuan-Wei & Cleveland, Colin & Szolnoki, Attila, 2021. "Small fraction of selective cooperators can elevate general wellbeing significantly," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 582(C).
    3. Guo, Tian & Du, Chunpeng & Shi, Lei, 2024. "Evolution of cooperation on interdependent networks: The impact of asymmetric punishment," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    4. Quan, Ji & Zhou, Yawen & Wang, Xianjia & Yang, Jian-Bo, 2020. "Information fusion based on reputation and payoff promotes cooperation in spatial public goods game," Applied Mathematics and Computation, Elsevier, vol. 368(C).
    5. Shu, Gang & Du, Xia & Li, Ya, 2016. "Surrounding information consideration promotes cooperation in Prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 91(C), pages 689-694.
    6. Xia, Ke, 2021. "Average abundance function of multi-player threshold public goods without initial endowment evolutionary game model under differential aspiration levels and redistribution mechanism," Chaos, Solitons & Fractals, Elsevier, vol. 142(C).
    7. Li, Yan & Ye, Hang & Zhang, Hong, 2016. "Evolution of cooperation driven by social-welfare-based migration," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 445(C), pages 48-56.
    8. Du, Jinming & Wu, Ziren, 2023. "Coevolutionary dynamics of strategy and network structure with publicity mechanism," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 623(C).
    9. Li, Ya & Lan, Xin & Deng, Xinyang & Sadiq, Rehan & Deng, Yong, 2014. "Comprehensive consideration of strategy updating promotes cooperation in the prisoner’s dilemma game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 403(C), pages 284-292.
    10. Quan, Ji & Zhou, Yawen & Wang, Xianjia & Yang, Jian-Bo, 2020. "Evidential reasoning based on imitation and aspiration information in strategy learning promotes cooperation in optional spatial public goods game," Chaos, Solitons & Fractals, Elsevier, vol. 133(C).
    11. Chang, Shuhua & Zhang, Zhipeng & Wu, Yu’e & Xie, Yunya, 2018. "Cooperation is enhanced by inhomogeneous inertia in spatial prisoner’s dilemma game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 419-425.
    12. Wang, Xu-Wen & Nie, Sen & Jiang, Luo-Luo & Wang, Bing-Hong & Chen, Shi-Ming, 2017. "Role of delay-based reward in the spatial cooperation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 153-158.
    13. Szolnoki, Attila & Chen, Xiaojie, 2020. "Gradual learning supports cooperation in spatial prisoner’s dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 130(C).
    14. Kojo, Ken'ichi & Sakiyama, Tomoko, 2024. "Restructuring of neighborhood definition based on strategies will enhance the cooperation in a spatial prisoner's dilemma," Chaos, Solitons & Fractals, Elsevier, vol. 179(C).
    15. Deng, Zhenghong & Ma, Chunmiao & Mao, Xudong & Wang, Shenglan & Niu, Zhenxi & Gao, Li, 2017. "Historical payoff promotes cooperation in the prisoner's dilemma game," Chaos, Solitons & Fractals, Elsevier, vol. 104(C), pages 1-5.
    16. Xia, Ke, 2021. "The characteristics of average abundance function of multi-player threshold public goods evolutionary game model under redistribution mechanism," Applied Mathematics and Computation, Elsevier, vol. 392(C).
    17. Su, Qi & Li, Aming & Wang, Long, 2017. "Spatial structure favors cooperative behavior in the snowdrift game with multiple interactive dynamics," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 468(C), pages 299-306.
    18. Quan, Ji & Yang, Xiukang & Wang, Xianjia, 2018. "Spatial public goods game with continuous contributions based on Particle Swarm Optimization learning and the evolution of cooperation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 505(C), pages 973-983.
    19. Wang, Tao & Chen, Zhigang & Li, Kenli & Deng, Xiaoheng & Li, Deng, 2014. "Memory does not necessarily promote cooperation in dilemma games," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 395(C), pages 218-227.
    20. Bin Wu & Da Zhou & Feng Fu & Qingjun Luo & Long Wang & Arne Traulsen, 2010. "Evolution of Cooperation on Stochastic Dynamical Networks," PLOS ONE, Public Library of Science, vol. 5(6), pages 1-7, June.
    21. Quan, Ji & Dong, Xu & Wang, Xianjia, 2022. "Rational conformity behavior in social learning promotes cooperation in spatial public goods game," Applied Mathematics and Computation, Elsevier, vol. 425(C).
    22. Xu, Jiwei & Deng, Zhenghong & Gao, Bo & Song, Qun & Tian, Zhihong & Wang, Qiuling & Gao, Mingyu & Niu, Zhenxi, 2019. "Popularity-driven strategy updating rule promotes cooperation in the spatial prisoner's dilemma game," Applied Mathematics and Computation, Elsevier, vol. 353(C), pages 82-87.
    23. Liu, Yongkui & Chen, Xiaojie & Zhang, Lin & Tao, Fei & Wang, Long, 2012. "Does migration cost influence cooperation among success-driven individuals?," Chaos, Solitons & Fractals, Elsevier, vol. 45(11), pages 1301-1308.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Galbiati, Marco & Soramäki, Kimmo, 2011. "An agent-based model of payment systems," Journal of Economic Dynamics and Control, Elsevier, vol. 35(6), pages 859-875, June.
    2. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    3. ,, 2011. "Manipulative auction design," Theoretical Economics, Econometric Society, vol. 6(2), May.
    4. Benaïm, Michel & Hofbauer, Josef & Hopkins, Ed, 2009. "Learning in games with unstable equilibria," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1694-1709, July.
    5. Dieter Balkenborg & Rosemarie Nagel, 2016. "An Experiment on Forward vs. Backward Induction: How Fairness and Level k Reasoning Matter," German Economic Review, Verein für Socialpolitik, vol. 17(3), pages 378-408, August.
    6. William L. Cooper & Tito Homem-de-Mello & Anton J. Kleywegt, 2015. "Learning and Pricing with Models That Do Not Explicitly Incorporate Competition," Operations Research, INFORMS, vol. 63(1), pages 86-103, February.
    7. Siegfried Berninghaus & Werner Güth & M. Vittoria Levati & Jianying Qiu, 2006. "Satisficing in sales competition: experimental evidence," Papers on Strategic Interaction 2006-32, Max Planck Institute of Economics, Strategic Interaction Group.
    8. Ball, Richard, 2017. "Violations of monotonicity in evolutionary models with sample-based beliefs," Economics Letters, Elsevier, vol. 152(C), pages 100-104.
    9. Tsakas, Elias & Voorneveld, Mark, 2009. "The target projection dynamic," Games and Economic Behavior, Elsevier, vol. 67(2), pages 708-719, November.
    10. Sandholm,W.H., 2003. "Excess payoff dynamics, potential dynamics, and stable games," Working papers 5, Wisconsin Madison - Social Systems.
    11. Yoo, Seung Han, 2014. "Learning a population distribution," Journal of Economic Dynamics and Control, Elsevier, vol. 48(C), pages 188-201.
    12. Anthony Ziegelmeyer & Frédéric Koessler & Kene Boun My & Laurent Denant-Boèmont, 2008. "Road Traffic Congestion and Public Information: An Experimental Investigation," Journal of Transport Economics and Policy, University of Bath, vol. 42(1), pages 43-82, January.
    13. DeJong, D.V. & Blume, A. & Neumann, G., 1998. "Learning in Sender-Receiver Games," Other publications TiSEM 4a8b4f46-f30b-4ad2-bb0c-1, Tilburg University, School of Economics and Management.
    14. Alessandro Lizzeri & Marciano Siniscalchi, 2008. "Parental Guidance and Supervised Learning," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(3), pages 1161-1195.
    15. Ilya R. P. Cuypers & Youtha Cuypers & Xavier Martin, 2017. "When the target may know better: Effects of experience and information asymmetries on value from mergers and acquisitions," Strategic Management Journal, Wiley Blackwell, vol. 38(3), pages 609-625, March.
    16. Mario Gilli, 2002. "Rational Learning in Imperfect Monitoring Games," Working Papers 46, University of Milano-Bicocca, Department of Economics, revised Mar 2002.
    17. Brit Grosskopf & Ido Erev & Eldad Yechiam, 2006. "Foregone with the Wind: Indirect Payoff Information and its Implications for Choice," International Journal of Game Theory, Springer;Game Theory Society, vol. 34(2), pages 285-302, August.
    18. Salle, Isabelle & Yildizoglu, Murat & Zumpe, Martin & Sénégas, Marc-Alexandre, 2017. "Coordination through social learning in a general equilibrium model," Journal of Economic Behavior & Organization, Elsevier, vol. 141(C), pages 64-82.
    19. Gilles Grandjean & Ana Mauleon & Vincent Vannetelbosch, 2017. "Strongly rational sets for normal-form games," Economic Theory Bulletin, Springer;Society for the Advancement of Economic Theory (SAET), vol. 5(1), pages 35-46, April.
    20. John T. Scholz & Cheng‐Lung Wang, 2009. "Learning to Cooperate: Learning Networks and the Problem of Altruism," American Journal of Political Science, John Wiley & Sons, vol. 53(3), pages 572-587, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:387:y:2008:i:22:p:5609-5615. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.