IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v64y2024i6d10.1007_s10614-024-10559-8.html
   My bibliography  Save this article

Engineering Optimal Cooperation Levels with Prosocial Autonomous Agents in Hybrid Human-Agent Populations: An Agent-Based Modeling Approach

Author

Listed:
  • Tian Guo

    (Yunnan University of Finance and Economics
    Kyushu University)

  • Zhixue He

    (Yunnan University of Finance and Economics
    Kyushu University)

  • Chen Shen

    (Kyushu University)

  • Lei Shi

    (Yunnan University of Finance and Economics
    Shanghai Lixin University of Accounting and Finance)

  • Jun Tanimoto

    (Kyushu University
    Kyushu University)

Abstract

The evolution of cooperation in social interactions remains a central topic in interdisciplinary research, often drawing debates on altruistic versus self-regarding preferences. Moving beyond these debates, this study investigates how autonomous agents (AAs) with a range of social preferences interact with human players in one-shot, anonymous prisoner’s dilemma games. We explore whether AAs, programmed with preferences that vary from self-interest to other-regarding behavior, can foster increased cooperation among humans. To do this, we have refined the traditional Bush–Mosteller reinforcement learning algorithm to integrate these diverse social preferences, thereby shaping the AAs’ strategic behavior. Our results indicate that even a minority presence of AAs, programmed with a moderate aspiration level, can significantly elevate cooperation levels among human participants in well-mixed situations. However, the structure of the population is a critical factor: we observe increased cooperation in well-mixed populations when imitation strength is weak, whereas networked populations maintain enhanced cooperation irrespective of the strength of imitation. Interestingly, the degree to which AAs promote cooperation is modulated by their social preferences. AAs with pro-social preferences, which balance their own payoffs with those of their opponents, foster the highest levels of cooperation. Conversely, AAs with either extremely altruistic or purely individualistic preferences tend to hinder cooperative dynamics. This research provides valuable insights into the potential of advanced AAs to steer social dilemmas toward more cooperative outcomes. It presents a computational perspective for exploring the complex interplay between social preferences and cooperation, potentially guiding the development of AAs to improve cooperative efforts in human societies.

Suggested Citation

  • Tian Guo & Zhixue He & Chen Shen & Lei Shi & Jun Tanimoto, 2024. "Engineering Optimal Cooperation Levels with Prosocial Autonomous Agents in Hybrid Human-Agent Populations: An Agent-Based Modeling Approach," Computational Economics, Springer;Society for Computational Economics, vol. 64(6), pages 3317-3331, December.
    • Handle: RePEc:kap:compec:v:64:y:2024:i:6:d:10.1007_s10614-024-10559-8
    DOI: 10.1007/s10614-024-10559-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-024-10559-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10614-024-10559-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jacob W. Crandall & Mayada Oudah & Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael A. Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," TSE Working Papers 17-806, Toulouse School of Economics (TSE).
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," IAST Working Papers 17-68, Institute for Advanced Study in Toulouse (IAST).
    2. Takahiro Ezaki & Yutaka Horita & Masanori Takezawa & Naoki Masuda, 2016. "Reinforcement Learning Explains Conditional Cooperation and Its Moody Cousin," PLOS Computational Biology, Public Library of Science, vol. 12(7), pages 1-13, July.
    3. Maxwell N. Burton-Chellew & Stuart A. West, 2021. "Payoff-based learning best explains the rate of decline in cooperation across 237 public-goods games," Nature Human Behaviour, Nature, vol. 5(10), pages 1330-1338, October.
    4. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    5. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    6. Ernst Fehr & Simon Gächter, 2002. "Altruistic punishment in humans," Nature, Nature, vol. 415(6868), pages 137-140, January.
    7. Charness, Gary & Rabin, Matthew, 2002. "Understanding Social Preferences with Simple Tests," Department of Economics, Working Paper Series qt3d04q5sm, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    8. Ernst Fehr & Urs Fischbacher, 2003. "The nature of human altruism," Nature, Nature, vol. 425(6960), pages 785-791, October.
    9. Rabin, Matthew, 1993. "Incorporating Fairness into Game Theory and Economics," American Economic Review, American Economic Association, vol. 83(5), pages 1281-1302, December.
    10. Dawes, Robyn M & Thaler, Richard H, 1988. "Anomalies: Cooperation," Journal of Economic Perspectives, American Economic Association, vol. 2(3), pages 187-197, Summer.
    11. Bolton, Gary E. & Katok, Elena & Ockenfels, Axel, 2005. "Cooperation among strangers with limited information about reputation," Journal of Public Economics, Elsevier, vol. 89(8), pages 1457-1468, August.
    12. Gary Charness & Matthew Rabin, 2002. "Understanding Social Preferences with Simple Tests," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 817-869.
    13. Jean-François Bonnefon & Fatimah Ishowo-Oloko & Zakariyah Soroye & Jacob W. Crandall & Iyad Rahwan & Tahal Rahwan, 2019. "Behavioural evidence for a transparency-efficiency tradeoff in human-machine cooperation," Post-Print hal-04121730, HAL.
    14. Karl Sigmund & Hannelore De Silva & Arne Traulsen & Christoph Hauert, 2010. "Social learning promotes institutions for governing the commons," Nature, Nature, vol. 466(7308), pages 861-863, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bogliacino, Francesco & Codagnone, Cristiano, 2021. "Microfoundations, behaviour, and evolution: Evidence from experiments," Structural Change and Economic Dynamics, Elsevier, vol. 56(C), pages 372-385.
    2. Felix Kolle, 2012. "Heterogeneity and Cooperation in Privileged Groups: The Role of Capability and Valuation on Public Goods Provision," Discussion Papers 2012-07, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    3. repec:cgr:cgsser:03-08 is not listed on IDEAS
    4. Simon Gaechter, 2014. "Human Pro-Social Motivation and the Maintenance of Social Order," CESifo Working Paper Series 4729, CESifo.
    5. Rudolf Kerschbamer, 2013. "The Geometry of Distributional Preferences and a Non-Parametric Identification Approach," Working Papers 2013-25, Faculty of Economics and Statistics, Universität Innsbruck.
    6. Giorgio Coricelli, 2002. "Sequence Matters: an Experimental Study of the Effects of Experiencing Positive and Negative Reciprocity," Department of Economics University of Siena 369, Department of Economics, University of Siena.
    7. Karagözoğlu, Emin & Keskin, Kerim & Sağlam, Çağrı, 2013. "A minimally altruistic refinement of Nash equilibrium," Mathematical Social Sciences, Elsevier, vol. 66(3), pages 422-430.
    8. Sylvie Thoron, 2016. "Morality Beyond Social Preferences: Smithian Sympathy, Social Neuroscience and the Nature of Social Consciousness [La moralité au delà des préférences sociales. La sympathie Smithienne, les neurosc," Post-Print hal-01645043, HAL.
    9. Christian Hilbe & Moshe Hoffman & Martin A. Nowak, 2015. "Cooperate without Looking in a Non-Repeated Game," Games, MDPI, vol. 6(4), pages 1-15, September.
    10. Wang, Xinghua & Navarro-Martinez, Daniel, 2023. "Increasing the external validity of social preference games by reducing measurement error," Games and Economic Behavior, Elsevier, vol. 141(C), pages 261-285.
    11. Leibbrandt, Andreas & López-Pérez, Raúl & Spiegelman, Eli, 2023. "Reciprocal, but inequality averse as well? Mixed motives for punishment and reward," Journal of Economic Behavior & Organization, Elsevier, vol. 210(C), pages 91-116.
    12. Fluet, Claude & Galbiati, Rpbertp, 2016. "Lois et normes : les enseignements de l'économie comportementale," L'Actualité Economique, Société Canadienne de Science Economique, vol. 92(1-2), pages 191-215, Mars-Juin.
    13. David Masclet & Marie-Claire Villeval, 2008. "Punishment, inequality, and welfare: a public good experiment," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 31(3), pages 475-502, October.
    14. Kim, Jeongbin & Putterman, Louis & Zhang, Xinyi, 2022. "Trust, Beliefs and Cooperation: Excavating a Foundation of Strong Economies," European Economic Review, Elsevier, vol. 147(C).
    15. Brownback, Andy & Kuhn, Michael A., 2019. "Understanding outcome bias," Games and Economic Behavior, Elsevier, vol. 117(C), pages 342-360.
    16. Eric Cardella, 2016. "Exploiting the guilt aversion of others: do agents do it and is it effective?," Theory and Decision, Springer, vol. 80(4), pages 523-560, April.
    17. Reuben, Ernesto & van Winden, Frans, 2008. "Social ties and coordination on negative reciprocity: The role of affect," Journal of Public Economics, Elsevier, vol. 92(1-2), pages 34-53, February.
    18. Bruttel, Lisa & Stolley, Florian, 2020. "Getting a yes. An experiment on the power of asking," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 86(C).
    19. Xiao, Erte & Bicchieri, Cristina, 2010. "When equality trumps reciprocity," Journal of Economic Psychology, Elsevier, vol. 31(3), pages 456-470, June.
    20. Kurt A. Ackermann & Ryan O. Murphy, 2019. "Explaining Cooperative Behavior in Public Goods Games: How Preferences and Beliefs Affect Contribution Levels," Games, MDPI, vol. 10(1), pages 1-34, March.
    21. Ernesto Reuben & Frans van Winden, 2005. "Negative Reciprocity and the Interaction of Emotions and Fairness Norms," Tinbergen Institute Discussion Papers 05-014/1, Tinbergen Institute.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:64:y:2024:i:6:d:10.1007_s10614-024-10559-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.