IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-03292360.html
   My bibliography  Save this paper

Bad machines corrupt good morals

Author

Listed:
  • Nils Köbis

    (Max Planck Institute for Human Development - Max-Planck-Gesellschaft)

  • Jean-François Bonnefon

    (TSE-R - Toulouse School of Economics - UT Capitole - Université Toulouse Capitole - UT - Université de Toulouse - EHESS - École des hautes études en sciences sociales - CNRS - Centre National de la Recherche Scientifique - INRAE - Institut National de Recherche pour l’Agriculture, l’Alimentation et l’Environnement, CNRS - Centre National de la Recherche Scientifique)

  • Iyad Rahwan

    (Max Planck Institute for Human Development - Max-Planck-Gesellschaft)

Abstract

Machines powered by Artificial Intelligence (AI) are now influencing the behavior of humans in ways that are both like and unlike the ways humans influence each other. In light of recent research showing that other humans can exert a strong corrupting influence on people's ethical behavior, worry emerges about the corrupting power of AI agents. To estimate the empirical validity of these fears, we review the available evidence from behavioral science, human-computer interaction, and AI research. We propose that the main social roles through which both humans and machines can influence ethical behavior are (a) role model, (b) advisor, (c) partner, and (d) delegate. When AI agents become influencers (role models or advisors), their corrupting power may not exceed (yet) the corrupting power of humans. However, AI agents acting as enablers of unethical behavior (partners or delegates) have many characteristics that may let people reap unethical benefits while feeling good about themselves, indicating good reasons for worry. Based on these insights, we outline a research agenda that aims at providing more behavioral insights for better AI oversight.

Suggested Citation

  • Nils Köbis & Jean-François Bonnefon & Iyad Rahwan, 2021. "Bad machines corrupt good morals," Post-Print hal-03292360, HAL.
    • Handle: RePEc:hal:journl:hal-03292360
    DOI: 10.1038/s41562-021-01128-2
    Note: View the original document on HAL open archive server: https://hal.science/hal-03292360
    as

    Download full text from publisher

    File URL: https://hal.science/hal-03292360/document
    Download Restriction: no
    File URL: https://libkey.io/10.1038/s41562-021-01128-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Zhixin Dai & Fabio Galeotti & Marie Claire Villeval, 2018. "Cheating in the Lab Predicts Fraud in the Field: An Experiment in Public Transportation," Management Science, INFORMS, vol. 64(3), pages 1081-1100, March.
    2. Jacob W. Crandall & Mayada Oudah & Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael A. Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," TSE Working Papers 17-806, Toulouse School of Economics (TSE).
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," IAST Working Papers 17-68, Institute for Advanced Study in Toulouse (IAST).
      • Jacob Crandall & Mayada Oudah & Fatimah Ishowo-Oloko Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Post-Print hal-01897802, HAL.
    3. Raymond Fisman & Edward Miguel, 2007. "Corruption, Norms, and Legal Enforcement: Evidence from Diplomatic Parking Tickets," Journal of Political Economy, University of Chicago Press, vol. 115(6), pages 1020-1048, December.
    4. Kirchkamp, Oliver & Strobel, Christina, 2019. "Sharing responsibility with a machine," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 80(C), pages 25-33.
    5. Francesca Gino & Don A. Moore & Max H. Bazerman, 2008. "No harm, no foul: The outcome bias in ethical judgments," Harvard Business School Working Papers 08-080, Harvard Business School, revised Apr 2009.
    6. Wiltermuth, Scott S., 2011. "Cheating more when the spoils are split," Organizational Behavior and Human Decision Processes, Elsevier, vol. 115(2), pages 157-168, July.
    7. Schniter, E. & Shields, T.W. & Sznycer, D., 2020. "Trust in humans and robots: Economically similar but emotionally different," Journal of Economic Psychology, Elsevier, vol. 78(C).
    8. Kate Crawford, 2019. "Halt the use of facial-recognition technology until it is regulated," Nature, Nature, vol. 572(7771), pages 565-565, August.
    9. Heiko Rauhut, 2013. "Beliefs about Lying and Spreading of Dishonesty: Undetected Lies and Their Constructive and Destructive Social Dynamics in Dice Experiments," PLOS ONE, Public Library of Science, vol. 8(11), pages 1-8, November.
    10. Zoe Rahwan & Erez Yoeli & Barbara Fasolo, 2019. "Heterogeneity in banker culture and its influence on dishonesty," Nature, Nature, vol. 575(7782), pages 345-349, November.
    11. Allison Koenecke & Andrew Nam & Emily Lake & Joe Nudell & Minnie Quartey & Zion Mengesha & Connor Toups & John R. Rickford & Dan Jurafsky & Sharad Goel, 2020. "Racial disparities in automated speech recognition," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(14), pages 7684-7689, April.
    12. Mark V. Pezzo & Stephanie P. Pezzo, 2006. "Physician Evaluation after Medical Errors: Does Having a Computer Decision Aid Help or Hurt in Hindsight?," Medical Decision Making, , vol. 26(1), pages 48-56, January.
    13. Alain Cohn & Michel André Maréchal, 2018. "Laboratory Measure of Cheating Predicts School Misconduct," Economic Journal, Royal Economic Society, vol. 128(615), pages 2743-2754, November.
    14. On Amir & Dan Ariely & Alan Cooke & David Dunning & Nicholas Epley & Uri Gneezy & Botond Koszegi & Donald Lichtenstein & Nina Mazar & Sendhil Mullainathan & Drazen Prelec & Eldar Shafir & Jose Silva, 2005. "Psychology, Behavioral Economics, and Public Policy," Marketing Letters, Springer, vol. 16(3), pages 443-454, December.
    15. Andreas Ostermaier & Matthias Uhl, 2017. "Spot on for liars! How public scrutiny influences ethical behavior," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-11, July.
    16. Mikhail Drugov & John Hamman & Danila Serra, 2014. "Intermediaries in corruption: an experiment," Experimental Economics, Springer;Economic Science Association, vol. 17(1), pages 78-99, March.
    17. Margarita Leib & Nils C. Kobis & Rainer Michael Rilke & Marloes Hagens & Bernd Irlenbusch, 2021. "The corruptive force of AI-generated advice," Papers 2102.07536, arXiv.org.
    18. Gogoll, Jan & Uhl, Matthias, 2018. "Rage against the machine: Automation in the moral domain," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 97-103.
    19. Simon Gächter & Jonathan F. Schulz, 2016. "Intrinsic honesty and the prevalence of rule violations across societies," Nature, Nature, vol. 531(7595), pages 496-499, March.
    20. Daniel Houser & Robert Kurzban, 2002. "Revisiting Kindness and Confusion in Public Goods Experiments," American Economic Review, American Economic Association, vol. 92(4), pages 1062-1069, September.
    21. Soraperra, Ivan & Weisel, Ori & Zultan, Ro’i & Kochavi, Sys & Leib, Margarita & Shalev, Hadar & Shalvi, Shaul, 2017. "The bad consequences of teamwork," Economics Letters, Elsevier, vol. 160(C), pages 12-15.
    22. Alina Mungiu-Pippidi, 2017. "The time has come for evidence-based anticorruption," Nature Human Behaviour, Nature, vol. 1(1), pages 1-3, January.
    23. Fisman, Ray & Golden, Miriam A., 2017. "Corruption: What Everyone Needs to Know," OUP Catalogue, Oxford University Press, number 9780190463977.
    24. Ostermaier, Andreas & Uhl, Matthias, 2017. "Spot On For Liars! How Public Scrutiny Influences Ethical Behavior," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168167, Verein für Socialpolitik / German Economic Association.
    25. Dan Ariely & Nina Mazar, 2006. "Dishonesty in everyday life and its policy implications," Working Papers 06-3, Federal Reserve Bank of Boston.
    26. Charles Efferson & Sonja Vogt & Ernst Fehr, 2020. "The promise and the peril of using social influence to reverse harmful traditions," Nature Human Behaviour, Nature, vol. 4(1), pages 55-68, January.
    27. Jason Dana & Roberto Weber & Jason Kuang, 2007. "Exploiting moral wiggle room: experiments demonstrating an illusory preference for fairness," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(1), pages 67-80, October.
    28. Rahwan, Zoe & Yoeli, Erez & Fasolo, Barbara, 2019. "Heterogeneity in banker culture and its influence on dishonesty," LSE Research Online Documents on Economics 102656, London School of Economics and Political Science, LSE Library.
    29. Kate Crawford & Ryan Calo, 2016. "There is a blind spot in AI research," Nature, Nature, vol. 538(7625), pages 311-313, October.
    30. Daniel Paravisini & Antoinette Schoar, 2013. "The Incentive Effect of Scores: Randomized Evidence from Credit Committees," NBER Working Papers 19303, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Werner, Tobias, 2021. "Algorithmic and human collusion," DICE Discussion Papers 372, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    2. Leib, Margarita & Köbis, Nils & Rilke, Rainer Michael & Hagens, Marloes & Irlenbusch, Bernd, 2023. "Corrupted by Algorithms? How AI-Generated and Human-Written Advice Shape (Dis)Honesty," IZA Discussion Papers 16293, Institute of Labor Economics (IZA).
    3. von Schenk, Alicia & Klockmann, Victor & Bonnefon, Jean-François & Rahwan, Iyad & Köbis, Nils, 2023. "Lie-detection algorithms attract few users but vastly increase accusation rates," IAST Working Papers 23-155, Institute for Advanced Study in Toulouse (IAST).
    4. Chugunova, Marina & Sele, Daniela, 2022. "We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    5. Lukas Lanz & Roman Briker & Fabiola H. Gerpott, 2024. "Employees Adhere More to Unethical Instructions from Human Than AI Supervisors: Complementing Experimental Evidence with Machine Learning," Journal of Business Ethics, Springer, vol. 189(3), pages 625-646, January.
    6. Köbis, Nils & Rahwan, Zoe & Bersch, Clara & Ajaj, Tamer & Bonnefon, Jean-François & Rahwan, Iyad, 2024. "Experimental evidence that delegating to intelligent machines can increase dishonest behaviour," OSF Preprints dnjgz, Center for Open Science.
    7. Elias Fernández Domingos & Inês Terrucha & Rémi Suchon & Jelena Grujić & Juan Burguillo & Francisco Santos & Tom Lenaerts, 2022. "Delegation to artificial agents fosters prosocial behaviors in the collective risk dilemma," Post-Print hal-04296038, HAL.
    8. Alicia von Schenk & Victor Klockmann & Jean-Franc{c}ois Bonnefon & Iyad Rahwan & Nils Kobis, 2022. "Lie detection algorithms attract few users but vastly increase accusation rates," Papers 2212.04277, arXiv.org.
    9. Emilio Ferrara, 2024. "GenAI against humanity: nefarious applications of generative artificial intelligence and large language models," Journal of Computational Social Science, Springer, vol. 7(1), pages 549-569, April.
    10. Lechardoy, Lucie & López Forés, Laura & Codagnone, Cristiano, 2023. "Artificial intelligence at the workplace and the impacts on work organisation, working conditions and ethics," 32nd European Regional ITS Conference, Madrid 2023: Realising the digital decade in the European Union – Easier said than done? 277997, International Telecommunications Society (ITS).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chugunova, Marina & Sele, Daniela, 2022. "We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    2. Köbis, Nils & Rahwan, Zoe & Bersch, Clara & Ajaj, Tamer & Bonnefon, Jean-François & Rahwan, Iyad, 2024. "Experimental evidence that delegating to intelligent machines can increase dishonest behaviour," OSF Preprints dnjgz, Center for Open Science.
    3. Sanjit Dhami, 2017. "Human Ethics and Virtues: Rethinking the Homo-Economicus Model," CESifo Working Paper Series 6836, CESifo.
    4. Marie Claire Villeval, 2019. "Comportements (non) éthiques et stratégies morales," Revue économique, Presses de Sciences-Po, vol. 70(6), pages 1021-1046.
    5. Irlenbusch, Bernd & Mussweiler, Thomas & Saxler, David J. & Shalvi, Shaul & Weiss, Alexa, 2020. "Similarity increases collaborative cheating," Journal of Economic Behavior & Organization, Elsevier, vol. 178(C), pages 148-173.
    6. Brice Corgnet, 2023. "An Experimental Test of Algorithmic Dismissals," Working Papers 2302, Groupe d'Analyse et de Théorie Economique Lyon St-Étienne (GATE Lyon St-Étienne), Université de Lyon.
    7. Andrea Albertazzi, 2022. "Individual cheating in the lab: a new measure and external validity," Theory and Decision, Springer, vol. 93(1), pages 37-67, July.
    8. March, Christoph, 2021. "Strategic interactions between humans and artificial intelligence: Lessons from experiments with computer players," Journal of Economic Psychology, Elsevier, vol. 87(C).
    9. Schram, Arthur & Zheng, Jin Di & Zhuravleva, Tatyana, 2022. "Corruption: A cross-country comparison of contagion and conformism," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 497-518.
    10. Ellen Garbarino & Robert Slonim & Marie Claire Villeval, 2019. "Loss aversion and lying behavior," Post-Print halshs-01981542, HAL.
    11. Margarita Leib & Nils C. Kobis & Rainer Michael Rilke & Marloes Hagens & Bernd Irlenbusch, 2021. "The corruptive force of AI-generated advice," Papers 2102.07536, arXiv.org.
    12. Falk, Armin & Abeler, Johannes & Kosse, Fabian, 2021. "Malleability of preferences for honesty," CEPR Discussion Papers 16164, C.E.P.R. Discussion Papers.
    13. Goerg, Sebastian J. & Himmler, Oliver & König, Tobias, 2024. "Norm violations and behavioral spillovers—Evidence from the lab and the field," European Economic Review, Elsevier, vol. 166(C).
    14. Cappelen, Alexander W. & Fjeldstad, Odd-Helge & Mmari, Donald & Sjursen, Ingrid Hoem & Tungodden, Bertil, 2021. "Understanding the resource curse: A large-scale experiment on corruption in Tanzania," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 129-157.
    15. Pfister, Roland & Wirth, Robert & Weller, Lisa & Foerster, Anna & Schwarz, Katharina, 2018. "Taking shortcuts: Cognitive conflict during motivated rule-breaking," MPRA Paper 95773, University Library of Munich, Germany.
    16. Garbarino, Ellen & Slonim, Robert & Villeval, Marie Claire, 2019. "Loss aversion and lying behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 379-393.
    17. Aksoy, Billur & Palma, Marco A., 2019. "The effects of scarcity on cheating and in-group favoritism," Journal of Economic Behavior & Organization, Elsevier, vol. 165(C), pages 100-117.
    18. Vranka, Marek Albert & Bahník, Štěpán, 2017. "Predictors of Bribe-Taking: The Role of Bribe Size and Personality," OSF Preprints mzhkq, Center for Open Science.
    19. Heinicke, Franziska & König-Kersting, Christian & Schmidt, Robert, 2022. "Injunctive vs. descriptive social norms and reference group dependence," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 199-218.
    20. Iván Barreda-Tarrazona & Ainhoa Jaramillo-Gutiérrez & Marina Pavan & Gerardo Sabater-Grande, 2021. "The “Human Factor” in Prisoner’s Dilemma Cooperation," Working Papers 2021/10, Economics Department, Universitat Jaume I, Castellón (Spain).

    More about this item

    Keywords

    Machine behavior; Behavioral ethics; Corruption; Artificial intelligence;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-03292360. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.