IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/dnjgz.html
   My bibliography  Save this paper

Experimental evidence that delegating to intelligent machines can increase dishonest behaviour

Author

Listed:
  • Köbis, Nils
  • Rahwan, Zoe

    (Max Planck Institute for Human Development)

  • Bersch, Clara
  • Ajaj, Tamer
  • Bonnefon, Jean-François

    (Toulouse School of Economics)

  • Rahwan, Iyad

Abstract

While artificial intelligence (AI) enables significant productivity gains from delegating tasks to machines, it can also facilitate the delegation of unethical behaviour. Here, we demonstrate this risk by having human principals instruct machine agents to perform a task with an incentive to cheat. Principals’ requests for cheating behaviour increased when the interface implicitly afforded unethical conduct: Machine agents programmed via supervised learning or goal specification evoked more cheating than those programmed with explicit rules. Cheating propensity was unaffected by whether delegation was mandatory or voluntary. Given the recent rise of large language model-based chatbots, we also explored delegation via natural language. Here, cheating requests did not vary between human and machine agents, but compliance diverged: When principals intended agents to cheat to the fullest extent, the majority of human agents did not comply, despite incentives to do so. In contrast, GPT4, a state-of-the-art machine agent, nearly fully complied. Our results highlight ethical risks in delegating tasks to intelligent machines, and suggest design principles and policy responses to mitigate such risks.

Suggested Citation

  • Köbis, Nils & Rahwan, Zoe & Bersch, Clara & Ajaj, Tamer & Bonnefon, Jean-François & Rahwan, Iyad, 2024. "Experimental evidence that delegating to intelligent machines can increase dishonest behaviour," OSF Preprints dnjgz, Center for Open Science.
  • Handle: RePEc:osf:osfxxx:dnjgz
    DOI: 10.31219/osf.io/dnjgz
    as

    Download full text from publisher

    File URL: https://osf.io/download/66ff1479296d9f7e9a5cd2a3/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/dnjgz?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Zhixin Dai & Fabio Galeotti & Marie Claire Villeval, 2018. "Cheating in the Lab Predicts Fraud in the Field: An Experiment in Public Transportation," Management Science, INFORMS, vol. 64(3), pages 1081-1100, March.
    2. Urs Fischbacher & Franziska Föllmi-Heusi, 2013. "Lies In Disguise—An Experimental Study On Cheating," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 525-547, June.
    3. Erat, Sanjiv, 2013. "Avoiding lying: The case of delegated deception," Journal of Economic Behavior & Organization, Elsevier, vol. 93(C), pages 273-278.
    4. Rustagi, Devesh & Kroell, Markus, 2022. "Measuring honesty and explaining adulteration in naturally occurring markets," Journal of Development Economics, Elsevier, vol. 156(C).
    5. Philipp N. Herrmann & Dennis O. Kundisch & Mohammad S. Rahman, 2015. "Beating Irrationality: Does Delegating to IT Alleviate the Sunk Cost Effect?," Management Science, INFORMS, vol. 61(4), pages 831-850, April.
    6. Nils Köbis & Jean-François Bonnefon & Iyad Rahwan, 2021. "Bad machines corrupt good morals," Nature Human Behaviour, Nature, vol. 5(6), pages 679-685, June.
    7. James Dawes, 2017. "The case for and against autonomous weapon systems," Nature Human Behaviour, Nature, vol. 1(9), pages 613-614, September.
    8. Martin G. Kocher & Simeon Schudy & Lisa Spantig, 2018. "I Lie? We Lie! Why? Experimental Evidence on a Dishonesty Shift in Groups," Management Science, INFORMS, vol. 64(9), pages 3995-4008, September.
    9. Emilio Calvano & Giacomo Calzolari & Vincenzo Denicolò & Sergio Pastorello, 2020. "Artificial Intelligence, Algorithmic Pricing, and Collusion," American Economic Review, American Economic Association, vol. 110(10), pages 3267-3297, October.
    10. Alain Cohn & Michel André Maréchal, 2018. "Laboratory Measure of Cheating Predicts School Misconduct," Economic Journal, Royal Economic Society, vol. 128(615), pages 2743-2754, November.
    11. Felix Holzmeister & Martin Holmén & Michael Kirchler & Matthias Stefan & Erik Wengström, 2023. "Delegation Decisions in Finance," Management Science, INFORMS, vol. 69(8), pages 4828-4844, August.
    12. Gogoll, Jan & Uhl, Matthias, 2018. "Rage against the machine: Automation in the moral domain," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 97-103.
    13. Simon Gächter & Jonathan F. Schulz, 2016. "Intrinsic honesty and the prevalence of rule violations across societies," Nature, Nature, vol. 531(7595), pages 496-499, March.
    14. Björn Bartling & Urs Fischbacher, 2012. "Shifting the Blame: On Delegation and Responsibility," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(1), pages 67-87.
    15. Jason Dana & Roberto Weber & Jason Kuang, 2007. "Exploiting moral wiggle room: experiments demonstrating an illusory preference for fairness," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(1), pages 67-80, October.
    16. Jean-François Bonnefon & Iyad Rahwan & Azim Shariff, 2024. "The Moral Psychology of Artificial Intelligence," Post-Print hal-04220044, HAL.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sanjit Dhami, 2017. "Human Ethics and Virtues: Rethinking the Homo-Economicus Model," CESifo Working Paper Series 6836, CESifo.
    2. Nils Köbis & Jean-François Bonnefon & Iyad Rahwan, 2021. "Bad machines corrupt good morals," Nature Human Behaviour, Nature, vol. 5(6), pages 679-685, June.
    3. Irlenbusch, Bernd & Mussweiler, Thomas & Saxler, David J. & Shalvi, Shaul & Weiss, Alexa, 2020. "Similarity increases collaborative cheating," Journal of Economic Behavior & Organization, Elsevier, vol. 178(C), pages 148-173.
    4. Marie Claire Villeval, 2019. "Comportements (non) éthiques et stratégies morales," Revue économique, Presses de Sciences-Po, vol. 70(6), pages 1021-1046.
    5. Muehlheusser, Gerd & Promann, Timo & Roider, Andreas & Wallmeier, Niklas, 2024. "Honesty of Groups: Effects of Size and Gender Composition," IZA Discussion Papers 16954, Institute of Labor Economics (IZA).
    6. Johannes Abeler & Armin Falk & Fabian Kosse, 2021. "Malleability of Preferences for Honesty," CESifo Working Paper Series 9033, CESifo.
    7. Feess, Eberhard & Schilling, Thomas & Timofeyev, Yuriy, 2023. "Misreporting in teams with individual decision making: The impact of information and communication," Journal of Economic Behavior & Organization, Elsevier, vol. 209(C), pages 509-532.
    8. Behnk, Sascha & Hao, Li & Reuben, Ernesto, 2022. "Shifting normative beliefs: On why groups behave more antisocially than individuals," European Economic Review, Elsevier, vol. 145(C).
    9. Dato, Simon & Feess, Eberhard & Nieken, Petra, 2024. "Lying in competitive environments: Identifying behavioral impacts," European Economic Review, Elsevier, vol. 170(C).
    10. Aksoy, Billur & Palma, Marco A., 2019. "The effects of scarcity on cheating and in-group favoritism," Journal of Economic Behavior & Organization, Elsevier, vol. 165(C), pages 100-117.
    11. Heike Hennig‐Schmidt & Hendrik Jürges & Daniel Wiesen, 2019. "Dishonesty in health care practice: A behavioral experiment on upcoding in neonatology," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 319-338, March.
    12. Andrea Albertazzi, 2022. "Individual cheating in the lab: a new measure and external validity," Theory and Decision, Springer, vol. 93(1), pages 37-67, July.
    13. Martinangeli, Andrea F.M. & Windsteiger, Lisa, 2024. "Inequality shapes the propagation of unethical behaviours: Cheating responses to tax evasion along the income distribution," Journal of Economic Behavior & Organization, Elsevier, vol. 220(C), pages 135-181.
    14. Dufwenberg, Martin & Dufwenberg, Martin A., 2018. "Lies in disguise – A theoretical analysis of cheating," Journal of Economic Theory, Elsevier, vol. 175(C), pages 248-264.
    15. Rilke, Rainer Michael & Danilov, Anastasia & Weisel, Ori & Shalvi, Shaul & Irlenbusch, Bernd, 2021. "When leading by example leads to less corrupt collaboration," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 288-306.
    16. Gawn, Glynis & Innes, Robert, 2019. "Lying through others: Does delegation promote deception?," Journal of Economic Psychology, Elsevier, vol. 71(C), pages 59-73.
    17. Celse, Jérémy & Max, Sylvain & Steinel, Wolfgang & Soraperra, Ivan & Shalvi, Shaul, 2019. "Uncertain lies: How payoff uncertainty affects dishonesty," Journal of Economic Psychology, Elsevier, vol. 71(C), pages 117-125.
    18. Olaf Hübler & Melanie Koch & Lukas Menkhoff & Ulrich Schmidt, 2019. "Cheating and Corruption: Evidence from a Household Survey," Discussion Papers of DIW Berlin 1826, DIW Berlin, German Institute for Economic Research.
    19. Kai A. Konrad & Tim Lohse & Sven A. Simon, 2021. "Pecunia non olet: on the self-selection into (dis)honest earning opportunities," Experimental Economics, Springer;Economic Science Association, vol. 24(4), pages 1105-1130, December.
    20. Billur Aksoy & Marco A. Palma, "undated". "The Effects of Scarcity on Cheating and In-Group Favoritism," Working Papers 20180918-001, Texas A&M University, Department of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:dnjgz. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.