IDEAS home Printed from https://ideas.repec.org/p/aim/wpaimx/2433.html
   My bibliography  Save this paper

The Moral Mind(s) of Large Language Models

Author

Abstract

As large language models (LLMs) become integrated to decision-making across various sectors, a key question arises: do they exhibit an emergent "moral mind" - a consistent set of moral principles guiding their ethical judgments - and is this reasoning uniform or diverse across models? To investigate this, we presented about forty different models from the main providers with a large array of structured ethical scenarios, creating one of the largest datasets of its kind. Our rationality tests revealed that at least one model from each provider demonstrated behavior consistent with stable moral principles, effectively acting as approximately optimizing a utility function encoding ethical reasoning. We identified these utility functions and observed a notable clustering of models around neutral ethical stances. To investigate variability, we introduced a novel non-parametric permutation approach, revealing that the most rational models shared 59% to 76% of their ethical reasoning patterns. Despite this shared foundation, differences emerged: roughly half displayed greater moral adaptability, bridging diverse perspectives, while the remainder adhered to more rigid ethical structures.

Suggested Citation

  • Avner Seror, 2024. "The Moral Mind(s) of Large Language Models," AMSE Working Papers 2433, Aix-Marseille School of Economics, France.
  • Handle: RePEc:aim:wpaimx:2433
    as

    Download full text from publisher

    File URL: https://www.amse-aixmarseille.fr/sites/default/files/working_papers/wp_2024_-_nr_33.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Varian, Hal R, 1982. "The Nonparametric Approach to Demand Analysis," Econometrica, Econometric Society, vol. 50(4), pages 945-973, July.
    2. Bart Smeulders & Laurens Cherchye & Bram De Rock & Frits C. R. Spieksma, 2013. "The Money Pump as a Measure of Revealed Preference Violations: A Comment," Journal of Political Economy, University of Chicago Press, vol. 121(6), pages 1248-1258.
    3. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    4. Heufer, Jan & Hjertstrand, Per, 2015. "Consistent subsets: Computationally feasible methods to compute the Houtman–Maks-index," Economics Letters, Elsevier, vol. 128(C), pages 87-89.
    5. Yoram Halevy & Dotan Persitz & Lanny Zrill, 2018. "Parametric Recoverability of Preferences," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1558-1593.
    6. Federico Echenique & Sangmok Lee & Matthew Shum, 2011. "The Money Pump as a Measure of Revealed Preference Violations," Journal of Political Economy, University of Chicago Press, vol. 119(6), pages 1201-1223.
    7. Varian, Hal R., 1990. "Goodness-of-fit in optimizing models," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 125-140.
    8. James Andreoni & John Miller, 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism," Econometrica, Econometric Society, vol. 70(2), pages 737-753, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Smeulders, Bart & Crama, Yves & Spieksma, Frits C.R., 2019. "Revealed preference theory: An algorithmic outlook," European Journal of Operational Research, Elsevier, vol. 272(3), pages 803-815.
    2. Dziewulski, Paweł, 2020. "Just-noticeable difference as a behavioural foundation of the critical cost-efficiency index," Journal of Economic Theory, Elsevier, vol. 188(C).
    3. Andreas C Drichoutis & Rodolfo M Nayga, 2020. "Economic Rationality under Cognitive Load," The Economic Journal, Royal Economic Society, vol. 130(632), pages 2382-2409.
    4. Thomas Demuynck & John Rehbeck, 2023. "Computing revealed preference goodness-of-fit measures with integer programming," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 76(4), pages 1175-1195, November.
    5. Avner Seror, 2022. "The Priced Survey Methodology," AMSE Working Papers 2224, Aix-Marseille School of Economics, France.
    6. Dziewulski, Paweł & Lanier, Joshua & Quah, John K.-H., 2024. "Revealed preference and revealed preference cycles: A survey," Journal of Mathematical Economics, Elsevier, vol. 113(C).
    7. Mir Adnan Mahmood & John Rehbeck, 2022. "Correcting for Random Budgets in Revealed Preference Experiments," Games, MDPI, vol. 13(2), pages 1-14, April.
    8. Pawel Dziewulski, 2018. "Just-noticeable difference as a behavioural foundation of the critical cost-efficiency," Economics Series Working Papers 848, University of Oxford, Department of Economics.
    9. Demuynck, Thomas & Hjertstrand, Per, 2019. "Samuelson's Approach to Revealed Preference Theory: Some Recent Advances," Working Paper Series 1274, Research Institute of Industrial Economics.
    10. Jim Engle-Warnick & Natalia Mishagina, 2014. "Insensitivity to Prices in a Dictator Game," CIRANO Working Papers 2014s-19, CIRANO.
    11. Jan Heufer & Per Hjertstrand, 2015. "Homothetic Efficiency and Test Power: A Non-Parametric Approach," Tinbergen Institute Discussion Papers 15-064/I, Tinbergen Institute.
    12. Kohei Shiozawa, 2015. "Revealed Preference Test and Shortest Path Problem; Graph Theoretic Structure of the Rationalizability Test," Discussion Papers in Economics and Business 15-17-Rev.2, Osaka University, Graduate School of Economics, revised Aug 2016.
    13. Aluma Dembo & Shachar Kariv & Matthew Polisson & John Quah, 2021. "Ever since Allais," IFS Working Papers W21/15, Institute for Fiscal Studies.
    14. Geoffroy de Clippel & Kareen Rozen, 2018. "Consumer Theory with Misperceived Tastes," Working Papers 2018-10, Brown University, Department of Economics.
    15. Shiozawa, Kohei, 2016. "Revealed preference test and shortest path problem; graph theoretic structure of the rationalizability test," Journal of Mathematical Economics, Elsevier, vol. 67(C), pages 38-48.
    16. Kohei Shiozawa, 2015. "Revealed Preference Test and Shortest Path Problem; Graph Theoretic Structure of the Rationalizability Test," Discussion Papers in Economics and Business 15-17-Rev., Osaka University, Graduate School of Economics, revised Jul 2015.
    17. Carrillo, Juan & Brocas, Isabelle & Combs, T. Dalton, 2015. "Consistency in Simple vs. Complex Choices over the Life Cycle," CEPR Discussion Papers 10457, C.E.P.R. Discussion Papers.
    18. Kohei Shiozawa, 2015. "Note on goodness-of-fit measures for the revealed preference test: The computational complexity of the minimum cost index," Economics Bulletin, AccessEcon, vol. 35(4), pages 2455-2461.
    19. Castillo, Marco & Freer, Mikhail, 2018. "Revealed differences," Journal of Economic Behavior & Organization, Elsevier, vol. 145(C), pages 202-217.
    20. Laurens Cherchye & Thomas Demuynck & Bram De Rock & Joshua Lanier, 2020. "Are Consumers Rational ?Shifting the Burden of Proof," Working Papers ECARES 2020-19, ULB -- Universite Libre de Bruxelles.

    More about this item

    Keywords

    Decision Theory; revealed preference; Rationality; artificial intelligence; LLM; PSM.;
    All these keywords.

    JEL classification:

    • D9 - Microeconomics - - Micro-Based Behavioral Economics
    • C9 - Mathematical and Quantitative Methods - - Design of Experiments
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aim:wpaimx:2433. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gregory Cornu (email available below). General contact details of provider: https://edirc.repec.org/data/amseafr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.