The Moral Mind(s) of Large Language Models
Not on the map. Why?
Abstract (arXiv)
As large language models (LLMs) increasingly participate in tasks with ethical and societal stakes, a critical question arises: do they exhibit an emergent "moral mind" - a consistent structure of moral preferences guiding their decisions - and to what extent is this structure shared across models? To investigate this, we applied tools from revealed preference theory to nearly 40 leading LLMs, presenting each with many structured moral dilemmas spanning five foundational dimensions of ethical reasoning. Using a probabilistic rationality test, we found that at least one model from each major provider exhibited behavior consistent with approximately stable moral preferences, acting as if guided by an underlying utility function. We then estimated these utility functions and found that most models cluster around neutral moral stances. To further characterize heterogeneity, we employed a non-parametric permutation approach, constructing a probabilistic similarity network based on revealed preference patterns. The results reveal a shared core in LLMs' moral reasoning, but also meaningful variation: some models show flexible reasoning across perspectives, while others adhere to more rigid ethical profiles. These findings provide a new empirical lens for evaluating moral consistency in LLMs and offer a framework for benchmarking ethical alignment across AI systems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 1 of its 31 references that are in the map. First posted on arXiv 19 Nov 2024.
Builds on
1 of 31 references.
References · 1
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026Would a Large Language Model Pay Extra for a View? Inferring Willingness to Pay from Subjective Choicescited by 3
- 2026Revealed Rationality: Label-Free Evaluation and Regularization from Representation Theoremscited by 3
- 2026To Nuke or Not to Nuke: LLMs' (Missing) Ethical Reasoning and Actions in a High-Stakes Decision-Making Simulationcited by 1
- 2025Morality in AI. A plea to embed morality in LLM architectures and frameworkscited by 0
- 2026Revealed Rationality: Label-Free Evaluation and Regularization from Representation Theorems5 Aug 2026
- 2026To Nuke or Not to Nuke: LLMs' (Missing) Ethical Reasoning and Actions in a High-Stakes Decision-Making Simulation6 Jun 2026
- 2026Would a Large Language Model Pay Extra for a View? Inferring Willingness to Pay from Subjective Choices10 Feb 2026
- 2025Morality in AI. A plea to embed morality in LLM architectures and frameworks21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
- 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoning
- 2025From Stability to Inconsistency: A Study of Moral Preferences in LLMs
- 2024Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language we Prompt them in
- 2025The Convergent Ethics of AI? Analyzing Moral Foundation Priorities in Large Language Models with a Multi-Framework Approach
- 2025Differences in the Moral Foundations of Large Language Models
- 2025Are Language Models Consequentialist or Deontological Moral Reasoners?
- 2024Moral Persuasion in Large Language Models: Evaluating Susceptibility and Ethical Alignment