mlsanityData to 7 Oct 2026

The Moral Mind(s) of Large Language Models

arXiv 2412.04476 ↗First posted 19 Nov 2024cs.CY cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) increasingly participate in tasks with ethical and societal stakes, a critical question arises: do they exhibit an emergent "moral mind" - a consistent structure of moral preferences guiding their decisions - and to what extent is this structure shared across models? To investigate this, we applied tools from revealed preference theory to nearly 40 leading LLMs, presenting each with many structured moral dilemmas spanning five foundational dimensions of ethical reasoning. Using a probabilistic rationality test, we found that at least one model from each major provider exhibited behavior consistent with approximately stable moral preferences, acting as if guided by an underlying utility function. We then estimated these utility functions and found that most models cluster around neutral moral stances. To further characterize heterogeneity, we employed a non-parametric permutation approach, constructing a probabilistic similarity network based on revealed preference patterns. The results reveal a shared core in LLMs' moral reasoning, but also meaningful variation: some models show flexible reasoning across perspectives, while others adhere to more rigid ethical profiles. These findings provide a new empirical lens for evaluating moral consistency in LLMs and offer a framework for benchmarking ethical alignment across AI systems.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 1 of its 31 references that are in the map. First posted on arXiv 19 Nov 2024.

Builds on

1 of 31 references.

References · 1

  1. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
  2. 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoning
  3. 2025From Stability to Inconsistency: A Study of Moral Preferences in LLMs
  4. 2024Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language we Prompt them in
  5. 2025The Convergent Ethics of AI? Analyzing Moral Foundation Priorities in Large Language Models with a Multi-Framework Approach
  6. 2025Differences in the Moral Foundations of Large Language Models
  7. 2025Are Language Models Consequentialist or Deontological Moral Reasoners?
  8. 2024Moral Persuasion in Large Language Models: Evaluating Susceptibility and Ethical Alignment