mlsanityData to 14 Oct 2026

The Morality of Probability: How Implicit Moral Biases in LLMs May Shape the Future of Human-AI Symbiosis

arXiv 2509.10297 ↗First posted 12 Sep 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence (AI) is advancing at a pace that raises urgent questions about how to align machine decision-making with human moral values. This working paper investigates how leading AI systems prioritize moral outcomes and what this reveals about the prospects for human-AI symbiosis. We address two central questions: (1) What moral values do state-of-the-art large language models (LLMs) implicitly favour when confronted with dilemmas? (2) How do differences in model architecture, cultural origin, and explainability affect these moral preferences? To explore these questions, we conduct a quantitative experiment with six LLMs, ranking and scoring outcomes across 18 dilemmas representing five moral frameworks. Our findings uncover strikingly consistent value biases. Across all models, Care and Virtue values outcomes were rated most moral, while libertarian choices were consistently penalized. Reasoning-enabled models exhibited greater sensitivity to context and provided richer explanations, whereas non-reasoning models produced more uniform but opaque judgments. This research makes three contributions: (i) Empirically, it delivers a large-scale comparison of moral reasoning across culturally distinct LLMs; (ii) Theoretically, it links probabilistic model behaviour with underlying value encodings; (iii) Practically, it highlights the need for explainability and cultural awareness as critical design principles to guide AI toward a transparent, aligned, and symbiotic future.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 41 references that are in the map. First posted on arXiv 12 Sep 2025.

Builds on

12 of 41 references.

References · 12

  1. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  2. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  3. 2024Phi-4 Technical Reportcited by 711
  4. 2024Frontier Models are Capable of In-context Schemingcited by 287
  5. 2023When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviourcited by 62
  6. 2021Hybrid Intelligencecited by 55
  7. 2017Cooperating with Machinescited by 39
  8. 2024Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactionscited by 20
  9. 2021Value alignment: a formal approachcited by 18
  10. 2021Human-AI Symbiosis: A Survey of Current Approachescited by 8
  11. 2024Heuristic Reasoning in AI: Instrumental Use and Mimetic Absorptioncited by 3
  12. 2025Super Co-alignment of Human and AI for Sustainable Symbiotic Societycited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Cultural Bias in Large Language Models: Evaluating AI Agents through Moral Questionnaires
  2. 2024The Moral Turing Test: Evaluating Human-LLM Alignment in Moral Decision-Making
  3. 2025The Convergent Ethics of AI? Analyzing Moral Foundation Priorities in Large Language Models with a Multi-Framework Approach
  4. 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
  5. 2025Dropouts in Confidence: Moral Uncertainty in Human-LLM Alignment
  6. 2025MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes
  7. 2025Exploring Persona-dependent LLM Alignment for the Moral Machine Experiment
  8. 2024Language Model Alignment in Multilingual Trolley Problems