Every Act Has Its Price: Compressed Moral Composition in Frontier LLMs
Not on the map. Why?
Abstract (arXiv)
Existing LLM moral benchmarks usually ask which isolated moral act, value, or foundation a model prefers. This is useful but incomplete. Realistic judgments often require a model to combine several moral signals within the same option. We introduce **Moral Trolley Arena**, a two-stage blind ELO benchmark for measuring how LLMs compose moral evidence. The single-scene arena first calibrates individual moral acts from a 229-scenario corpus across five Moral Foundations Theory foundations; the composite arena then combines calibrated acts into two-act moral items over a controlled intensity grid and measures the resulting composite preferences. Across ten frontier models, composite judgments are largely predicted by component act strength, but the relation is consistently compressed rather than simply additive. Models also show non-additive intensity anchoring, bounded foundation-specific residuals after component control, and highly convergent composite preference surfaces across providers. These results suggest that moral audits should measure composition rules for moral evidence, not only rankings over isolated acts.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
14 of 27 references.
References · 14
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
- 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 211
- 2022When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgmentcited by 93
- 2024Language Model Alignment in Multilingual Trolley Problemscited by 46
- 2025MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomescited by 22
- 2025Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamicscited by 19
- 2025Will AI Tell Lies to Save Sick Children? Litmus-Testing AI Values Prioritization with AIRiskDilemmascited by 17
- 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmascited by 13
Built on by
Citing papers per year: 2026: 1.
1 paper.