The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Ethical decision-making is a critical aspect of human judgment, and the growing use of LLMs in decision-support systems necessitates a rigorous evaluation of their moral reasoning capabilities. However, existing assessments primarily rely on single-step evaluations, failing to capture how models adapt to evolving ethical challenges. Addressing this gap, we introduce the Multi-step Moral Dilemmas (MMDs), the first dataset specifically constructed to evaluate the evolving moral judgments of LLMs across 3,302 five-stage dilemmas. This framework enables a fine-grained, dynamic analysis of how LLMs adjust their moral reasoning across escalating dilemmas. Our evaluation of nine widely used LLMs reveals that their value preferences shift significantly as dilemmas progress, indicating that models recalibrate moral judgments based on scenario complexity. Furthermore, pairwise value comparisons demonstrate that while LLMs often prioritize the value of care, this value can sometimes be superseded by fairness in certain contexts, highlighting the dynamic and context-dependent nature of LLM ethical reasoning. Our findings call for a shift toward dynamic, context-aware evaluation paradigms, paving the way for more human-aligned and value-sensitive development of LLMs.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 19 of its 46 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
19 of 46 references.
Closest ancestors · 1
Same direction, newest first
- 2023Rethinking Machine Ethics -- Can LLMs Perform Moral Reasoning through the Lens of Moral Theories?29 Aug
Other references · 18
- 2023GPT-4 Technical Reportcited by 18,396
- 2016Concrete Problems in AI Safetycited by 1,642
- 2020Aligning AI With Shared Human Valuescited by 723
- 2023AI Alignment: A Comprehensive Surveycited by 263
- 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 255
- 2021Societal Biases in Language Generation: Progress and Challengescited by 202
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 141
- 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 135
- 2022The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systemscited by 93
- 2022When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgmentcited by 93
- 2018'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisionscited by 91
- 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 74
6 more
- 2024DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Lifecited by 59
- 2017A Voting-Based System for Ethical Decision Makingcited by 55
- 2025Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactionscited by 52
- 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 50
- 2023Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learningcited by 26
- 2024CMoralEval: A Moral Evaluation Benchmark for Chinese Large Language Modelscited by 10
Built on by
Citing papers per year: 2025: 5; 2026: 8.
13 papers.
Sort:
By area:
- 2025MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomescited by 23
- 2025Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamicscited by 19
- 2025PRISON: Unmasking the Criminal Potential of Large Language Modelscited by 2
- 2026Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainabilitycited by 1
- 2026Every Act Has Its Price: Compressed Moral Composition in Frontier LLMscited by 1
- 2025Cross-cultural value alignment frameworks for responsible AI governance: Evidence from China-West comparative analysiscited by 0
- 2025Morality in AI. A plea to embed morality in LLM architectures and frameworkscited by 0
- 2026Moral Lenses, Political Coordinates: Towards Ideological Positioning of Morally Conditioned LLMscited by 0
- 2026The Straight and Narrow: Do LLMs Possess an Internal Moral Path?cited by 0
- 2026Visual Distraction Undermines Moral Reasoning in Vision-Language Modelscited by 0
- 2026Staying with the Uncertainty: Uncertainty-Scaffolding Strategies for Artificial Moral Advisors in LLM-to-LLM Simulated Conversationscited by 0
- 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoningcited by 0
- 2026TPvG: A Moral Decision Framework for Large Language Models from One-Shot to Sequential Feedback15 Jul 2026
- 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoning13 Jul 2026
- 2026Staying with the Uncertainty: Uncertainty-Scaffolding Strategies for Artificial Moral Advisors in LLM-to-LLM Simulated Conversations4 Jun 2026
- 2026Every Act Has Its Price: Compressed Moral Composition in Frontier LLMs29 May 2026
- 2026Visual Distraction Undermines Moral Reasoning in Vision-Language Models17 Mar 2026
- 2026Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainability16 Mar 2026
- 2026The Straight and Narrow: Do LLMs Possess an Internal Moral Path?15 Jan 2026
- 2026Moral Lenses, Political Coordinates: Towards Ideological Positioning of Morally Conditioned LLMs13 Jan 2026
- 2025Morality in AI. A plea to embed morality in LLM architectures and frameworks21 Nov 2025
- 2025Cross-cultural value alignment frameworks for responsible AI governance: Evidence from China-West comparative analysis21 Nov 2025
- 2025MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes18 Oct 2025
- 2025PRISON: Unmasking the Criminal Potential of Large Language Models19 Jun 2025
- 2025MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomescited by 23
- 2026Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainabilitycited by 1
- 2026Visual Distraction Undermines Moral Reasoning in Vision-Language Modelscited by 0
- 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoningcited by 0
- 2026MET: Theory-Grounded and Culture-Aware Multilingual Moral Reasoning13 Jul 2026
- 2026Visual Distraction Undermines Moral Reasoning in Vision-Language Models17 Mar 2026
- 2026Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainability16 Mar 2026
- 2025MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes18 Oct 2025
- 2025Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamicscited by 19
- 2025PRISON: Unmasking the Criminal Potential of Large Language Modelscited by 2
- 2026Every Act Has Its Price: Compressed Moral Composition in Frontier LLMscited by 1
- 2025Morality in AI. A plea to embed morality in LLM architectures and frameworkscited by 0
- 2026Moral Lenses, Political Coordinates: Towards Ideological Positioning of Morally Conditioned LLMscited by 0
- 2026Staying with the Uncertainty: Uncertainty-Scaffolding Strategies for Artificial Moral Advisors in LLM-to-LLM Simulated Conversationscited by 0
- 2026TPvG: A Moral Decision Framework for Large Language Models from One-Shot to Sequential Feedbackcited by 0
- 2026TPvG: A Moral Decision Framework for Large Language Models from One-Shot to Sequential Feedback15 Jul 2026
- 2026Staying with the Uncertainty: Uncertainty-Scaffolding Strategies for Artificial Moral Advisors in LLM-to-LLM Simulated Conversations4 Jun 2026
- 2026Every Act Has Its Price: Compressed Moral Composition in Frontier LLMs29 May 2026
- 2026Moral Lenses, Political Coordinates: Towards Ideological Positioning of Morally Conditioned LLMs13 Jan 2026
- 2025Morality in AI. A plea to embed morality in LLM architectures and frameworks21 Nov 2025
- 2025PRISON: Unmasking the Criminal Potential of Large Language Models19 Jun 2025
- 2025Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamics14 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025The Morality of Probability: How Implicit Moral Biases in LLMs May Shape the Future of Human-AI Symbiosis
- 2025The Greatest Good Benchmark: Measuring LLMs' Alignment with Utilitarian Moral Dilemmas
- 2025The Convergent Ethics of AI? Analyzing Moral Foundation Priorities in Large Language Models with a Multi-Framework Approach
- 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
- 2026How Does Thinking Mode Change LLM Moral Judgments? A Controlled Instant-vs-Thinking Comparison Across Five Frontier Models
- 2025Discerning What Matters: A Multi-Dimensional Assessment of Moral Competence in LLMs
- 2025Are Language Models Consequentialist or Deontological Moral Reasoners?
- 2023Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs