mlsanityData to 14 Oct 2026

Where Paths Split: Localized, Calibrated Control of Moral Reasoning in Large Language Models

arXiv 2605.03609 ↗First posted 5 May 2026cs.AI cs.LGcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models often display heterogeneous moral preferences across settings. We study inference-time steering toward a desired ethical framework while preserving general competence. We present Convergent-Divergent Routing, which traces and edits minimal branch points inside transformer blocks where ethical-framework-related pathways first converge and then diverge. Gating non-target branches at these loci blocks the downstream propagation while leaving upstream computations intact. We find that this intervention alone increases targeted ethical-framework reasoning. To achieve fine-grained control, we adapt Common Spatial Patterns to the residual stream and extract, for each branch-point layer, a pair of directions that discriminate between utilitarian and deontological frameworks. We then introduce Dual Logit Calibration, a closed-form, minimum-ℓ2-norm update that moves the residual within this two-dimensional subspace so the resulting directional projections align with user-specified preference weights. Experiments on real-life moral dilemmas show that our method reliably achieves preference calibration and largely preserves general capabilities, outperforming recent baselines while providing an interpretable mechanism.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 15 of its 52 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

15 of 52 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas10 Aug
  2. 2025Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework17 Jun

Other references · 13

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2023Steering Language Models With Activation Engineeringcited by 922
  5. 2024Yi: Open Foundation Models by 01.AIcited by 719
  6. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  7. 2024A Roadmap to Pluralistic Alignmentcited by 184
  8. 2024DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Lifecited by 59
  9. 2024AI PERSONA: Towards Life-long Personalization of LLMscited by 32
  10. 2025Improved Representation Steering for Language Modelscited by 21
  11. 2025Addressing Moral Uncertainty using Large Language Models for Ethical Decision-Makingcited by 3
  12. 2025MidPO: Dual Preference Optimization for Safety and Helpfulness in Large Language Models via a Mixture of Experts Frameworkcited by 3
1 more
  1. 2024Is ETHICS about ethics? Evaluating the ETHICS benchmarkcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainability
  2. 2025Probabilistic Aggregation and Targeted Embedding Optimization for Collective Moral Reasoning in Large Language Models
  3. 2026CORDA: A Benchmark for Hierarchical Harm-Centric Moral Reasoning in Large Language Models
  4. 2025Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization
  5. 2026Mechanistic Origin of Moral Indifference in Language Models
  6. 2025The Convergent Ethics of AI? Analyzing Moral Foundation Priorities in Large Language Models with a Multi-Framework Approach
  7. 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoning
  8. 2026A Geometric Perspective on Stabilizing Value Conflict Resolution