mlsanityData to 14 Oct 2026

Rule vs.Consequence: Dissociable Internal Representations of Moral Reasoning in LLMs

arXiv 2610.16371 ↗First posted 12 Oct 2026cs.CLcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

also in 1 more
Abstract (arXiv)

Large language models are increasingly deployed in morally and legally sensitive contexts, yet little is known about how they internally represent distinctions between moral reasoning styles. We ask whether a model's differential response to rule-framed and consequence-framed moral questions reflects distinct internal structure or merely surface lexical sensitivity. We construct a 2×2 factorial dataset crossing reasoning style (rule-based vs. consequence-based framing) with judgment polarity (permissive vs. prohibitive), drawn from three established moral reasoning benchmarks and evaluated on a cleanroom test set of novel phrasings that includes conflict pairs where the two framings predict opposite labels. Using linear probing and activation steering, we identify two orthogonal directions in the residual stream: Dir-A tracks reasoning style and Dir-B tracks judgment polarity, each near-blind to the other factor (cross-correlation |r| < 0.04). This double dissociation replicates across three instruction-tuned models from different developers at comparable proportional depth, and it is not knife-edged in layer: the directions are recoverable and causally effective throughout an extended band of the network. Dir-A can causally change judgments, and in conflicting scenarios, it selectively corrects errors in rule-based judgments without changing consequence-based judgments, suggesting that it does not simply make the model more likely to accept everything. Generalization beyond the training templates is partial: the direction transfers across benchmark sources, but its advantage over lexical baselines on novel phrasings is modest. We therefore frame the result as moral reasoning style sensitivity, a geometrically dissociable and causally effective structure, rather than internalized normative reasoning.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 23 of its 31 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

23 of 31 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Where Norms and References Collide: Evaluating LLMs on Normative Reasoning3 Feb
  2. 2025Normative Reasoning in Large Language Models: A Comparative Benchmark from Logical and Modal Perspectives30 Oct

Other references · 21

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  6. 2022Toy Models of Superpositioncited by 971
  7. 2023Steering Language Models With Activation Engineeringcited by 922
  8. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  9. 2020Aligning AI With Shared Human Valuescited by 723
  10. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 255
  11. 2020Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequencescited by 135
  12. 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 74
9 more
  1. 2023Evaluating the Zero-shot Robustness of Instruction-tuned Language Modelscited by 66
  2. 2023Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Biascited by 53
  3. 2023Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framingcited by 51
  4. 2024Open (Clinical) LLMs are Sensitive to Instruction Phrasingscited by 24
  5. 2025Disentangling the Drivers of LLM Social Conformity: An Uncertainty-Moderated Dual-Process Mechanismcited by 6
  6. 2025Normative Conflicts and Shallow AI Alignmentcited by 5
  7. 2026Measuring Pragmatic Influence in Large Language Model Instructionscited by 4
  8. 2025Deontological Keyword Bias: The Impact of Modal Expressions on Normative Judgments of Language Modelscited by 3
  9. 2026DeFrame: Debiasing Large Language Models Against Framing Effectscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Understanding Moral Reasoning Trajectories in Large Language Models: Toward Probing-Based Explainability
  2. 2025Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework
  3. 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoning
  4. 2026Reasoning or Rhetoric? An Empirical Analysis of Moral Reasoning Explanations in Large Language Models
  5. 2025Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization
  6. 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
  7. 2026Frame-Conditioned Moral Computation in LLaMA 3.1-8B-Instruct: A Mechanistic Interpretability Audit of Ethical Reasoning
  8. 2025Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoral