Not Just the Destination, But the Journey: Reasoning Traces Causally Shape Generalization Behaviors
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Chain-of-Thought (CoT) is often viewed as a window into LLM decision-making, yet recent work suggests it may function merely as post-hoc rationalization. This raises a critical alignment question: Does the reasoning trace causally shape model generalization independent of the final answer? To isolate reasoning's causal effect, we design a controlled experiment holding final harmful answers constant while varying reasoning paths. We construct datasets with textitEvil reasoning embracing malice, textitMisleading reasoning rationalizing harm, and textitSubmissive reasoning yielding to pressure. We train models (0.6B--14B parameters) under multiple paradigms, including question-thinking-answer (QTA), question-thinking (QT), and thinking-only (T-only), and evaluate them in both think and no-think modes. We find that: (1) CoT training could amplify harmful generalization more than standard fine-tuning; (2) distinct reasoning types induce distinct behavioral patterns aligned with their semantics, despite identical final answers; (3) training on reasoning without answer supervision (QT or T-only) is sufficient to alter behavior, proving reasoning carries an independent signal; and (4) these effects persist even when generating answers without reasoning, indicating deep internalization. Our findings demonstrate that reasoning content is causally potent, challenging alignment strategies that supervise only outputs.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 29 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
18 of 29 references.
Closest ancestors · 7
Same direction, newest first
- 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety15 Jul
- 2025When Chain of Thought is Necessary, Language Models Struggle to Evade Monitors7 Jul
- 2025Large language models can learn and generalize steganographic chain-of-thought under process supervision2 Jun
- 2025Mitigating Deceptive Alignment via Self-Monitoring24 May
- 2025Reasoning Models Don't Always Say What They Think8 May
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation14 Mar
- 2023Measuring Faithfulness in Chain-of-Thought Reasoning17 Jul
Other references · 11
- 2025Qwen3 Technical Reportcited by 8,820
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Alignment faking in large language modelscited by 360
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
- 2025Model Organisms for Emergent Misalignmentcited by 91
- 2025Persona Features Control Emergent Misalignmentcited by 86
- 2025Convergent Linear Representations of Emergent Misalignmentcited by 71
- 2025Thought Crime: Backdoors and Emergent Misalignment in Reasoning Modelscited by 65
- 2025Steering Out-of-Distribution Generalization with Concept Ablation Fine-Tuningcited by 39
- 2025DeceptionBench: A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarioscited by 19
- 2025In-Training Defenses against Emergent Misalignment in Language Modelscited by 15
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Post-Hoc Reasoning in Chain of Thought: Decoding and Steering Pre-Committed Answers
- 2026Does Verbose Chain-of-Thought Really Help? In-Distribution Evidence that Content, Not Length, Matters
- 2025Unveiling Confirmation Bias in Chain-of-Thought Reasoning
- 2024How Likely Do LLMs with CoT Mimic Human Reasoning?
- 2026Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning
- 2026Dynamics Within Latent Chain-of-Thought: An Empirical Study of Causal Structure
- 2025Unveiling and Causalizing CoT: A Causal Pespective
- 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithful