Thinking Leakage: A Causal Audit of NoThink Post-Training in Hybrid Reasoning Models
On the map: LLM reasoning → Causal reasoning in LLMs also fits: Prompting and chain-of-thought reasoning
Abstract (arXiv)
Post-training hybrid reasoning models in NoThink mode has attracted growing interest as a way to improve performance while keeping inference fast. However, these gains may draw on thinking behavior already accessible through the base model's Think mode. We formulate this thinking leakage in a causal mediation framework and audit its contribution using bidirectional interventions along a simple base-derived activation direction. Across three models and three post-training methods on competition math benchmarks, we find that leakage is real, causal, and substantial: behavioral and representational analyses reveal shifts toward Think, steering the base model along this direction reproduces most of the post-training accuracy gain, and counter-steering a checkpoint removes a substantial share of what it gains. Across nine aligned checkpoints with positive NoThink gains, the resulting leakage ratio ranges from 42% to 79%. These interventions support a substantial causal contribution of thinking leakage. Our findings show that a post-training method's apparent advantage can therefore reflect greater drift toward Think, obscuring whether it improves capability within NoThink or more effectively re-invokes existing Think behavior.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 19 of its 51 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
19 of 51 references.
References · 19
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2026Learning beyond Teacher: Generalized On-Policy Distillation with Reward Extrapolationcited by 157
- 2025Understanding Reasoning in Thinking Language Models via Steering Vectorscited by 69
7 more
- 2025MiniCPM4: Ultra-Efficient LLMs on End Devicescited by 51
- 2026Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligencecited by 25
- 2025EasySteer: A Unified Framework for High-Performance and Extensible LLM Steeringcited by 13
- 2026On-Policy Self-Distillation without Any Supervisioncited by 11
- 2026Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvementcited by 8
- 2026Bootstrapping Exploration with Group-Level Natural Language Feedback in Reinforcement Learningcited by 5
- 2026AGPO: Asymmetric Group Policy Optimization for Verifiable Reasoning and Search Ads Relevance at JDcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Bypassing the Rationale: Causal Auditing of Implicit Reasoning in Language Models
- 2025AdaptThink: Reasoning Models Can Learn When to Think
- 2025Reasoning Models Can Be Effective Without Thinking
- 2026To Think or Not To Think, That is The Question for Large Reasoning Models in Theory of Mind Tasks
- 2026Final Checkpoints Are Not Enough: Analyzing Latent Reasoning Faithfulness Along Training Trajectories
- 2026NeuReasoner: Theory-grounded Mapping of Reasoning Elicitation Boundaries
- 2025Distributional Biases in Post-Training: A Markovian Analysis of Reasoning Trajectories
- 2026Amplified Does Not Mean Predictive: Reasoning Behaviors in Thinking Models