Reflection Steering: Disentangling Reflection from Reasoning in Activation Space for Token-Efficient Inference
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large reasoning models often produce reasoning traces with verification, revision, and backtracking. When reflection merely re-checks established results, it wastes reasoning tokens and increases latency. Most existing reflection steering methods add a label-derived mean-difference direction across preset layers, but its entanglement with reasoning and length signals destabilizes the accuracy-efficiency trade-off. In this paper, we propose Reflection Steering, a training-free framework for controlling reflection-associated computation within LLMs by disentangling reflection-related activations from general reasoning. Specifically, we contrast reflective and non-reflective hidden states at each LLM layer, denoise the resulting reflection directions with PCA, and orthogonalize them against general-reasoning directions. To limit downstream amplification from early-layer interventions, we calibrate each layer across multiple intervention strengths on a small set, retain only stable layers, and apply bounded projection removal to their residual-stream activations. We conduct extensive experiments across two public benchmarks and three open-weight LLMs against state-of-the-art activation-steering baselines. Results show that Reflection Steering reduces reasoning tokens by 16.9% on average across six matched settings. Besides, our method further introduces a bounded reflection intervention-strength parameter α, enabling deployment-time adjustment to balance token savings, accuracy, and generation stability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 0 of its 30 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
0 of 30 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ReflCtrl: Controlling LLM Reflection Efficiently via Representation Engineering
- 2025Reflective Confidence: Correcting Reasoning Flaws via Online Self-Correction
- 2026ReFlect: An Effective Harness System for Complex Long-Horizon LLM Reasoning
- 2025Unveiling the Latent Directions of Reflection in Large Language Models
- 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Models
- 2026Reflective Recovery: A Self-Supervised Method for Reasoning by Learning from Mistakes
- 2024Mirror: A Multiple-perspective Self-Reflection Method for Knowledge-rich Reasoning
- 2025Reasoning-Finetuning Repurposes Latent Representations in Base Models