mlsanityData to 14 Oct 2026

Reflection Steering: Disentangling Reflection from Reasoning in Activation Space for Token-Efficient Inference

arXiv 2608.25542 ↗First posted 26 Aug 2026cs.LG cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large reasoning models often produce reasoning traces with verification, revision, and backtracking. When reflection merely re-checks established results, it wastes reasoning tokens and increases latency. Most existing reflection steering methods add a label-derived mean-difference direction across preset layers, but its entanglement with reasoning and length signals destabilizes the accuracy-efficiency trade-off. In this paper, we propose Reflection Steering, a training-free framework for controlling reflection-associated computation within LLMs by disentangling reflection-related activations from general reasoning. Specifically, we contrast reflective and non-reflective hidden states at each LLM layer, denoise the resulting reflection directions with PCA, and orthogonalize them against general-reasoning directions. To limit downstream amplification from early-layer interventions, we calibrate each layer across multiple intervention strengths on a small set, retain only stable layers, and apply bounded projection removal to their residual-stream activations. We conduct extensive experiments across two public benchmarks and three open-weight LLMs against state-of-the-art activation-steering baselines. Results show that Reflection Steering reduces reasoning tokens by 16.9% on average across six matched settings. Besides, our method further introduces a bounded reflection intervention-strength parameter α, enabling deployment-time adjustment to balance token savings, accuracy, and generation stability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 0 of its 30 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

0 of 30 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReflCtrl: Controlling LLM Reflection Efficiently via Representation Engineering
  2. 2025Reflective Confidence: Correcting Reasoning Flaws via Online Self-Correction
  3. 2026ReFlect: An Effective Harness System for Complex Long-Horizon LLM Reasoning
  4. 2025Unveiling the Latent Directions of Reflection in Large Language Models
  5. 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Models
  6. 2026Reflective Recovery: A Self-Supervised Method for Reasoning by Learning from Mistakes
  7. 2024Mirror: A Multiple-perspective Self-Reflection Method for Knowledge-rich Reasoning
  8. 2025Reasoning-Finetuning Repurposes Latent Representations in Base Models