ReflCtrl: Controlling LLM Reflection Efficiently via Representation Engineering
On the map: LLM reasoning → Test-time compute and efficient thinking
also in 1 more
Abstract (arXiv)
Large reasoning models achieve strong performance on diverse tasks by producing extended chains of thought. Self-reflection, the ability to review and revise prior reasoning steps, is widely regarded as a key contributor to this performance. However, self-reflection also incurs substantial inference cost, and its governing mechanism remains underexplored. In this work, we study self-reflection through the lens of representation engineering. First, we identify a reflection direction in the model's latent space that separates reflection steps from non-reflection steps, and show that activation along this direction is strongly predictive of answer correctness, suggesting that self-reflection is regulated by the model's internal uncertainty. Next, building on this insight, we propose ReflCtrl, a framework that controls self-reflection via a stepwise steering method: interventions are applied only at the start of each new reasoning step, enabling fine-grained control over reflection frequency without degrading generation quality. Experiments across math and general reasoning benchmarks show that reflection is often redundant, especially in stronger models: ReflCtrl reduces total reasoning tokens by up to 43.2% while preserving accuracy, and substantially outperforms the conventional approach that steers at every token, at matched token budgets.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 27 of its 34 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
27 of 34 references.
Closest ancestors · 10
Same direction, newest first
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency10 Jun
- 2025Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Training20 May
- 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs30 Apr
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
- 2025Understanding Aha Moments: from External Observations to Internal Mechanisms3 Apr
- 2025ThinkEdit: Interpretable Weight Editing to Mitigate Overly Short Thinking in Reasoning Models27 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025s1: Simple test-time scaling31 Jan
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
- 2023Large Language Models Cannot Self-Correct Reasoning Yet3 Oct
Other references · 17
- 2017Attention Is All You Needcited by 60,361
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
5 more
- 2020Reducing conversational agents' overconfidence through linguistic calibrationcited by 210
- 2024VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidancecited by 65
- 2024Concept Bottleneck Large Language Modelscited by 43
- 2025Interpretable Generative Models through Post-hoc Concept Bottleneckscited by 11
- 2025Effective Skill Unlearning through Intervention and Abstentioncited by 9
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Models
- 2024Mirror: A Multiple-perspective Self-Reflection Method for Knowledge-rich Reasoning
- 2026ReFlect: An Effective Harness System for Complex Long-Horizon LLM Reasoning
- 2025Reflective Confidence: Correcting Reasoning Flaws via Online Self-Correction
- 2026Reflection Steering: Disentangling Reflection from Reasoning in Activation Space for Token-Efficient Inference
- 2025From Emergence to Control: Probing and Modulating Self-Reflection in Language Models
- 2025Efficient Reasoning Through Suppression of Self-Affirmation Reflections in Large Reasoning Models
- 2025Instruct-of-Reflection: Enhancing Large Language Models Iterative Reflection Capabilities via Dynamic-Meta Instruction