Efficient Reasoning Through Suppression of Self-Affirmation Reflections in Large Reasoning Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
While recent advances in large reasoning models have demonstrated remarkable performance, efficient reasoning remains critical due to the rapid growth of output length. Existing optimization approaches highlights a tendency toward "overthinking", yet lack fine-grained analysis. In this work, we focus on Self-Affirmation Reflections: redundant reflective steps that affirm prior content and often occurs after the already correct reasoning steps. Observations of both original and optimized reasoning models reveal pervasive self-affirmation reflections. Notably, these reflections sometimes lead to longer outputs in optimized models than their original counterparts. Through detailed analysis, we uncover an intriguing pattern: compared to other reflections, the leading words (i.e., the first word of sentences) in self-affirmation reflections exhibit a distinct probability bias. Motivated by this insight, we can locate self-affirmation reflections and conduct a train-free experiment demonstrating that suppressing self-affirmation reflections reduces output length without degrading accuracy across multiple models (R1-Distill-Models, QwQ-32B, and Qwen3-32B). Furthermore, we also improve current train-based method by explicitly suppressing such reflections. In our experiments, we achieve length compression of 18.7% in train-free settings and 50.2% in train-based settings for R1-Distill-Qwen-1.5B. Moreover, our improvements are simple yet practical and can be directly applied to existing inference frameworks, such as vLLM. We believe that our findings will provide community insights for achieving more precise length compression and step-level efficient reasoning.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 35 of its 41 references that are in the map. First posted on arXiv 14 Jun 2025.
Builds on
35 of 41 references.
Closest ancestors · 17
Same direction, newest first
- 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
- 2025Rethinking Reflection in Pre-Training5 Apr
- 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models31 Mar
- 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond27 Mar
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
- 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
- 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
- 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
- 2025s1: Simple test-time scaling31 Jan
5 more
- 2025Reward-Guided Speculative Decoding for Efficient LLM Reasoning31 Jan
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
- 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
- 2024Token-Budget-Aware LLM Reasoning24 Dec
- 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representations17 Dec
Other references · 18
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Let's Verify Step by Stepcited by 3,789
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
6 more
- 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 225
- 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 191
- 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
- 2025A Sober Look at Progress in Language Model Reasoning: Pitfalls and Paths to Reproducibilitycited by 93
- 2025Energy Considerations of Large Language Model Inference and Efficiency Optimizationscited by 55
- 2025Confident or Seek Stronger: Exploring Uncertainty-Based On-device LLM Routing From Benchmarking to Generalizationcited by 29
Built on by
Citing papers per year: 2025: 7; 2026: 3.
10 papers.
- 2025EDGE-GRPO: Entropy-Driven GRPO with Guided Error Correction for Advantage Diversitycited by 41
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Modelscited by 37
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Surveycited by 18
- 2025DRPO: Efficient Reasoning via Decoupled Reward Policy Optimizationcited by 16
- 2025Reconsidering Overthinking: Penalizing Internal and External Redundancy in CoT Reasoningcited by 13
- 2025Controlling Thinking Speed in Reasoning Modelscited by 10
- 2026Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Modelscited by 8
- 2025Where Did This Sentence Come From? Tracing Provenance in LLM Reasoning Distillationcited by 6
- 2026Visual Para-Thinker++: A Single-Policy Multi-Agent Framework for Visual Reasoningcited by 1
- 2026Beyond Model Scaling: Test-Time Intervention for Efficient Deep Reasoningcited by 0
- 2026Visual Para-Thinker++: A Single-Policy Multi-Agent Framework for Visual Reasoning8 Jun 2026
- 2026Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Models16 Jan 2026
- 2026Beyond Model Scaling: Test-Time Intervention for Efficient Deep Reasoning16 Jan 2026
- 2025Where Did This Sentence Come From? Tracing Provenance in LLM Reasoning Distillation24 Dec 2025
- 2025DRPO: Efficient Reasoning via Decoupled Reward Policy Optimization6 Oct 2025
- 2025Reconsidering Overthinking: Penalizing Internal and External Redundancy in CoT Reasoning4 Aug 2025
- 2025Don't Overthink It: A Survey of Efficient R1-style Large Reasoning Models4 Aug 2025
- 2025EDGE-GRPO: Entropy-Driven GRPO with Guided Error Correction for Advantage Diversity29 Jul 2025
- 2025Towards Concise and Adaptive Thinking in Large Reasoning Models: A Survey13 Jul 2025
- 2025Controlling Thinking Speed in Reasoning Models4 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025ReflCtrl: Controlling LLM Reflection Efficiently via Representation Engineering
- 2026Improving reasoning at inference time via uncertainty minimisation
- 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Models
- 2025Reflective Confidence: Correcting Reasoning Flaws via Online Self-Correction
- 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency
- 2025Thinking Out Loud: Do Reasoning Models Know When They're Right?
- 2025Selection, Reflection and Self-Refinement: Revisit Reasoning Tasks via a Causal Lens
- 2025Lost at the Beginning of Reasoning