mlsanityData to 14 Oct 2026

Efficient Reasoning Through Suppression of Self-Affirmation Reflections in Large Reasoning Models

arXiv 2506.12353 ↗First posted 14 Jun 2025cs.CL cs.AIcited by 10

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

While recent advances in large reasoning models have demonstrated remarkable performance, efficient reasoning remains critical due to the rapid growth of output length. Existing optimization approaches highlights a tendency toward "overthinking", yet lack fine-grained analysis. In this work, we focus on Self-Affirmation Reflections: redundant reflective steps that affirm prior content and often occurs after the already correct reasoning steps. Observations of both original and optimized reasoning models reveal pervasive self-affirmation reflections. Notably, these reflections sometimes lead to longer outputs in optimized models than their original counterparts. Through detailed analysis, we uncover an intriguing pattern: compared to other reflections, the leading words (i.e., the first word of sentences) in self-affirmation reflections exhibit a distinct probability bias. Motivated by this insight, we can locate self-affirmation reflections and conduct a train-free experiment demonstrating that suppressing self-affirmation reflections reduces output length without degrading accuracy across multiple models (R1-Distill-Models, QwQ-32B, and Qwen3-32B). Furthermore, we also improve current train-based method by explicitly suppressing such reflections. In our experiments, we achieve length compression of 18.7% in train-free settings and 50.2% in train-based settings for R1-Distill-Qwen-1.5B. Moreover, our improvements are simple yet practical and can be directly applied to existing inference frameworks, such as vLLM. We believe that our findings will provide community insights for achieving more precise length compression and step-level efficient reasoning.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 35 of its 41 references that are in the map. First posted on arXiv 14 Jun 2025.

Builds on

35 of 41 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025SEAL: Steerable Reasoning Calibration of Large Language Models for Free7 Apr
  2. 2025Rethinking Reflection in Pre-Training5 Apr
  3. 2025Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models31 Mar
  4. 2025A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond27 Mar
  5. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models20 Mar
  6. 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
  7. 2025DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models6 Mar
  8. 2025How Well do LLMs Compress Their Own Chain-of-Thought? A Token Complexity Approach3 Mar
  9. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMs17 Feb
  10. 2025CoT-Valve: Length-Compressible Chain-of-Thought Tuning13 Feb
  11. 2025Demystifying Long Chain-of-Thought Reasoning in LLMs5 Feb
  12. 2025s1: Simple test-time scaling31 Jan
5 more
  1. 2025Reward-Guided Speculative Decoding for Efficient LLM Reasoning31 Jan
  2. 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan
  3. 2025O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning22 Jan
  4. 2024Token-Budget-Aware LLM Reasoning24 Dec
  5. 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representations17 Dec

Other references · 18

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2023Let's Verify Step by Stepcited by 3,789
  7. 2021Program Synthesis with Large Language Modelscited by 3,637
  8. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  9. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  10. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  11. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  12. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 297
6 more
  1. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 225
  2. 2024Let's Think Dot by Dot: Hidden Computation in Transformer Language Modelscited by 191
  3. 2025Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired Sketchingcited by 117
  4. 2025A Sober Look at Progress in Language Model Reasoning: Pitfalls and Paths to Reproducibilitycited by 93
  5. 2025Energy Considerations of Large Language Model Inference and Efficiency Optimizationscited by 55
  6. 2025Confident or Seek Stronger: Exploring Uncertainty-Based On-device LLM Routing From Benchmarking to Generalizationcited by 29

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 7; 2026: 3.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReflCtrl: Controlling LLM Reflection Efficiently via Representation Engineering
  2. 2026Improving reasoning at inference time via uncertainty minimisation
  3. 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Models
  4. 2025Reflective Confidence: Correcting Reasoning Flaws via Online Self-Correction
  5. 2025Wait, We Don't Need to "Wait"! Removing Thinking Tokens Improves Reasoning Efficiency
  6. 2025Thinking Out Loud: Do Reasoning Models Know When They're Right?
  7. 2025Selection, Reflection and Self-Refinement: Revisit Reasoning Tasks via a Causal Lens
  8. 2025Lost at the Beginning of Reasoning