How Much Thinking is Enough? Quantifying and Understanding Redundancy in LLM Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Reasoning-capable large language models solve hard problems by emitting long chains of thought, paying heavily in latency, GPU time, and energy. Casual inspection of their traces reveals extensive reformulation, verification, and circular self-reflection, yet how much of this deliberation is actually necessary has never been measured at scale or explained from first principles. This paper closes both gaps. We formalise reasoning redundancy directly in terms of the reasoning model itself: the redundancy of a correct trace is the largest fraction of its trailing segmented steps that can be truncated while π, forced to terminate thinking and emit a final answer, still produces the correct answer. A large-scale quantification across four frontier reasoning models and two mathematical benchmarks shows that step-level redundancy is consistently high -- between 61% and 93% across the 8 (model, benchmark) conditions we study, with the median critical prefix equal to a single segmented step in six of the eight conditions -- that the finding is robust to the choice of judge family, and that although ρ decreases with problem difficulty on MATH-500, all four models remain substantially redundant (ρ ∈ [46%, 85%]) even on the hardest Level-5 problems. We then prove that this redundancy is a structural consequence of length-agnostic outcome rewards, not a model-specific artefact: under any such reward, no finite expected stopping time is optimal. The result holds regardless of RL algorithm, base model, data distribution, or whether the policy is obtained via RL or distillation; over-thinking is therefore not a bug to be patched in individual models but a structural property of how current reasoning models are trained. Code: https://github.com/zhiyuanZhai20/how-much-thinking-is-enough
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 25 of its 43 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
25 of 43 references.
Closest ancestors · 5
Same direction, newest first
- 2025Rethinking Reflection in Pre-Training5 Apr
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning6 Mar
- 2025s1: Simple test-time scaling31 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Token-Budget-Aware LLM Reasoning24 Dec
Other references · 20
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,276
- 2024OpenAI o1 System Cardcited by 1,220
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
8 more
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2025SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wildcited by 505
- 2023Reinforced Self-Training (ReST) for Language Modelingcited by 486
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 479
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
- 2025Training Language Models to Reason Efficientlycited by 242
- 2025Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretrainingcited by 123
- 2025Magistralcited by 57
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
- 2025Think Clearly: Improving Reasoning via Redundant Token Pruning
- 2025Reasoning Relay: Evaluating Stability and Interchangeability of Large Language Models in Mathematical Reasoning
- 2025FINEREASON: Evaluating and Improving LLMs' Deliberate Reasoning through Reflective Puzzle Solving
- 2026Scaling of Capability and Efficiency at Inference Time in Large Reasoning Models
- 2025Lost at the Beginning of Reasoning
- 2025DeduCE: Deductive Consistency as a Framework to Evaluate LLM Reasoning
- 2025THINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models