Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large Reasoning Models (LRMs) achieve strong performance by generating long chains of thought (CoT), but often overthink, continuing to reason after a solution has already stabilized and thereby wasting tokens and increasing latency. Existing inference-time early-exit methods rely primarily on answer-level signals, such as confidence or trial-answer consistency, to decide when to stop. However, these signals mainly reflect answer readiness rather than reasoning convergence: they may trigger before the model has finished exploring or self-correcting, causing premature exits that can degrade final-answer accuracy and leave the retained reasoning chain semantically incomplete. We identify reasoning-level semantic redundancy as a complementary signal for semantic-preserving early exit: when successive steps no longer add novel progress and instead revisit established conclusions, the reasoning trajectory has likely converged. Building on this insight, we propose PUMA, a plug-and-play framework that combines a lightweight Redundancy Detector with answer-level verification. The detector flags semantically redundant candidate exits, while verification confirms whether stopping is safe, allowing PUMA to remove redundant continuation while preserving both answer accuracy and a coherent reasoning prefix. Across five LRMs and five challenging reasoning benchmarks, PUMA achieves 26.2% average token reduction while preserving accuracy and retained CoT quality. Additional experiments on code generation, zero-shot vision-language reasoning, and learned stopping-policy internalization further demonstrate that reasoning-level redundancy is a robust, transferable, and learnable signal for efficient reasoning. Our code is available at urlhttps://github.com/giovanni-vaccarino/PUMA.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 28 of its 91 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
28 of 91 references.
Closest ancestors · 12
Same direction, newest first
- 2026NEAT: Neuron-Based Early Exit for Large Reasoning Models2 Feb
- 2025LYNX: Learning Dynamic Exits for Confidence-Controlled Reasoning5 Dec
- 2025Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning11 Oct
- 2025Entropy After </Think> for reasoning model early exiting30 Sep
- 2025The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis25 Aug
- 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
- 2025TL;DR: Too Long, Do Re-weighting for Efficient LLM Reasoning Compression3 Jun
- 2025Group Think: Multiple Concurrent Reasoning Agents Collaborating at Token Level Granularity16 May
- 2025Llama-Nemotron: Efficient Reasoning Models2 May
- 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs30 Apr
- 2025Reasoning Models Can Be Effective Without Thinking14 Apr
- 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Cost29 Jul
Other references · 16
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2024OpenAI o1 System Cardcited by 1,220
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
- 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
- 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 222
4 more
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 28
- 2025Early Stopping Chain-of-thoughts in Large Language Modelscited by 19
- 2025MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMscited by 14
- 2026PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planningcited by 6
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026TSRouter: Dynamic Modality-Model Selection for Time Series Reasoningcited by 2
- 2026When Does Learning to Stop Help? A Cost-Aware Study of Early Exits in Reasoning Modelscited by 1
- 2026CUSUM-Shaped Inference-Time Monitoring and Targeted Re-Decoding for Quantized Small Language Model Reasoningcited by 1
- 2026Stable Answers, Unfinished Reasoning: Why Self-Consensus Is Not a Safe Early-Exit Signalcited by 0
- 2026Settle: Learning When to Stop Reasoningcited by 0
- 2026Settle: Learning When to Stop Reasoning30 Sep 2026
- 2026Stable Answers, Unfinished Reasoning: Why Self-Consensus Is Not a Safe Early-Exit Signal9 Sep 2026
- 2026CUSUM-Shaped Inference-Time Monitoring and Targeted Re-Decoding for Quantized Small Language Model Reasoning22 Jul 2026
- 2026TSRouter: Dynamic Modality-Model Selection for Time Series Reasoning9 Jul 2026
- 2026When Does Learning to Stop Help? A Cost-Aware Study of Early Exits in Reasoning Models29 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
- 2026Large Language Models Decide Early and Explain Later
- 2026TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning
- 2026Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring
- 2026Beyond the Commitment Boundary: Probing Epiphenomenal Chain-of-Thought in Large Reasoning Models
- 2026BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning
- 2026The Detection-Extraction Gap: Models Know the Answer Before They Can Say It
- 2025Dynamic Early Exit in Reasoning Models