mlsanityData to 7 Oct 2026

Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models

arXiv 2605.17672 ↗First posted 17 May 2026cs.CLcited by 5

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Large Reasoning Models (LRMs) achieve strong performance by generating long chains of thought (CoT), but often overthink, continuing to reason after a solution has already stabilized and thereby wasting tokens and increasing latency. Existing inference-time early-exit methods rely primarily on answer-level signals, such as confidence or trial-answer consistency, to decide when to stop. However, these signals mainly reflect answer readiness rather than reasoning convergence: they may trigger before the model has finished exploring or self-correcting, causing premature exits that can degrade final-answer accuracy and leave the retained reasoning chain semantically incomplete. We identify reasoning-level semantic redundancy as a complementary signal for semantic-preserving early exit: when successive steps no longer add novel progress and instead revisit established conclusions, the reasoning trajectory has likely converged. Building on this insight, we propose PUMA, a plug-and-play framework that combines a lightweight Redundancy Detector with answer-level verification. The detector flags semantically redundant candidate exits, while verification confirms whether stopping is safe, allowing PUMA to remove redundant continuation while preserving both answer accuracy and a coherent reasoning prefix. Across five LRMs and five challenging reasoning benchmarks, PUMA achieves 26.2% average token reduction while preserving accuracy and retained CoT quality. Additional experiments on code generation, zero-shot vision-language reasoning, and learned stopping-policy internalization further demonstrate that reasoning-level redundancy is a robust, transferable, and learnable signal for efficient reasoning. Our code is available at urlhttps://github.com/giovanni-vaccarino/PUMA.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 28 of its 91 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

28 of 91 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026NEAT: Neuron-Based Early Exit for Large Reasoning Models2 Feb
  2. 2025LYNX: Learning Dynamic Exits for Confidence-Controlled Reasoning5 Dec
  3. 2025Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning11 Oct
  4. 2025Entropy After </Think> for reasoning model early exiting30 Sep
  5. 2025The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis25 Aug
  6. 2025gpt-oss-120b & gpt-oss-20b Model Card8 Aug
  7. 2025TL;DR: Too Long, Do Re-weighting for Efficient LLM Reasoning Compression3 Jun
  8. 2025Group Think: Multiple Concurrent Reasoning Agents Collaborating at Token Level Granularity16 May
  9. 2025Llama-Nemotron: Efficient Reasoning Models2 May
  10. 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs30 Apr
  11. 2025Reasoning Models Can Be Effective Without Thinking14 Apr
  12. 2024Concise Thoughts: Impact of Output Length on LLM Reasoning and Cost29 Jul

Other references · 16

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2024OpenAI o1 System Cardcited by 1,220
  6. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  7. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  8. 2025Kimi K2: Open Agentic Intelligencecited by 523
  9. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  10. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  11. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
  12. 2025Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetycited by 222
4 more
  1. 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 28
  2. 2025Early Stopping Chain-of-thoughts in Large Language Modelscited by 19
  3. 2025MVI-Bench: A Comprehensive Benchmark for Evaluating Robustness to Misleading Visual Inputs in LVLMscited by 14
  4. 2026PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planningcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
  2. 2026Large Language Models Decide Early and Explain Later
  3. 2026TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning
  4. 2026Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring
  5. 2026Beyond the Commitment Boundary: Probing Epiphenomenal Chain-of-Thought in Large Reasoning Models
  6. 2026BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning
  7. 2026The Detection-Extraction Gap: Models Know the Answer Before They Can Say It
  8. 2025Dynamic Early Exit in Reasoning Models