mlsanityData to 7 Oct 2026

When Does Learning to Stop Help? A Cost-Aware Study of Early Exits in Reasoning Models

arXiv 2606.30852 ↗First posted 29 Jun 2026cs.AI cs.CL cs.LGcited by 1

On the map: LLM reasoning → Test-time compute and efficient thinking

also in 1 more
Abstract (arXiv)

Reasoning models spend test-time compute unevenly across instances, and a growing family of early-exit rules -- confidence thresholds, entropy monitors, answer-stability checks, and learned stoppers -- promises to reclaim the waste. These rules, however, are evaluated under heterogeneous protocols that leave the deployment question unanswered: at a fixed tolerance for losing correct answers, which policy saves more compute, and does the saving survive probe overhead? We answer this question with a controlled study across 18 task-model settings spanning GSM8K, MATH-500, MMLU-Pro, AIME-90, and GPQA on Qwen3 and DeepSeek-R1-distilled models, using LearnStop, a hidden-state-free logistic stopper over prefix-observable features, as the learned policy instrument. Under matched lost-correct risk at α = 0.15, with the scalar competitor selected on calibration data from confidence, entropy, confidence-leap, and run-stability exits, the answer forms three regimes. Learned stopping wins on all four primary Qwen3 free-form math settings (+3.2 to +21.2 pp additional total-token saving); calibrated scalar exits win on multiple-choice MMLU-Pro; and small hard benchmarks (AIME-90, GPQA) admit no certifiable aggressive policy at all. A trajectory decomposition predicts the regime: learning pays where answers oscillate and correctness evidence is spread across complementary signals, while a single confidence threshold suffices where most instances are already solved at the first checkpoint. Cost accounting sharpens the picture further -- the same policy that saves 32% of tokens under KV-cache forking costs 121% extra under black-box repeated prefilling. Together, these results replace the single-method race with a decision procedure for choosing a stopping rule from the trajectory structure and serving regime of the target workload.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 15 of its 18 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

15 of 18 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models17 May
  2. 2026TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning13 Mar
  3. 2026Conformal Thinking: Risk Control for Reasoning on a Compute Budget3 Feb
  4. 2025Entropy After </Think> for reasoning model early exiting30 Sep
  5. 2025Thought calibration: Efficient and confident test-time scaling23 May
  6. 2025Dynamic Early Exit in Reasoning Models22 Apr
  7. 2025s1: Simple test-time scaling31 Jan
  8. 2024Token-Budget-Aware LLM Reasoning24 Dec

Other references · 7

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  3. 2023Let's Verify Step by Stepcited by 3,598
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  5. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  6. 2022Conformal Risk Controlcited by 290
  7. 2023Conformal Language Modelingcited by 163

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Early Stopping for Large Reasoning Models via Confidence Dynamics
  2. 2026Learning to Stop without Learning to Stop: Self-Supervised Confidence Training Improves Reasoning Efficiency
  3. 2025Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning
  4. 2026TRACES: Tagging Reasoning Steps for Adaptive Cost-Efficient Early-Stopping
  5. 2026ESTAR: Early-Stopping Token-Aware Reasoning For Efficient Inference
  6. 2026Statistical Early Stopping for Reasoning Models
  7. 2025LYNX: Learning Dynamic Exits for Confidence-Controlled Reasoning
  8. 2026It's the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectories