mlsanityData to 7 Oct 2026

BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning

arXiv 2607.28966 ↗First posted 31 Jul 2026cs.CLcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large language models often improve task performance by generating long reasoning traces, but the resulting computation is frequently wasted on redundant verification and revision. Existing probe-based early-exit approaches mainly inspect explicit self-doubt expressions, leaving many earlier termination opportunities undetected. Expanding inspection to ordinary reasoning boundaries improves coverage, but also exposes highly diverse intermediate states whose predictive information may reside in different hidden layers. We present Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning (BLADE), a lightweight framework that dynamically terminates reasoning by estimating whether the generated prefix is sufficient for correct answering. BLADE constructs multi-granular checkpoints from sentence, self-doubt, and paragraph boundaries, and derives robust training labels through repeated answer completions. It further learns a compact subset of informative probe layers instead of relying on fixed choices or expensive representations from all layers. At inference time, calibrated predictions are combined with checkpoint-specific confirmation rules to balance responsiveness and premature-exit risk. Experiments on five benchmarks and two Qwen3 reasoning models show that BLADE preserves near-baseline accuracy while reducing generated tokens by 24.8% on Qwen3-8B and 15.8% on Qwen3-4B. Ablation studies further confirm the benefits of diverse checkpoints and automatic layer selection, demonstrating an effective approach to more efficient LLM reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 10 of its 28 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

10 of 28 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring15 Mar
  2. 2026Structured Reasoning for Large Language Models12 Jan
  3. 2025Native Parallel Reasoner: Reasoning in Parallelism via Self-Distilled Reinforcement Learning8 Dec
  4. 2025LYNX: Learning Dynamic Exits for Confidence-Controlled Reasoning5 Dec
  5. 2025Revisiting Overthinking in Long Chain-of-Thought from the Perspective of Self-Doubt29 May
  6. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec

Other references · 4

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  4. 2025Your Dense Retriever is Secretly an Expeditious Reasonercited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention
  2. 2026Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
  3. 2026SABER: Stability-Aware Early Exit for LLM Reasoning via Adversarial Branch Probing
  4. 2026Tandem: Riding Together with Large and Small Language Models for Efficient Reasoning
  5. 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs
  6. 2026Refining Over Resampling: Test-Time Self-Correction for LLM Reasoning
  7. 2026Silent Failures in Quantized LLM Reasoning: A Taxonomy-Based Analysis of Hollow Convergence and Failure Mode Shifts
  8. 2026MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning