mlsanityData to 7 Oct 2026

EDIT: Early Diffusion Inference Termination for dLLMs Based on Dynamics of Training Gradients

arXiv 2512.00670 ↗First posted 29 Nov 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Diffusion-based large language models (dLLMs) refine token generations through iterative denoising, but answers often stabilize before all steps complete. We propose EDIT (Early Diffusion Inference Termination), an inference-time criterion that adaptively stops denoising once sufficient reasoning stability relative to training-time reasoning is detected. EDIT monitors the alignment between token activations and a reasoning map derived from AdamW-aggregated LoRA updates captured during supervised fine-tuning (SFT). During training, optimization dynamics generate rich metadata about parameter importance that in prior methods is typically discarded upon model release. We preserve this information as a compact representation of learned reasoning pathways. During inference, alignment scores are converted to a distribution over the tokens already unmasked at the current denoising step, and convergence is detected when KL divergence between consecutive steps falls below a threshold on the matched unmasked (visible) tokens. Across reasoning benchmarks, EDIT reduces diffusion steps by 11.8% to 68.3% while preserving or improving accuracy in most settings, with approximately 0.02% storage overhead (about 1.5-2 MB for all QKV modules across 32 blocks in an 8 GB model). By utilizing training-gradient dynamics, our work opens a new research direction for reducing dLLM inference time and cost.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 10 references that are in the map. First posted on arXiv 29 Nov 2025.

Builds on

7 of 10 references.

References · 7

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2023Let's Verify Step by Stepcited by 3,598
  3. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  4. 2025s1: Simple test-time scalingcited by 1,311
  5. 2025Large Language Diffusion Modelscited by 872
  6. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 385
  7. 2025d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learningcited by 178

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CAI-DLLM: Convergence Aware Inference for Diffusion Language Models
  2. 2025Reasoning in Diffusion Large Language Models is Concentrated in Dynamic Confusion Zones
  3. 2026Semantic Reasoning Denoising: Correcting Language Model Reasoning with Semantic Operators
  4. 2026Think First, Diffuse Fast: Improving Diffusion Language Model Reasoning via Autoregressive Plan Conditioning
  5. 2026Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models
  6. 2025Advancing Reasoning in Diffusion Language Models with Denoising Process Rewards
  7. 2026Just on Time: Token-Level Early Stopping for Diffusion Language Models
  8. 2026MetaState: Persistent Working Memory Enhances Reasoning in Discrete Diffusion Language Models