EDIT: Early Diffusion Inference Termination for dLLMs Based on Dynamics of Training Gradients
Not on the map. Why?
Abstract (arXiv)
Diffusion-based large language models (dLLMs) refine token generations through iterative denoising, but answers often stabilize before all steps complete. We propose EDIT (Early Diffusion Inference Termination), an inference-time criterion that adaptively stops denoising once sufficient reasoning stability relative to training-time reasoning is detected. EDIT monitors the alignment between token activations and a reasoning map derived from AdamW-aggregated LoRA updates captured during supervised fine-tuning (SFT). During training, optimization dynamics generate rich metadata about parameter importance that in prior methods is typically discarded upon model release. We preserve this information as a compact representation of learned reasoning pathways. During inference, alignment scores are converted to a distribution over the tokens already unmasked at the current denoising step, and convergence is detected when KL divergence between consecutive steps falls below a threshold on the matched unmasked (visible) tokens. Across reasoning benchmarks, EDIT reduces diffusion steps by 11.8% to 68.3% while preserving or improving accuracy in most settings, with approximately 0.02% storage overhead (about 1.5-2 MB for all QKV modules across 32 blocks in an 8 GB model). By utilizing training-gradient dynamics, our work opens a new research direction for reducing dLLM inference time and cost.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 10 references that are in the map. First posted on arXiv 29 Nov 2025.
Builds on
7 of 10 references.
References · 7
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Let's Verify Step by Stepcited by 3,598
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2025s1: Simple test-time scalingcited by 1,311
- 2025Large Language Diffusion Modelscited by 872
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 385
- 2025d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learningcited by 178
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CAI-DLLM: Convergence Aware Inference for Diffusion Language Models
- 2025Reasoning in Diffusion Large Language Models is Concentrated in Dynamic Confusion Zones
- 2026Semantic Reasoning Denoising: Correcting Language Model Reasoning with Semantic Operators
- 2026Think First, Diffuse Fast: Improving Diffusion Language Model Reasoning via Autoregressive Plan Conditioning
- 2026Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models
- 2025Advancing Reasoning in Diffusion Language Models with Denoising Process Rewards
- 2026Just on Time: Token-Level Early Stopping for Diffusion Language Models
- 2026MetaState: Persistent Working Memory Enhances Reasoning in Discrete Diffusion Language Models