mlsanityData to 14 Oct 2026

Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models

arXiv 2508.00819 ↗First posted 1 Aug 2025cs.CLcited by 34

Not on the map. Why?

Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Diffusion Large Language Models (DLLMs) are emerging as a powerful alternative to the dominant Autoregressive Large Language Models, offering efficient parallel generation and capable global context modeling. However, the practical application of DLLMs is hindered by a critical architectural constraint: the need for a statically predefined generation length. This static length allocation leads to a problematic trade-off: insufficient lengths cripple performance on complex tasks, while excessive lengths incur significant computational overhead and sometimes result in performance degradation. While the inference framework is rigid, we observe that the model itself possesses internal signals that correlate with the optimal response length for a given task. To bridge this gap, we leverage these latent signals and introduce DAEDAL, a novel training-free denoising strategy that enables Dynamic Adaptive Length Expansion for Diffusion Large Language Models. DAEDAL operates in two phases: 1) Before the denoising process, DAEDAL starts from a short initial length and iteratively expands it to a coarse task-appropriate length, guided by a sequence completion metric. 2) During the denoising process, DAEDAL dynamically intervenes by pinpointing and expanding insufficient generation regions through mask token insertion, ensuring the final output is fully developed. Extensive experiments on DLLMs demonstrate that DAEDAL achieves performance comparable, and in some cases superior, to meticulously tuned fixed-length baselines, while simultaneously enhancing computational efficiency by achieving a higher effective token ratio. By resolving the static length constraint, DAEDAL unlocks new potential for DLLMs, bridging a critical gap with their Autoregressive counterparts and paving the way for more efficient and capable generation.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 30 of its 31 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

30 of 31 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  7. 2025Qwen3 Technical Reportcited by 8,820
  8. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  10. 2024Qwen2.5 Technical Reportcited by 4,942
  11. 2023Let's Verify Step by Stepcited by 3,789
  12. 2021Program Synthesis with Large Language Modelscited by 3,637
18 more
  1. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  2. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  3. 2025s1: Simple test-time scalingcited by 1,341
  4. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  5. 2025Large Language Diffusion Modelscited by 912
  6. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
  7. 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
  8. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
  9. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
  10. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
  11. 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 235
  12. 2024Scaling up Masked Diffusion Models on Textcited by 199
  13. 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 169
  14. 2025dKV-Cache: The Cache for Diffusion Language Modelscited by 143
  15. 2025Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmaskingcited by 131
  16. 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
  17. 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decodingcited by 101
  18. 2025Rethinking Reflection in Pre-Trainingcited by 43

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 25.

34 papers.

Sort:

By area:

  1. 2025A Survey on Diffusion Language Modelscited by 78
  2. 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 38
  3. 2025Learning Unmasking Policies for Diffusion Language Modelscited by 30
  4. 2026DreamOn: Diffusion Language Models For Code Infilling Beyond Fixed-size Canvascited by 19
  5. 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoningcited by 14
  6. 2026DAWN: Dependency-Aware Fast Inference for Diffusion LLMscited by 13
  7. 2025DiffuGuard: How Intrinsic Safety is Lost and Found in Diffusion Large Language Modelscited by 12
  8. 2025STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligencecited by 11
  9. 2025Masks Can Be Distracting: On Context Comprehension in Diffusion Language Modelscited by 9
  10. 2026CD4LM: Consistency Distillation and aDaptive Decoding for Diffusion Language Modelscited by 8
  11. 2026ρ-textttEOS: Training-free Bidirectional Variable-Length Control for Masked Diffusion LLMscited by 7
  12. 2026DSB: Dynamic Sliding Block Scheduling for Diffusion LLMscited by 7
22 more
  1. 2026When to Commit? Towards Variable-Size Self-Contained Blocks for Discrete Diffusion Language Modelscited by 7
  2. 2025Finish First, Perfect Later: Test-Time Token-Level Cross-Validation for Diffusion Large Language Modelscited by 5
  3. 2026Diffusion Language Models Are Natively Length-Awarecited by 5
  4. 2026DARE: Diffusion Large Language Models Alignment and Reinforcement Executorcited by 5
  5. 2026Improving Variable-Length Generation in Diffusion Language Models via Length Regularizationcited by 4
  6. 2025A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Modelscited by 3
  7. 2026Top 10 Open Challenges Steering the Future of Diffusion Language Model and Its Variantscited by 3
  8. 2026DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understandingcited by 3
  9. 2026Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Modelscited by 3
  10. 2026dTRPO: Trajectory Reduction in Policy Optimization of Diffusion Large Language Modelscited by 3
  11. 2026Diffusion LMs Can Approximate Optimal Infilling Lengths Implicitlycited by 2
  12. 2026Stability-Weighted Decoding for Diffusion Language Modelscited by 1
  13. 2026Dystruct: Dynamically Structured Diffusion Language Model Decoding via Bayesian Inferencecited by 1
  14. 2026AMix-2: Establishing Protein as a Native Modality in Large Language Modelscited by 1
  15. 2026Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniquescited by 1
  16. 2026Efficient Self-Evaluation for Diffusion Language Models via Sequence Regenerationcited by 0
  17. 2026A Continuous-Time Markov Chain Framework for Insertion Language Modelscited by 0
  18. 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Gamescited by 0
  19. 2026DRRG: A Discrete Diffusion Framework for Radiology Report Generationcited by 0
  20. 2026CARVE: Verified Expansion for Variable-Length Generation in Diffusion Language Modelscited by 0
  21. 2026Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editingcited by 0
  22. 2026HaloBlock: Faster and Better Decoding for Diffusion Large Language Modelscited by 0