Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Models
Not on the map. Why?
Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Diffusion Large Language Models (DLLMs) are emerging as a powerful alternative to the dominant Autoregressive Large Language Models, offering efficient parallel generation and capable global context modeling. However, the practical application of DLLMs is hindered by a critical architectural constraint: the need for a statically predefined generation length. This static length allocation leads to a problematic trade-off: insufficient lengths cripple performance on complex tasks, while excessive lengths incur significant computational overhead and sometimes result in performance degradation. While the inference framework is rigid, we observe that the model itself possesses internal signals that correlate with the optimal response length for a given task. To bridge this gap, we leverage these latent signals and introduce DAEDAL, a novel training-free denoising strategy that enables Dynamic Adaptive Length Expansion for Diffusion Large Language Models. DAEDAL operates in two phases: 1) Before the denoising process, DAEDAL starts from a short initial length and iteratively expands it to a coarse task-appropriate length, guided by a sequence completion metric. 2) During the denoising process, DAEDAL dynamically intervenes by pinpointing and expanding insufficient generation regions through mask token insertion, ensuring the final output is fully developed. Extensive experiments on DLLMs demonstrate that DAEDAL achieves performance comparable, and in some cases superior, to meticulously tuned fixed-length baselines, while simultaneously enhancing computational efficiency by achieving a higher effective token ratio. By resolving the static length constraint, DAEDAL unlocks new potential for DLLMs, bridging a critical gap with their Autoregressive counterparts and paving the way for more efficient and capable generation.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 30 of its 31 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
30 of 31 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Let's Verify Step by Stepcited by 3,789
- 2021Program Synthesis with Large Language Modelscited by 3,637
18 more
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2025s1: Simple test-time scalingcited by 1,341
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2025Large Language Diffusion Modelscited by 912
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
- 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 235
- 2024Scaling up Masked Diffusion Models on Textcited by 199
- 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 169
- 2025dKV-Cache: The Cache for Diffusion Language Modelscited by 143
- 2025Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmaskingcited by 131
- 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
- 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decodingcited by 101
- 2025Rethinking Reflection in Pre-Trainingcited by 43
Built on by
Citing papers per year: 2025: 9; 2026: 25.
34 papers.
Sort:
By area:
- 2025A Survey on Diffusion Language Modelscited by 78
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 38
- 2025Learning Unmasking Policies for Diffusion Language Modelscited by 30
- 2026DreamOn: Diffusion Language Models For Code Infilling Beyond Fixed-size Canvascited by 19
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoningcited by 14
- 2026DAWN: Dependency-Aware Fast Inference for Diffusion LLMscited by 13
- 2025DiffuGuard: How Intrinsic Safety is Lost and Found in Diffusion Large Language Modelscited by 12
- 2025STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligencecited by 11
- 2025Masks Can Be Distracting: On Context Comprehension in Diffusion Language Modelscited by 9
- 2026CD4LM: Consistency Distillation and aDaptive Decoding for Diffusion Language Modelscited by 8
- 2026ρ-textttEOS: Training-free Bidirectional Variable-Length Control for Masked Diffusion LLMscited by 7
- 2026DSB: Dynamic Sliding Block Scheduling for Diffusion LLMscited by 7
22 more
- 2026When to Commit? Towards Variable-Size Self-Contained Blocks for Discrete Diffusion Language Modelscited by 7
- 2025Finish First, Perfect Later: Test-Time Token-Level Cross-Validation for Diffusion Large Language Modelscited by 5
- 2026Diffusion Language Models Are Natively Length-Awarecited by 5
- 2026DARE: Diffusion Large Language Models Alignment and Reinforcement Executorcited by 5
- 2026Improving Variable-Length Generation in Diffusion Language Models via Length Regularizationcited by 4
- 2025A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Modelscited by 3
- 2026Top 10 Open Challenges Steering the Future of Diffusion Language Model and Its Variantscited by 3
- 2026DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understandingcited by 3
- 2026Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Modelscited by 3
- 2026dTRPO: Trajectory Reduction in Policy Optimization of Diffusion Large Language Modelscited by 3
- 2026Diffusion LMs Can Approximate Optimal Infilling Lengths Implicitlycited by 2
- 2026Stability-Weighted Decoding for Diffusion Language Modelscited by 1
- 2026Dystruct: Dynamically Structured Diffusion Language Model Decoding via Bayesian Inferencecited by 1
- 2026AMix-2: Establishing Protein as a Native Modality in Large Language Modelscited by 1
- 2026Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniquescited by 1
- 2026Efficient Self-Evaluation for Diffusion Language Models via Sequence Regenerationcited by 0
- 2026A Continuous-Time Markov Chain Framework for Insertion Language Modelscited by 0
- 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Gamescited by 0
- 2026DRRG: A Discrete Diffusion Framework for Radiology Report Generationcited by 0
- 2026CARVE: Verified Expansion for Variable-Length Generation in Diffusion Language Modelscited by 0
- 2026Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editingcited by 0
- 2026HaloBlock: Faster and Better Decoding for Diffusion Large Language Modelscited by 0
- 2026HaloBlock: Faster and Better Decoding for Diffusion Large Language Models13 Oct 2026
- 2026Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editing13 Oct 2026
- 2026CARVE: Verified Expansion for Variable-Length Generation in Diffusion Language Models31 Aug 2026
- 2026DRRG: A Discrete Diffusion Framework for Radiology Report Generation25 Aug 2026
- 2026Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques14 Jul 2026
- 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games17 Jun 2026
- 2026A Continuous-Time Markov Chain Framework for Insertion Language Models8 Jun 2026
- 2026AMix-2: Establishing Protein as a Native Modality in Large Language Models29 May 2026
- 2026Dystruct: Dynamically Structured Diffusion Language Model Decoding via Bayesian Inference10 May 2026
- 2026When to Commit? Towards Variable-Size Self-Contained Blocks for Discrete Diffusion Language Models27 Apr 2026
- 2026Stability-Weighted Decoding for Diffusion Language Models18 Apr 2026
- 2026DARE: Diffusion Large Language Models Alignment and Reinforcement Executor5 Apr 2026
22 more
- 2026dTRPO: Trajectory Reduction in Policy Optimization of Diffusion Large Language Models19 Mar 2026
- 2026Diffusion Language Models Are Natively Length-Aware6 Mar 2026
- 2026Efficient Self-Evaluation for Diffusion Language Models via Sequence Regeneration3 Mar 2026
- 2026Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Models11 Feb 2026
- 2026Improving Variable-Length Generation in Diffusion Language Models via Length Regularization7 Feb 2026
- 2026DAWN: Dependency-Aware Fast Inference for Diffusion LLMs6 Feb 2026
- 2026DSB: Dynamic Sliding Block Scheduling for Diffusion LLMs5 Feb 2026
- 2026DreamOn: Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas1 Feb 2026
- 2026Diffusion LMs Can Approximate Optimal Infilling Lengths Implicitly31 Jan 2026
- 2026DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understanding30 Jan 2026
- 2026ρ-textttEOS: Training-free Bidirectional Variable-Length Control for Masked Diffusion LLMs30 Jan 2026
- 2026Top 10 Open Challenges Steering the Future of Diffusion Language Model and Its Variants20 Jan 2026
- 2026CD4LM: Consistency Distillation and aDaptive Decoding for Diffusion Language Models5 Jan 2026
- 2025Learning Unmasking Policies for Diffusion Language Models9 Dec 2025
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoning4 Dec 2025
- 2025Masks Can Be Distracting: On Context Comprehension in Diffusion Language Models26 Nov 2025
- 2025A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Models19 Nov 2025
- 2025STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence28 Oct 2025
- 2025Finish First, Perfect Later: Test-Time Token-Level Cross-Validation for Diffusion Large Language Models6 Oct 2025
- 2025DiffuGuard: How Intrinsic Safety is Lost and Found in Diffusion Large Language Models29 Sep 2025
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learning26 Sep 2025
- 2025A Survey on Diffusion Language Models14 Aug 2025
- 2025A Survey on Diffusion Language Modelscited by 78
- 2025Learning Unmasking Policies for Diffusion Language Modelscited by 30
- 2026DreamOn: Diffusion Language Models For Code Infilling Beyond Fixed-size Canvascited by 19
- 2025Masks Can Be Distracting: On Context Comprehension in Diffusion Language Modelscited by 9
- 2026CD4LM: Consistency Distillation and aDaptive Decoding for Diffusion Language Modelscited by 8
- 2026ρ-textttEOS: Training-free Bidirectional Variable-Length Control for Masked Diffusion LLMscited by 7
- 2026When to Commit? Towards Variable-Size Self-Contained Blocks for Discrete Diffusion Language Modelscited by 7
- 2026Diffusion Language Models Are Natively Length-Awarecited by 5
- 2026Improving Variable-Length Generation in Diffusion Language Models via Length Regularizationcited by 4
- 2026Top 10 Open Challenges Steering the Future of Diffusion Language Model and Its Variantscited by 3
- 2026Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Modelscited by 3
- 2026Diffusion LMs Can Approximate Optimal Infilling Lengths Implicitlycited by 2
12 most cited of 20 All 20 (JSON)
- 2026Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editing13 Oct 2026
- 2026CARVE: Verified Expansion for Variable-Length Generation in Diffusion Language Models31 Aug 2026
- 2026DRRG: A Discrete Diffusion Framework for Radiology Report Generation25 Aug 2026
- 2026Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques14 Jul 2026
- 2026A Continuous-Time Markov Chain Framework for Insertion Language Models8 Jun 2026
- 2026Dystruct: Dynamically Structured Diffusion Language Model Decoding via Bayesian Inference10 May 2026
- 2026When to Commit? Towards Variable-Size Self-Contained Blocks for Discrete Diffusion Language Models27 Apr 2026
- 2026Stability-Weighted Decoding for Diffusion Language Models18 Apr 2026
- 2026Diffusion Language Models Are Natively Length-Aware6 Mar 2026
- 2026Efficient Self-Evaluation for Diffusion Language Models via Sequence Regeneration3 Mar 2026
- 2026Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Models11 Feb 2026
- 2026Improving Variable-Length Generation in Diffusion Language Models via Length Regularization7 Feb 2026
12 newest of 20 All 20 (JSON)
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 38
- 2025A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Modelscited by 3
- 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Gamescited by 0
- 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games17 Jun 2026
- 2025A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Models19 Nov 2025
- 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learning26 Sep 2025
- 2026DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understandingcited by 3
- 2026dTRPO: Trajectory Reduction in Policy Optimization of Diffusion Large Language Modelscited by 3
- 2026AMix-2: Establishing Protein as a Native Modality in Large Language Modelscited by 1
- 2026HaloBlock: Faster and Better Decoding for Diffusion Large Language Modelscited by 0
- 2026HaloBlock: Faster and Better Decoding for Diffusion Large Language Models13 Oct 2026
- 2026AMix-2: Establishing Protein as a Native Modality in Large Language Models29 May 2026
- 2026dTRPO: Trajectory Reduction in Policy Optimization of Diffusion Large Language Models19 Mar 2026
- 2026DIFFA-2: A Practical Diffusion Large Language Model for General Audio Understanding30 Jan 2026