Unmask the State: When Does State Adaptation Matter for Masked Diffusion Language Models
On the map: Diffusion models → Discrete and text diffusion
Abstract (arXiv)
Masked diffusion language models (MDMs) admit flexible generation orders, making the unmasking strategy an inference decision. Existing methods vary in how they prioritize positions, control parallelism, restrict selection regions, revise predictions, or plan future denoising, yet it remains unclear when these choices should change during generation. We study this question through strategy reversals, where an alternative action becomes preferable to a fixed choice. We organize MDM inference into five axes--score, cardinality, region, commitment, and planning--and define adaptation opportunity as the one-step utility advantage of the best candidate action over a validation-selected fixed action. This view shows that adaptation value depends on both the frequency and magnitude of such reversals. Across three MDMs and ten tasks, adaptation opportunities are highly heterogeneous, with some regimes exhibiting concentrated and predictable one-step gains. This motivates selective adaptation: lightweight detectors calibrated on validation prompts identify high-opportunity states, capturing, for example, 56.9 percent of the candidate-set oracle opportunity by adapting only the top 10 percent of states on LLaDA-8B constrained JSON filling. Our transition-level results suggest that state adaptation is most useful when applied selectively rather than uniformly.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 17 of its 41 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
17 of 41 references.
Closest ancestors · 15
Same direction, newest first
- 2026When to Commit? Towards Variable-Size Self-Contained Blocks for Discrete Diffusion Language Models27 Apr
- 2026Dependency-Guided Parallel Decoding in Discrete Diffusion Language Models2 Apr
- 2026Search or Accelerate: Confidence-Switched Position Beam Search for Diffusion Language Models11 Feb
- 2026Where-to-Unmask: Ground-Truth-Guided Unmasking Order Learning for Masked Diffusion Language Models10 Feb
- 2026Swordsman: Entropy-Driven Adaptive Block Partition for Efficient Diffusion Language Models4 Feb
- 2026Unifying Masked Diffusion Models with Various Generation Orders and Beyond2 Feb
- 2026Generation Order and Parallel Decoding in Masked Diffusion Models: An Information-Theoretic Perspective30 Jan
- 2026Improving Diffusion Language Model Decoding through Joint Search in Generation Order and Token Space28 Jan
- 2026Deferred Commitment Decoding for Diffusion Language Models5 Jan
- 2025Optimal Inference Schedules for Masked Diffusion Models6 Nov
- 2025Lookahead Unmasking Elicits Accurate Decoding in Diffusion Language Models4 Nov
- 2025Dream 7B: Diffusion Large Language Models21 Aug
3 more
Other references · 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Learning Unmasking Policies for Diffusion Language Models
- 2026Adaptation to Intrinsic Dependence in Diffusion Language Models
- 2026Mask-Aware Policy Gradients for Diffusion Language Models
- 2025From Next-Token to Next-Block: A Principled Adaptation Path for Diffusion LLMs
- 2026A Theoretical Analysis of Why Masked Diffusion Models Mitigate the Reversal Curse
- 2026CaRE Compute-aware Remasking Evaluation Protocol for Masked Diffusion Language Models
- 2026CORE: Context-Robust Remasking for Diffusion Language Models
- 2025Improving Discrete Diffusion Unmasking Policies Beyond Explicit Reference Policies