x-Prediction Flow: Efficient Continuous Decoding for Masked Diffusion Language Models
On the map: Diffusion models → Discrete and text diffusion
Abstract (arXiv)
Masked diffusion language models (MDLMs) generate text by iteratively unmasking tokens, but their standard decoder reduces each step to a binary action: a position is either committed to a single token or left fully masked, discarding rich predictive information rather than carrying it forward, and forcing premature, irrevocable commitments that lead to poor performance under a limited decoding budget. In this paper, we reinterpret mask prediction as a clean-state prediction (x-prediction) and show that it can be used to induce a continuous flow in the input embedding space. Building on this view, we propose a continuous decoding framework for MDLMs where tokens can accumulate partial progress at each diffusion step and remain revisable. To match the uneven contextual constraints across positions in language, we replace the globally synchronous schedule in image diffusion with a confidence-based asynchronous update in which the diffusion progress is token-wise accumulated. Additionally, we introduce a lightweight policy network and formulate its training as a reinforcement learning problem. Applied to pretrained LLaDA, our decoder retains 83--97% of full-budget accuracy using under 15% of the diffusion steps, largely outperforming discrete mask-prediction decoding at matched budgets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 10 of its 18 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
10 of 18 references.
Closest ancestors · 3
Same direction, newest first
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100B10 Dec
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data6 Jun
- 2022Empowering Diffusion Models on the Embedding Space for Text Generation19 Dec
Other references · 7
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Soft-Masked Diffusion Language Models
- 2025Activation Steering for Masked Diffusion Language Models
- 2026Mask-Aware Policy Gradients for Diffusion Language Models
- 2026Machine Unlearning for Masked Diffusion Language Models
- 2026Rethinking the Roles of Diffusion and Decoding: Predictive-State Flows for Parallel Language Generation
- 2026CRoCoDiL: Continuous and Robust Conditioned Diffusion for Language
- 2026Multi-Mask Diffusion Language Models for Few-Step Generation
- 2026On Trajectory-Aware Training for Masked Diffusion Language Models