WavefrontDiffusion: Dynamic Decoding Schedule for Improved Reasoning
On the map: LLM reasoning → Diffusion reasoning and test-time scaling
also in 1 more
Abstract (arXiv)
Diffusion Language Models (DLMs) have shown strong potential for text generation and are becoming a competitive alternative to autoregressive models. The denoising strategy plays an important role in determining the quality of their outputs. Mainstream denoising strategies include Standard Diffusion and BlockDiffusion. Standard Diffusion performs global denoising without restricting the update range, often finalizing incomplete context and causing premature end-of-sequence predictions. BlockDiffusion updates fixed-size blocks in a preset order, but its rigid structure can break apart coherent semantic units and disrupt reasoning. We present WavefrontDiffusion, a dynamic decoding approach that expands a wavefront of active tokens outward from finalized positions. This adaptive process follows the natural flow of semantic structure while keeping computational cost equal to block-based methods. Across four benchmarks in reasoning and code generation, WavefrontDiffusion achieves state-of-the-art performance while producing outputs with higher semantic fidelity, showing the value of adaptive scheduling for more coherent and efficient generation.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 25 of its 33 references that are in the map. First posted on arXiv 22 Nov 2025.
Builds on
25 of 33 references.
References · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,653
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
- 2025Large Language Diffusion Modelscited by 912
- 2025Dream 7B: Diffusion Large Language Modelscited by 544
13 more
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
- 2019Analysing Mathematical Reasoning Abilities of Neural Modelscited by 335
- 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generationcited by 187
- 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 178
- 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 155
- 2023Likelihood-Based Diffusion Language Modelscited by 151
- 2025Dream-Coder 7B: An Open Diffusion Language Model for Codecited by 81
- 2025A Survey on Diffusion Language Modelscited by 78
- 2023Diffusion Models for Non-autoregressive Text Generation: A Surveycited by 44
- 2020Best-First Beam Searchcited by 40
- 2025MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Modelscited by 32
- 2025Self Speculative Decoding for Diffusion Large Language Modelscited by 30
- 2025TreeDiff: AST-Guided Code Generation with Diffusion LLMscited by 11
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026DSB: Dynamic Sliding Block Scheduling for Diffusion LLMscited by 7
- 2026Few-Step Diffusion Language Models via Trajectory Self-Distillationcited by 3
- 2026Context-Aware Cluster Decoding: Semantic Anchor-Driven Coherence in dMLLMscited by 0
- 2026Information-Guided Frontier Decoding: Contextual Utility-Driven Commitment in dMLLMscited by 0
- 2026Information-Guided Frontier Decoding: Contextual Utility-Driven Commitment in dMLLMs27 Aug 2026
- 2026Context-Aware Cluster Decoding: Semantic Anchor-Driven Coherence in dMLLMs23 Aug 2026
- 2026Few-Step Diffusion Language Models via Trajectory Self-Distillation12 Feb 2026
- 2026DSB: Dynamic Sliding Block Scheduling for Diffusion LLMs5 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026SemBlock: Semantic Boundary Dynamic Blocks for Diffusion LLMs
- 2026Window-Diffusion: Accelerating Diffusion Language Model Inference with Windowed Token Pruning and Caching
- 2025Beyond Confidence: Adaptive and Coherent Decoding for Diffusion Language Models
- 2026FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models
- 2026Efficient Diffusion LLMs via Temporal-Spatial Parallel Decoding and Confidence Extrapolation
- 2026Hierarchical Continuous Diffusion Language Models
- 2026Deferred Commitment Decoding for Diffusion Language Models
- 2026PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding