mlsanityData to 14 Oct 2026

WavefrontDiffusion: Dynamic Decoding Schedule for Improved Reasoning

arXiv 2511.19473 ↗First posted 22 Nov 2025cs.LG cs.AIcited by 4

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

also in 1 more
Abstract (arXiv)

Diffusion Language Models (DLMs) have shown strong potential for text generation and are becoming a competitive alternative to autoregressive models. The denoising strategy plays an important role in determining the quality of their outputs. Mainstream denoising strategies include Standard Diffusion and BlockDiffusion. Standard Diffusion performs global denoising without restricting the update range, often finalizing incomplete context and causing premature end-of-sequence predictions. BlockDiffusion updates fixed-size blocks in a preset order, but its rigid structure can break apart coherent semantic units and disrupt reasoning. We present WavefrontDiffusion, a dynamic decoding approach that expands a wavefront of active tokens outward from finalized positions. This adaptive process follows the natural flow of semantic structure while keeping computational cost equal to block-based methods. Across four benchmarks in reasoning and code generation, WavefrontDiffusion achieves state-of-the-art performance while producing outputs with higher semantic fidelity, showing the value of adaptive scheduling for more coherent and efficient generation.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 25 of its 33 references that are in the map. First posted on arXiv 22 Nov 2025.

Builds on

25 of 33 references.

References · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  6. 2021Program Synthesis with Large Language Modelscited by 3,637
  7. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  8. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,653
  9. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  10. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  11. 2025Large Language Diffusion Modelscited by 912
  12. 2025Dream 7B: Diffusion Large Language Modelscited by 544
13 more
  1. 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
  2. 2019Analysing Mathematical Reasoning Abilities of Neural Modelscited by 335
  3. 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generationcited by 187
  4. 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 178
  5. 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 155
  6. 2023Likelihood-Based Diffusion Language Modelscited by 151
  7. 2025Dream-Coder 7B: An Open Diffusion Language Model for Codecited by 81
  8. 2025A Survey on Diffusion Language Modelscited by 78
  9. 2023Diffusion Models for Non-autoregressive Text Generation: A Surveycited by 44
  10. 2020Best-First Beam Searchcited by 40
  11. 2025MDPO: Overcoming the Training-Inference Divide of Masked Diffusion Language Modelscited by 32
  12. 2025Self Speculative Decoding for Diffusion Large Language Modelscited by 30
  13. 2025TreeDiff: AST-Guided Code Generation with Diffusion LLMscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SemBlock: Semantic Boundary Dynamic Blocks for Diffusion LLMs
  2. 2026Window-Diffusion: Accelerating Diffusion Language Model Inference with Windowed Token Pruning and Caching
  3. 2025Beyond Confidence: Adaptive and Coherent Decoding for Diffusion Language Models
  4. 2026FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models
  5. 2026Efficient Diffusion LLMs via Temporal-Spatial Parallel Decoding and Confidence Extrapolation
  6. 2026Hierarchical Continuous Diffusion Language Models
  7. 2026Deferred Commitment Decoding for Diffusion Language Models
  8. 2026PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding