mlsanityData to 14 Oct 2026

DepCap: Adaptive Block-Wise Parallel Decoding for Efficient Diffusion LM Inference

arXiv 2604.15750 ↗First posted 17 Apr 2026cs.LG cs.AIcited by 1

On the map: Diffusion models → Discrete and text diffusion

also in 1 more
Abstract (arXiv)

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive language generation due to their potential for parallel decoding and global refinement of the entire sequence. To unlock this potential, DLM inference must carefully balance generation quality and decoding speed. Recent block-wise DLM decoding methods improve this trade-off by performing diffusion-based decoding sequentially in blocks. However, existing methods typically rely on fixed block schedules or current-step local signals to determine block boundaries, and use conservative confidence-based parallel decoding to avoid conflicts, limiting the quality-speed trade-off. In this paper, we argue that block-wise DLM inference requires more suitable signals for its two core decisions: cross-step signals for determining block boundaries, and token-level conflict signals for parallel decoding. Based on this view, we propose DepCap, a training-free framework for efficient block-wise DLM inference. Specifically, DepCap instantiates the cross-step signal as the influence of the last decoded block and uses it to adaptively determine how far the next block should extend, while identifying a conflict-free subset of tokens for safe parallel decoding within each block, enabling substantial inference acceleration with negligible quality degradation. DepCap is a plug-and-play method applicable to various DLMs, and compatible with existing KV-cache strategies for block-wise DLM. An information-theoretic analysis further suggests that the cumulative last-block influence on a candidate block is approximately additive across tokens, supporting the proposed block-partitioning criterion. Experimental results show that DepCap achieves favorable speed-quality trade-offs across multiple DLM backbones and reasoning and coding benchmarks, with up to 5.63× speedup without significant performance degradation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 39 of its 40 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

39 of 40 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026GeoBlock: Inferring Block Granularity from Dependency Geometry in Diffusion Language Models4 Mar
  2. 2026Swordsman: Entropy-Driven Adaptive Block Partition for Efficient Diffusion Language Models4 Feb
  3. 2026Deferred Commitment Decoding for Diffusion Language Models5 Jan
  4. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100B10 Dec
  5. 2025SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation7 Oct
  6. 2025DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding28 Sep
  7. 2025Dream 7B: Diffusion Large Language Models21 Aug
  8. 2025A Survey on Diffusion Language Models14 Aug
  9. 2025Diffusion LLMs Can Do Faster-Than-AR Inference via Discrete Diffusion Forcing8 Aug
  10. 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation25 Jun
  11. 2025Discrete Diffusion in Large Language and Multimodal Models: A Survey16 Jun
  12. 2025FlashDLM: Accelerating Diffusion Language Model Inference via Efficient KV Caching and Guided Diffusion27 May
7 more
  1. 2025dKV-Cache: The Cache for Diffusion Language Models21 May
  2. 2025Reinforcing the Diffusion Chain of Lateral Thought with Diffusion Language Models15 May
  3. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models12 Mar
  4. 2025Large Language Diffusion Models14 Feb
  5. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Models23 Oct
  6. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution25 Oct
  7. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models17 Oct

Other references · 20

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2021Program Synthesis with Large Language Modelscited by 3,637
  6. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  7. 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
  8. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
  9. 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 235
  10. 2025d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learningcited by 186
  11. 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 169
  12. 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 139
8 more
  1. 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
  2. 2025Sparse-dLLM: Accelerating Diffusion LLMs with Dynamic Cache Evictioncited by 65
  3. 2025dParallel: Learnable Parallel Decoding for dLLMscited by 65
  4. 2025Attention Is All You Need for KV Cache in Diffusion LLMscited by 32
  5. 2025AdaBlock-dLLM: Semantic-Aware Diffusion LLM Inference via Adaptive Block Sizecited by 31
  6. 2025d2Cache: Accelerating Diffusion-Based LLMs via Dual Adaptive Cachingcited by 25
  7. 2026DAWN: Dependency-Aware Fast Inference for Diffusion LLMscited by 13
  8. 2026DSB: Dynamic Sliding Block Scheduling for Diffusion LLMscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
  2. 2025From Bits to Rounds: Parallel Decoding with Exploration for Diffusion Language Models
  3. 2026BlockBatch: Multi-Scale Consensus Decoding for Efficient Diffusion Language Model Inference
  4. 2026Early-Bird Decoding: Accelerating Diffusion LLMs with Learnable Block Sizes and Parallel Sampling
  5. 2026Locally Coherent Parallel Decoding in Diffusion Language Models
  6. 2026Rethinking the Generation Order of Block Diffusion Language Models
  7. 2025Diffusion Language Models Know the Answer Before Decoding
  8. 2026Dystruct: Dynamically Structured Diffusion Language Model Decoding via Bayesian Inference