mlsanityData to 7 Oct 2026

Dependency-Aware Revocable Decoding for Efficient Diffusion Large Language Model Inference

arXiv 2608.26574 ↗First posted 27 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Diffusion large language models (dLLMs) offer a promising alternative to autoregressive generation by decoding multiple tokens in parallel through iterative denoising. However, increasing decoding parallelism often degrades generation quality, as early errors can contaminate later contexts. Revocable decoding mitigates this issue by re-evaluating decoded tokens and remasking unreliable ones, but existing methods overlook that unreliable tokens may also corrupt the verification context itself. We identify this failure mode and propose Dependency-Aware Revocable Decoding (DARD), a training-free framework that separates tokens into masked, candidate, and unmasked states. DARD verifies candidate tokens using a selective context that excludes less reliable tokens and adaptively regulates their influence on subsequent decoding. Experiments across 12 textual and multimodal benchmarks on 3 open-source dLLMs show that DARD consistently improves the speed-quality Pareto frontier over recent revocable decoding methods, achieving a 2.71× speedup and a 4.35-point CIDEr score gain over Saber on Flickr30K.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

31 of 45 references.

References · 31

  1. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  2. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  3. 2021Program Synthesis with Large Language Modelscited by 3,509
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  5. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  6. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  7. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
  8. 2016A Diagram Is Worth A Dozen Imagescited by 793
  9. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
  10. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
  11. 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 404
  12. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 371
19 more
  1. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
  2. 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 225
  3. 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusionscited by 208
  4. 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 168
  5. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 154
  6. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
  7. 2024Stream of Search (SoS): Learning to Search in Languagecited by 141
  8. 2024Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planningcited by 135
  9. 2025LaViDa: A Large Diffusion Language Model for Multimodal Understandingcited by 81
  10. 2025FlashDLM: Accelerating Diffusion Language Model Inference via Efficient KV Caching and Guided Diffusioncited by 77
  11. 2025Diffusion Language Models Know the Answer Before Decodingcited by 68
  12. 2025Sparse-dLLM: Accelerating Diffusion LLMs with Dynamic Cache Evictioncited by 64
  13. 2025Wide-In, Narrow-Out: Revokable Decoding for Efficient and Effective DLLMscited by 45
  14. 2025ParallelBench: Understanding the Trade-offs of Parallel Decoding in Diffusion LLMscited by 42
  15. 2025Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decodingcited by 26
  16. 2025Saber: An Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Modelcited by 13
  17. 2026DAPD: Dependency-Aware Parallel Decoding via Attention for Diffusion LLMscited by 13
  18. 2025Ideas in Inference-time Scaling can Benefit Generative Pre-training Algorithmscited by 12
  19. 2026Rejection Mixing: Fast Semantic Propagation of Mask Tokens for Efficient DLLM Inferencecited by 4

Built on by

Not cited yet.