mlsanityData to 7 Oct 2026

CreditDecoding: Accelerating Parallel Decoding in Diffusion Large Language Models with Trace Credit

arXiv 2510.06133 ↗First posted 7 Oct 2025cs.CL cs.AIcited by 11

On the map: Efficient LLM inference and serving → Diffusion LLM and MoE inference

Abstract (arXiv)

Diffusion large language models (dLLMs) generate text through iterative denoising. In commonly adopted parallel decoding schemes, each step confirms only high-confidence positions while remasking the others. By analyzing dLLM denoising traces, we uncover a key inefficiency: models often predict the correct target token several steps before its confidence becomes high enough to be decoded. This gap between early prediction and late decoding forces repeated remasking of already-correct tokens, causing redundant iterations and limiting acceleration. To exploit this temporal redundancy, we introduce Trace Credit to quantify a token's decoding potential by accumulating historical evidence. Building on this, we propose CreditDecoding, a training-free parallel decoding method that fuses Trace Credit with current logits to boost the confidence of correct but underconfident tokens, thereby accelerating denoising and improving robustness. On eight benchmarks, CreditDecoding achieves up to 5.48 times speedup with +0.48 accuracy on LLaDA-8B and consistently improves performance across diverse dLLM architectures and parameter scales. It further scales to long contexts and remains orthogonal to mainstream inference optimizations, making it a practical and widely applicable solution.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Diffusion LLM and MoE inference, one of 12 directions in Efficient LLM inference and serving. Builds on 26 of its 31 references that are in the map. First posted on arXiv 7 Oct 2025.

Builds on

26 of 31 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding28 May
  2. 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decoding22 May

Other references · 24

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  6. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  7. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  8. 2025Dream 7B: Diffusion Large Language Modelscited by 515
  9. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
  10. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
  11. 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusionscited by 208
  12. 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generationcited by 184
12 more
  1. 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 173
  2. 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 168
  3. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
  4. 2025Path Planning for Masked Diffusion Model Samplingcited by 79
  5. 2024KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Taskscited by 67
  6. 2025LLaDA-MoE: A Sparse MoE Diffusion Language Modelcited by 54
  7. 2025Any-Order Flexible Length Masked Diffusioncited by 48
  8. 2025Theoretical Benefit and Limitation of Diffusion Language Modelcited by 46
  9. 2025Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Principlescited by 43
  10. 2025LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMscited by 38
  11. 2025DPad: Efficient Diffusion Language Models with Suffix Dropoutcited by 38
  12. 2025Time Is a Feature: Exploiting Temporal Dynamics in Diffusion Language Modelscited by 33

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 7.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models
  2. 2026Stability-Weighted Decoding for Diffusion Language Models
  3. 2026Roll Out and Roll Back: Diffusion LLMs are Their Own Efficiency Teachers
  4. 2025Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decoding
  5. 2026Early-Bird Decoding: Accelerating Diffusion LLMs with Learnable Block Sizes and Parallel Sampling
  6. 2026Understanding Evaluation Illusion in Diffusion Large Language Models
  7. 2026PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding
  8. 2026Trajectory-Level Speculative Decoding for Diffusion Language Models