CreditDecoding: Accelerating Parallel Decoding in Diffusion Large Language Models with Trace Credit
On the map: Efficient LLM inference and serving → Diffusion LLM and MoE inference
Abstract (arXiv)
Diffusion large language models (dLLMs) generate text through iterative denoising. In commonly adopted parallel decoding schemes, each step confirms only high-confidence positions while remasking the others. By analyzing dLLM denoising traces, we uncover a key inefficiency: models often predict the correct target token several steps before its confidence becomes high enough to be decoded. This gap between early prediction and late decoding forces repeated remasking of already-correct tokens, causing redundant iterations and limiting acceleration. To exploit this temporal redundancy, we introduce Trace Credit to quantify a token's decoding potential by accumulating historical evidence. Building on this, we propose CreditDecoding, a training-free parallel decoding method that fuses Trace Credit with current logits to boost the confidence of correct but underconfident tokens, thereby accelerating denoising and improving robustness. On eight benchmarks, CreditDecoding achieves up to 5.48 times speedup with +0.48 accuracy on LLaDA-8B and consistently improves performance across diverse dLLM architectures and parameter scales. It further scales to long contexts and remains orthogonal to mainstream inference optimizations, making it a practical and widely applicable solution.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Diffusion LLM and MoE inference, one of 12 directions in Efficient LLM inference and serving. Builds on 26 of its 31 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
26 of 31 references.
Closest ancestors · 2
Same direction, newest first
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding28 May
- 2025Dimple: Discrete Diffusion Multimodal Large Language Model with Parallel Decoding22 May
Other references · 24
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
- 2025Dream 7B: Diffusion Large Language Modelscited by 515
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
- 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusionscited by 208
- 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generationcited by 184
12 more
- 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 173
- 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 168
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
- 2025Path Planning for Masked Diffusion Model Samplingcited by 79
- 2024KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Taskscited by 67
- 2025LLaDA-MoE: A Sparse MoE Diffusion Language Modelcited by 54
- 2025Any-Order Flexible Length Masked Diffusioncited by 48
- 2025Theoretical Benefit and Limitation of Diffusion Language Modelcited by 46
- 2025Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Principlescited by 43
- 2025LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMscited by 38
- 2025DPad: Efficient Diffusion Language Models with Suffix Dropoutcited by 38
- 2025Time Is a Feature: Exploiting Temporal Dynamics in Diffusion Language Modelscited by 33
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025LoPA: Scaling dLLM Inference via Lookahead Parallel Decodingcited by 17
- 2026DMax: Aggressive Parallel Decoding for dLLMscited by 14
- 2025Corrective Diffusion Language Modelscited by 11
- 2025Fast-Decoding Diffusion Language Models via Progress-Aware Confidence Schedulescited by 10
- 2026R2-dLLM: Accelerating Diffusion Large Language Models via Spatio-Temporal Redundancy Reductioncited by 6
- 2026Breaking Block Boundaries: Anchor-based History-stable Decoding for Diffusion Large Language Modelscited by 3
- 2025Reasoning in Diffusion Large Language Models is Concentrated in Dynamic Confusion Zonescited by 2
- 2026VidLaDA: Bidirectional Diffusion Large Language Models for Efficient Video Understandingcited by 2
- 2026TAD: Temporal-Aware Trajectory Self-Distillation for Fast and Accurate Diffusion LLMcited by 2
- 2026Efficient Diffusion LLMs via Temporal-Spatial Parallel Decoding and Confidence Extrapolationcited by 1
- 2026Forward-Free Diffusion Language Models with BPTT-Free Looped Refinementcited by 0
- 2026Forward-Free Diffusion Language Models with BPTT-Free Looped Refinement6 Jun 2026
- 2026Efficient Diffusion LLMs via Temporal-Spatial Parallel Decoding and Confidence Extrapolation29 May 2026
- 2026TAD: Temporal-Aware Trajectory Self-Distillation for Fast and Accurate Diffusion LLM10 May 2026
- 2026R2-dLLM: Accelerating Diffusion Large Language Models via Spatio-Temporal Redundancy Reduction21 Apr 2026
- 2026Breaking Block Boundaries: Anchor-based History-stable Decoding for Diffusion Large Language Models10 Apr 2026
- 2026DMax: Aggressive Parallel Decoding for dLLMs9 Apr 2026
- 2026VidLaDA: Bidirectional Diffusion Large Language Models for Efficient Video Understanding25 Jan 2026
- 2025LoPA: Scaling dLLM Inference via Lookahead Parallel Decoding18 Dec 2025
- 2025Corrective Diffusion Language Models17 Dec 2025
- 2025Fast-Decoding Diffusion Language Models via Progress-Aware Confidence Schedules2 Dec 2025
- 2025Reasoning in Diffusion Large Language Models is Concentrated in Dynamic Confusion Zones19 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Models
- 2026Stability-Weighted Decoding for Diffusion Language Models
- 2026Roll Out and Roll Back: Diffusion LLMs are Their Own Efficiency Teachers
- 2025Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decoding
- 2026Early-Bird Decoding: Accelerating Diffusion LLMs with Learnable Block Sizes and Parallel Sampling
- 2026Understanding Evaluation Illusion in Diffusion Large Language Models
- 2026PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding
- 2026Trajectory-Level Speculative Decoding for Diffusion Language Models