xPress: Parallel Refinement for Diffusion Drafters in Speculative Decoding
On the map: Efficient LLM inference and serving → Speculative decoding
Abstract (arXiv)
Block-diffusion drafters like dFlash generate an entire block of draft tokens in a single forward pass, drastically reducing the overhead of multiple-token drafting in speculative decoding. The crucial final step of the single-pass discrete denoising process involves using the logit distribution at each position to sample conditionally independent tokens. The resulting draft is thus a set of per-position marginals, rather than a joint distribution: no draft token is guaranteed to depend on its predecessors. Such independently sampled marginals tend to produce sequences with tokens that are individually likely, but jointly improbable under the target model's distribution, which verifies each token conditionally. This can cause early rejection and limits acceptance length. To address this, we propose xPress as a means to restore the missing causality in diffusion drafters. xPress is a lightweight causal refiner that reconciles the whole diffusion block at once through parallel refinement, restoring and propagating causal dependencies across the draft without a token-by-token loop. On Qwen3-8B, across seven math, code, and chat benchmarks, xPress raises acceptance length by about 30% on average (up to +56%) and its end-to-end decoding throughput by about 1.3 on average (up to 1.7) compared to the original dFlash diffusion drafter.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Speculative decoding, one of 12 directions in Efficient LLM inference and serving. Builds on 22 of its 24 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
22 of 24 references.
Closest ancestors · 14
Same direction, newest first
- 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation6 Jul
- 2026PRESTO: Prefix-Aligned Tree Drafting for Diffusion Speculative Decoding20 Jun
- 2026JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting16 Jun
- 2026Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding28 May
- 2026Accelerating Speculative Decoding with Block Diffusion Draft Trees14 Apr
- 2026DFlash: Block Diffusion for Flash Speculative Decoding5 Feb
- 2025SpecDiff-2: Scaling Diffusion Drafter Alignment For Faster Speculative Decoding1 Nov
- 2025DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding28 Sep
- 2025EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test3 Mar
- 2024EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees24 Jun
- 2024CLLMs: Consistency Large Language Models28 Feb
- 2024EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty26 Jan
2 more
Other references · 8
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 128
- 2020Accelerating Feedforward Computation via Parallel Nonlinear Equation Solvingcited by 51
- 2026Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decodingcited by 19
- 2026The Truth Lies Somewhere in the Middle (of the Generated Tokens)cited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Beyond Parallel Blindness: Information Floors and Model Gaps in Block Draftingcited by 0
- 2026Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Modelscited by 0
- 2026Carryover Drafting: Recycling Rejected States for Speculative Decodingcited by 0
- 2026Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decodingcited by 0
- 2026LongSpark: Efficient speculative decoding with a fixed-cost parallel draftercited by 0
- 2026DEdit: Iterative Draft Editing for Speculative Decodingcited by 0
- 2026D-Loop: Looped Diffusion Drafting for Speculative Decodingcited by 0
- 2026D-Loop: Looped Diffusion Drafting for Speculative Decoding5 Oct 2026
- 2026DEdit: Iterative Draft Editing for Speculative Decoding29 Sep 2026
- 2026LongSpark: Efficient speculative decoding with a fixed-cost parallel drafter29 Sep 2026
- 2026Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding28 Sep 2026
- 2026Carryover Drafting: Recycling Rejected States for Speculative Decoding13 Sep 2026
- 2026Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Models31 Aug 2026
- 2026Beyond Parallel Blindness: Information Floors and Model Gaps in Block Drafting27 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026AdaFlash: Adaptive Speculative Decoding via On-Policy Distilled Diffusion Drafters
- 2026PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding
- 2026D^2SD: Accelerating Speculative Decoding with Dual Diffusion Draft Models
- 2026Trajectory-Level Speculative Decoding for Diffusion Language Models
- 2026Cost-Aware Diffusion Draft Trees for Speculative Decoding
- 2026SimSD: Simple Speculative Decoding in Diffusion Language Models
- 2026Accelerating Speculative Diffusions via Block Verification
- 2026SpecFold: Folding Multi-Branch Redundancy for Faster Speculative Decoding in Diffusion Language Models