mlsanityData to 14 Oct 2026

PRESTO: Prefix-Aligned Tree Drafting for Diffusion Speculative Decoding

arXiv 2607.22634 ↗First posted 20 Jun 2026cs.AIcited by 3

On the map: Efficient LLM inference and serving → Speculative decoding

Abstract (arXiv)

Diffusion Large Language Models (dLLMs) have emerged as a promising alternative to autoregressive (AR) LLMs, generating tokens in parallel. This makes them effective draft models for speculative decoding (SD), producing an entire block of draft tokens in a single forward pass. Yet existing diffusion-based drafting methods rely on linear drafting, even though dLLMs emit multiple candidate tokens across positions, inducing a large combinatorial space of decoding paths. Consequently, they limit acceptance length and decoding efficiency. To exploit this multi-candidate structure, we apply tree-based drafting to diffusion drafters, enabling exploration of diverse candidate paths. However, we find that naive tree drafting is suboptimal: diffusion marginals are prefix-blind, mismatching the prefix-based AR verification and yielding unreliable path ranking. We propose PRESTO, a principled framework that extends tree-based drafting to diffusion drafters while resolving the fundamental mismatch between diffusion draft confidence and prefix-based AR verification through PREfix-aligned Scoring and priority-based Tree search for diffusion speculative decOding. The key principles behind PRESTO are that (1) candidate ranking should align with the prefix-based nature of AR verification, and (2) tree construction should prioritize candidate paths with high verification potential to maximize acceptance length. Extensive experiments show that PRESTO achieves up to an average of 1.5× end-to-end throughput speedup on the state-of-the-art dedicated diffusion drafter SD and an average of 1.12× on self-speculative diffusion LLMs across diverse benchmarks.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Speculative decoding, one of 12 directions in Efficient LLM inference and serving. Builds on 23 of its 31 references that are in the map. First posted on arXiv 20 Jun 2026.

Builds on

23 of 31 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026DFlash: Block Diffusion for Flash Speculative Decoding5 Feb
  2. 2025SpecDiff-2: Scaling Diffusion Drafter Alignment For Faster Speculative Decoding1 Nov
  3. 2025DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding28 Sep
  4. 2025EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test3 Mar
  5. 2024OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure25 Jun
  6. 2024EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees24 Jun
  7. 2024SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices4 Jun
  8. 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads19 Jan
  9. 2023SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification16 May
  10. 2023Accelerating Large Language Model Decoding with Speculative Sampling2 Feb
  11. 2022Fast Inference from Transformers via Speculative Decoding30 Nov

Other references · 12

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2021Program Synthesis with Large Language Modelscited by 3,637
  5. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  6. 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
  7. 2025FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Servingcited by 258
  8. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
  9. 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 139
  10. 2025SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generationcited by 129
  11. 2025Your LLM Knows the Future: Uncovering Its Multi-Token Prediction Potentialcited by 47
  12. 2025Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speedcited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TAPS: Target-Aware Prefix Tree Selection for Diffusion-Drafted Speculative Decoding
  2. 2026D^2SD: Accelerating Speculative Decoding with Dual Diffusion Draft Models
  3. 2026Accelerating Speculative Decoding with Block Diffusion Draft Trees
  4. 2026DARTree: Speculative Diffusion Decoding with Autoregressive Draft Trees
  5. 2026Cost-Aware Diffusion Draft Trees for Speculative Decoding
  6. 2025Fail Fast, Win Big: Rethinking the Drafting Strategy in Speculative Decoding via Diffusion LLMs
  7. 2026SimSD: Simple Speculative Decoding in Diffusion Language Models
  8. 2026JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting