Accelerating Diffusion Sampling via Speculative Draft Trees
On the map: Diffusion models → Discrete and text diffusion
also in 1 more
Abstract (arXiv)
Speculative sampling accelerates diffusion model generation by drafting inexpensive candidate states and correcting them under a coupling that preserves the target distribution exactly, reducing the number of expensive target evaluations. Existing diffusion samplers, notably those based on reflection maximal coupling, are topologically constrained: their lookahead drafts form a chain graph, a single linear sequence, which inherently limits the acceptance rate per target evaluation. We connect speculative sampling in diffusion models to relative entropy coding (REC). This perspective shows the lookahead need not be linear and motivates our central contribution, draft trees, which enrich the candidates considered per round and lower the target function evaluations. We further adopt greedy rejection sampling, an REC algorithm, as the draft-target coupling, improving acceptance while guaranteeing exact target samples. Experiments across diverse target and draft models demonstrate up to 8.3% acceleration over the reflection coupling baseline in practical settings.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 61 of its 100 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
61 of 100 references.
Closest ancestors · 1
Same direction, newest first
Other references · 60
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
38 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2022Video Diffusion Modelscited by 2,305
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Consistency Modelscited by 1,822
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,653
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2021Variational Diffusion Modelscited by 1,153
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 1,006
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2023Adversarial Diffusion Distillationcited by 759
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2023SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verificationcited by 365
- 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
- 2014A* Samplingcited by 151
- 2023SpecTr: Fast Speculative Decoding via Optimal Transportcited by 129
- 2023Parallel Sampling of Diffusion Modelscited by 112
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
- 2025How to build a consistency model: Learning flow maps via self-distillationcited by 103
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
- 2025The Principles of Diffusion Modelscited by 76
- 2024Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexitycited by 42
- 2026Meta Flow Maps enable scalable reward alignmentcited by 37
- 2024Accelerating Parallel Sampling of Diffusion Modelscited by 30
- 2026Diamond Maps: Efficient Reward Alignment via Stochastic Flow Mapscited by 29
- 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMscited by 22
- 2025Terminal Velocity Matchingcited by 20
- 2025Towards Optimal Multi-draft Speculative Decodingcited by 19
- 2023The Sample Complexity of Approximate Rejection Sampling with Applications to Smoothed Online Learningcited by 13
- 2024AMO Sampler: Enhancing Text Rendering with Overshootingcited by 12
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026A Tale of Two Temperatures: Simple, Efficient, and Diverse Sampling from Diffusion Language Models
- 2025Diffusion Language Models are Provably Optimal Parallel Samplers
- 2025Diffusion Tree Sampling: Scalable inference-time alignment of diffusion models
- 2025Pretrained Diffusion Models Are Inherently Skipped-Step Samplers
- 2025SynBoost: A Synergistic Framework for Fast Sampling of Diffusion Models
- 2025On scalable and efficient training of diffusion samplers
- 2026PRESTO: Prefix-Aligned Tree Drafting for Diffusion Speculative Decoding
- 2026The Diffusion Duality, Chapter II: Psi-Samplers