mlsanityData to 14 Oct 2026

Accelerating Diffusion Sampling via Speculative Draft Trees

arXiv 2609.17691 ↗First posted 15 Sep 2026cs.LG cs.AI stat.APcited by 2

On the map: Diffusion models → Discrete and text diffusion

also in 1 more
Abstract (arXiv)

Speculative sampling accelerates diffusion model generation by drafting inexpensive candidate states and correcting them under a coupling that preserves the target distribution exactly, reducing the number of expensive target evaluations. Existing diffusion samplers, notably those based on reflection maximal coupling, are topologically constrained: their lookahead drafts form a chain graph, a single linear sequence, which inherently limits the acceptance rate per target evaluation. We connect speculative sampling in diffusion models to relative entropy coding (REC). This perspective shows the lookahead need not be linear and motivates our central contribution, draft trees, which enrich the candidates considered per round and lower the target function evaluations. We further adopt greedy rejection sampling, an REC algorithm, as the draft-target coupling, improving acceptance while guaranteeing exact target samples. Experiments across diverse target and draft models demonstrate up to 8.3% acceleration over the reflection coupling baseline in practical settings.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 61 of its 100 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

61 of 100 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Accelerated Diffusion Models via Speculative Sampling9 Jan

Other references · 60

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  10. 2022Flow Matching for Generative Modelingcited by 5,702
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
38 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  3. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  4. 2022Video Diffusion Modelscited by 2,305
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  6. 2023Consistency Modelscited by 1,822
  7. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,653
  8. 2018Hierarchical Neural Story Generationcited by 1,193
  9. 2021Variational Diffusion Modelscited by 1,153
  10. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  11. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  12. 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 1,006
  13. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  14. 2023Adversarial Diffusion Distillationcited by 759
  15. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  16. 2025Mean Flows for One-step Generative Modelingcited by 561
  17. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
  18. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  19. 2024One Step Diffusion via Shortcut Modelscited by 391
  20. 2023SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verificationcited by 365
  21. 2021Knowledge Distillation in Iterative Generative Models for Improved Sampling Speedcited by 348
  22. 2014A* Samplingcited by 151
  23. 2023SpecTr: Fast Speculative Decoding via Optimal Transportcited by 129
  24. 2023Parallel Sampling of Diffusion Modelscited by 112
  25. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
  26. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
  27. 2025How to build a consistency model: Learning flow maps via self-distillationcited by 103
  28. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
  29. 2025The Principles of Diffusion Modelscited by 76
  30. 2024Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexitycited by 42
  31. 2026Meta Flow Maps enable scalable reward alignmentcited by 37
  32. 2024Accelerating Parallel Sampling of Diffusion Modelscited by 30
  33. 2026Diamond Maps: Efficient Reward Alignment via Stochastic Flow Mapscited by 29
  34. 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMscited by 22
  35. 2025Terminal Velocity Matchingcited by 20
  36. 2025Towards Optimal Multi-draft Speculative Decodingcited by 19
  37. 2023The Sample Complexity of Approximate Rejection Sampling with Applications to Smoothed Online Learningcited by 13
  38. 2024AMO Sampler: Enhancing Text Rendering with Overshootingcited by 12

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Tale of Two Temperatures: Simple, Efficient, and Diverse Sampling from Diffusion Language Models
  2. 2025Diffusion Language Models are Provably Optimal Parallel Samplers
  3. 2025Diffusion Tree Sampling: Scalable inference-time alignment of diffusion models
  4. 2025Pretrained Diffusion Models Are Inherently Skipped-Step Samplers
  5. 2025SynBoost: A Synergistic Framework for Fast Sampling of Diffusion Models
  6. 2025On scalable and efficient training of diffusion samplers
  7. 2026PRESTO: Prefix-Aligned Tree Drafting for Diffusion Speculative Decoding
  8. 2026The Diffusion Duality, Chapter II: Psi-Samplers