mlsanityData to 14 Oct 2026

A Quantitative Approximation Framework for Flow Distillation in Diffusion Models

arXiv 2606.03820 ↗First posted 2 Jun 2026stat.ML cs.LGcited by 1

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

We develop a quantitative framework for diffusion distillation by viewing few step sampling as approximation through compositions of learned flow maps. For trajectory distillation of the probability flow ODE, we show that low noise multimodal regimes separate score approximability from dynamical stability: the score remains efficiently approximable, while small local errors may be strongly amplified by stiff flow dynamics. In a Gaussian mixture Ornstein--Uhlenbeck model, we prove time uniform (Lp(pt)) score approximation by ReLU and ReQU networks with explicit polylogarithmic complexity, and derive a computable Lipschitz bound (L(t)) for the flow velocity. The stability factor (expbigl(intst L(u)mathrm dubigr)) can grow exponentially as noise decreases and mixture separation increases. Comparing this certificate with a certified local Lipschitz budget for one step students identifies regimes of direct distillation difficulty, without implying an approximation lower bound. We also show that deep residual compositions control global transport error through propagated local errors, and that equalizing cumulative stability yields an optimal nonuniform segmentation. With eight segments, this grid reduces final mean relative MSE by up to (51.9%) versus uniform grids.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 51 of its 60 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

51 of 60 references.

Closest ancestors · 34

Same direction, newest first

  1. 2026Smoothing the Score Function to Enhance Generalization in Diffusion Models27 Jan
  2. 2025Lipschitz-Guided Design of Interpolation Schedules in Generative Models1 Sep
  3. 2025Are We Really Learning the Score Function? Reinterpreting Diffusion Models Through Wasserstein Gradient Flow Matching30 Aug
  4. 2025On the Edge of Memorization in Diffusion Models25 Aug
  5. 2025Faster Diffusion Models via Higher-Order Approximation30 Jun
  6. 2025Resolving Memorization in Empirical Diffusion Model for Manifold Data in High-Dimensional Spaces5 May
  7. 2024Structured Diffusion Models with Mixture of Gaussians as Prior Distribution24 Oct
  8. 2024One Step Diffusion via Shortcut Models16 Oct
  9. 2024What does guidance do? A fine-grained analysis in a simple setting19 Sep
  10. 2024Breaking the Curse of Dimensionality: Diffusion Models Efficiently Learn Low-Dimensional Distributions4 Sep
  11. 2024Stability and Generalizability in SDE Diffusion Models with Measure-Preserving Dynamics19 Jun
  12. 2024Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective26 May
22 more
  1. 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
  2. 2024Learning Mixtures of Gaussians Using Diffusion Models29 Apr
  3. 2024Critical windows: non-asymptotic theory for feature emergence in diffusion models3 Mar
  4. 2024Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization28 Jan
  5. 2023One-step Diffusion with Distribution Matching Distillation30 Nov
  6. 2023Adversarial Diffusion Distillation28 Nov
  7. 2023Gaussian Mixture Solvers for Diffusion Models2 Nov
  8. 2023Learning Mixtures of Gaussians Using the DDPM Objective3 Jul
  9. 2023Lipschitz Singularities in Diffusion Models20 Jun
  10. 2023BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping8 Jun
  11. 2023Diffusion Models are Minimax Optimal Distribution Estimators3 Mar
  12. 2023Consistency Models2 Mar
  13. 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data14 Feb
  14. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
  15. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
  16. 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
  17. 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
  18. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  19. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  20. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  21. 2020Denoising Diffusion Implicit Models6 Oct
  22. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2025Mean Flows for One-step Generative Modelingcited by 561
  4. 2019Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limitcited by 187
  5. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
  6. 2023Exact Diffusion Inversion via Bi-directional Integration Approximationcited by 44
  7. 2023Analysis of learning a flow-based generative model from limited sample complexitycited by 38
  8. 2023Nearly Optimal VC-Dimension and Pseudo-Dimension Bounds for Deep Neural Network Derivativescited by 30
  9. 2022Simultaneous approximation of a smooth function and its derivatives by deep neural networks with piecewise-polynomial activationscited by 29
  10. 2021Overparameterization of deep ResNet: zero loss and mean-field analysiscited by 24
  11. 2024How Do Flow Matching Models Memorize and Generalize in Sample Data Subspaces?cited by 19
  12. 2025Flow Map Distillation Without Datacited by 14
5 more
  1. 2024Characteristic Learning for Provable One Step Generationcited by 5
  2. 2026Terminally constrained flow-based generative models from an optimal control perspectivecited by 4
  3. 2025Simultaneous Approximation of the Score Function and Its Derivatives by Deep Neural Networkscited by 3
  4. 2025Toward Theoretical Insights into Diffusion Trajectory Distillation via Operator Mergingcited by 2
  5. 2025Expressive Power of Deep Networks on Manifolds: Simultaneous Approximationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Understanding Generalization in Diffusion Distillation via Probability Flow Distance
  2. 2026Consistent Distribution Matching for Data-Free Diffusion Distillation
  3. 2025How to build a consistency model: Learning flow maps via self-distillation
  4. 2026Stabilizing, Scaling & Enhancing MeanFlow for Large-scale Diffusion Distillation
  5. 2026Probability-Flow Distillation: Distribution Matching in Parameter Space
  6. 2025VarDiU: A Variational Diffusive Upper Bound for One-Step Diffusion Distillation
  7. 2025From Structure to Detail: Hierarchical Distillation for Efficient Diffusion Model
  8. 2025Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free Lunch