A Quantitative Approximation Framework for Flow Distillation in Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
We develop a quantitative framework for diffusion distillation by viewing few step sampling as approximation through compositions of learned flow maps. For trajectory distillation of the probability flow ODE, we show that low noise multimodal regimes separate score approximability from dynamical stability: the score remains efficiently approximable, while small local errors may be strongly amplified by stiff flow dynamics. In a Gaussian mixture Ornstein--Uhlenbeck model, we prove time uniform (Lp(pt)) score approximation by ReLU and ReQU networks with explicit polylogarithmic complexity, and derive a computable Lipschitz bound (L(t)) for the flow velocity. The stability factor (expbigl(intst L(u)mathrm dubigr)) can grow exponentially as noise decreases and mixture separation increases. Comparing this certificate with a certified local Lipschitz budget for one step students identifies regimes of direct distillation difficulty, without implying an approximation lower bound. We also show that deep residual compositions control global transport error through propagated local errors, and that equalizing cumulative stability yields an optimal nonuniform segmentation. With eight segments, this grid reduces final mean relative MSE by up to (51.9%) versus uniform grids.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 51 of its 60 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
51 of 60 references.
Closest ancestors · 34
Same direction, newest first
- 2026Smoothing the Score Function to Enhance Generalization in Diffusion Models27 Jan
- 2025Lipschitz-Guided Design of Interpolation Schedules in Generative Models1 Sep
- 2025Are We Really Learning the Score Function? Reinterpreting Diffusion Models Through Wasserstein Gradient Flow Matching30 Aug
- 2025On the Edge of Memorization in Diffusion Models25 Aug
- 2025Faster Diffusion Models via Higher-Order Approximation30 Jun
- 2025Resolving Memorization in Empirical Diffusion Model for Manifold Data in High-Dimensional Spaces5 May
- 2024Structured Diffusion Models with Mixture of Gaussians as Prior Distribution24 Oct
- 2024One Step Diffusion via Shortcut Models16 Oct
- 2024What does guidance do? A fine-grained analysis in a simple setting19 Sep
- 2024Breaking the Curse of Dimensionality: Diffusion Models Efficiently Learn Low-Dimensional Distributions4 Sep
- 2024Stability and Generalizability in SDE Diffusion Models with Measure-Preserving Dynamics19 Jun
- 2024Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective26 May
22 more
- 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
- 2024Learning Mixtures of Gaussians Using Diffusion Models29 Apr
- 2024Critical windows: non-asymptotic theory for feature emergence in diffusion models3 Mar
- 2024Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization28 Jan
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov
- 2023Adversarial Diffusion Distillation28 Nov
- 2023Gaussian Mixture Solvers for Diffusion Models2 Nov
- 2023Learning Mixtures of Gaussians Using the DDPM Objective3 Jul
- 2023Lipschitz Singularities in Diffusion Models20 Jun
- 2023BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping8 Jun
- 2023Diffusion Models are Minimax Optimal Distribution Estimators3 Mar
- 2023Consistency Models2 Mar
- 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data14 Feb
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions22 Sep
- 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
- 2022Convergence for score-based generative modeling with polynomial complexity13 Jun
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 17
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2019Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limitcited by 187
- 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
- 2023Exact Diffusion Inversion via Bi-directional Integration Approximationcited by 44
- 2023Analysis of learning a flow-based generative model from limited sample complexitycited by 38
- 2023Nearly Optimal VC-Dimension and Pseudo-Dimension Bounds for Deep Neural Network Derivativescited by 30
- 2022Simultaneous approximation of a smooth function and its derivatives by deep neural networks with piecewise-polynomial activationscited by 29
- 2021Overparameterization of deep ResNet: zero loss and mean-field analysiscited by 24
- 2024How Do Flow Matching Models Memorize and Generalize in Sample Data Subspaces?cited by 19
- 2025Flow Map Distillation Without Datacited by 14
5 more
- 2024Characteristic Learning for Provable One Step Generationcited by 5
- 2026Terminally constrained flow-based generative models from an optimal control perspectivecited by 4
- 2025Simultaneous Approximation of the Score Function and Its Derivatives by Deep Neural Networkscited by 3
- 2025Toward Theoretical Insights into Diffusion Trajectory Distillation via Operator Mergingcited by 2
- 2025Expressive Power of Deep Networks on Manifolds: Simultaneous Approximationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Cross-Time Directional Selection in Diffusion Samplingcited by 0
- 2026Cross-Time Directional Selection in Diffusion Sampling4 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2025Understanding Generalization in Diffusion Distillation via Probability Flow Distance
- 2026Consistent Distribution Matching for Data-Free Diffusion Distillation
- 2025How to build a consistency model: Learning flow maps via self-distillation
- 2026Stabilizing, Scaling & Enhancing MeanFlow for Large-scale Diffusion Distillation
- 2026Probability-Flow Distillation: Distribution Matching in Parameter Space
- 2025VarDiU: A Variational Diffusive Upper Bound for One-Step Diffusion Distillation
- 2025From Structure to Detail: Hierarchical Distillation for Efficient Diffusion Model
- 2025Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free Lunch