Lipschitz-Guided Design of Interpolation Schedules in Generative Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
We study the design of interpolation schedules in flow and diffusion-based generative models from both statistical and numerical perspectives. Within the stochastic interpolants framework, we first show that scalar interpolation schedules are statistically equivalent under the Kullback--Leibler divergence in path space, after optimal a posteriori tuning of the diffusion coefficient. This equivalence motivates focusing on numerical properties of the drift field rather than purely statistical criteria. We propose minimizing the averaged squared Lipschitzness of the drift as a principled criterion for schedule design, in contrast with kinetic-energy minimization in optimal transport. A simple transfer formula expresses the drift of one schedule in terms of the drift of another, allowing the designed schedule to be used at inference time with a model trained under a different (e.g., linear) schedule, without retraining. We work out the optimal schedules analytically for Gaussian and Gaussian-mixture targets: for Gaussians, we obtain exponential improvements in the Lipschitz constant over linear schedules; for Gaussian mixtures, we obtain schedules that mitigate mode collapse in few-step sampling. We then validate the approach on high-dimensional invariant measures of stochastic Allen--Cahn and Navier--Stokes equations, where the designed schedule yields markedly more accurate fine-scale statistics at fixed integrator budget.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 45 of its 50 references that are in the map. First posted on arXiv 1 Sep 2025.
Builds on
45 of 50 references.
Closest ancestors · 29
Same direction, newest first
- 2025On the Contractivity of Stochastic Interpolation Flow14 Apr
- 2025Optimizing Noise Schedules of Generative Models in High Dimensionss2 Jan
- 2024One Step Diffusion via Shortcut Models16 Oct
- 2024Stochastic Runge-Kutta Methods: Provable Acceleration of Diffusion Models7 Oct
- 2024Evaluating the design space of diffusion-based generative models18 Jun
- 2024Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexity24 May
- 2024On the Trajectory Regularity of ODE-based Diffusion Sampling18 May
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Models22 Apr
- 2024Accelerating Convergence of Score-Based Diffusion Models, Provably6 Mar
- 2024Accelerating Diffusion Sampling with Optimized Time Steps27 Feb
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion1 Oct
- 2023Consistency Models2 Mar
17 more
- 2022Wavelet Diffusion Models are fast and scalable Image Generators29 Nov
- 2022GENIE: Higher-Order Denoising Diffusion Solvers11 Oct
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
- 2022Wavelet Score-Based Generative Modeling9 Aug
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2022Subspace Diffusion Generative Models3 May
- 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
- 2021Variational Diffusion Models1 Jul
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
- 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
- 2021Gotta Go Fast When Generating Data with Score-Based Models28 May
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Noise Estimation for Generative Diffusion Models6 Apr
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
- 2020Improved Techniques for Training Score-Based Generative Models16 Jun
Other references · 16
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 267
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 99
- 2024Probabilistic Forecasting with Stochastic Interpolants and F"ollmer Processescited by 61
- 2023Bespoke Solvers for Generative Flow Modelscited by 36
- 2020Wavelet Flow: Fast Training of High Resolution Normalizing Flowscited by 33
4 more
- 2025Accelerated Diffusion Models via Speculative Samplingcited by 30
- 2023Gaussian Interpolation Flowscited by 17
- 2025Optimal Scheduling of Dynamic Transportcited by 12
- 2025New affine invariant ensemble samplers and their dimensional scalingcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 12.
15 papers.
Sort:
By area:
- 2025Scale-Adaptive Generative Flows for Multiscale Scientific Datacited by 4
- 2026Geometry-Aware Discretization Error of Diffusion Modelscited by 3
- 2025On The Hidden Biases of Flow Matching Samplerscited by 2
- 2025Adaptive Path Integral Diffusion: AdaPIDcited by 1
- 2026Variational Optimality of F"ollmer Processes in Generative Diffusionscited by 1
- 2026Noise Schedule Design for Diffusion Models: An Optimal Control Perspectivecited by 1
- 2026Two-Parameter Flows for Learning Population Dynamics of Physical Systemscited by 1
- 2026Scheduling Thoughts: Learning the Order of Thought in Diffusion Language Modelscited by 1
- 2026Gaussian Flow-Matching Schedules: Implications for Sampling and Trainingcited by 1
- 2026Fast Sampling for Flows and Diffusions with Lazy and Point Mass Stochastic Interpolantscited by 0
- 2026A Quantitative Approximation Framework for Flow Distillation in Diffusion Modelscited by 0
- 2026Making Every Step Count: Spatio-Temporal Information Allocation for Imaging Inverse Problemscited by 0
- 2026Universal Local Error and Realized Amplification for the First-Order EDM Predictor7 Oct 2026
- 2026Correcting CondOT: Exact Finite-Step Sampling in Gaussian Flow Matching30 Sep 2026
- 2026Gaussian Flow-Matching Schedules: Implications for Sampling and Training22 Sep 2026
- 2026Model-Aware Schedules Improve Generation via Fiberwise Optimal Transport10 Sep 2026
- 2026Making Every Step Count: Spatio-Temporal Information Allocation for Imaging Inverse Problems12 Aug 2026
- 2026Scheduling Thoughts: Learning the Order of Thought in Diffusion Language Models22 Jun 2026
- 2026A Quantitative Approximation Framework for Flow Distillation in Diffusion Models2 Jun 2026
- 2026Two-Parameter Flows for Learning Population Dynamics of Physical Systems25 May 2026
- 2026Noise Schedule Design for Diffusion Models: An Optimal Control Perspective21 May 2026
- 2026Geometry-Aware Discretization Error of Diffusion Models8 May 2026
- 2026Variational Optimality of F"ollmer Processes in Generative Diffusions11 Feb 2026
- 2026Fast Sampling for Flows and Diffusions with Lazy and Point Mass Stochastic Interpolants3 Feb 2026
3 more
- 2025On The Hidden Biases of Flow Matching Samplers18 Dec 2025
- 2025Adaptive Path Integral Diffusion: AdaPID5 Dec 2025
- 2025Scale-Adaptive Generative Flows for Multiscale Scientific Data3 Sep 2025
- 2026Geometry-Aware Discretization Error of Diffusion Modelscited by 3
- 2025On The Hidden Biases of Flow Matching Samplerscited by 2
- 2026Noise Schedule Design for Diffusion Models: An Optimal Control Perspectivecited by 1
- 2026Gaussian Flow-Matching Schedules: Implications for Sampling and Trainingcited by 1
- 2026A Quantitative Approximation Framework for Flow Distillation in Diffusion Modelscited by 0
- 2026Model-Aware Schedules Improve Generation via Fiberwise Optimal Transportcited by 0
- 2026Correcting CondOT: Exact Finite-Step Sampling in Gaussian Flow Matchingcited by 0
- 2026Universal Local Error and Realized Amplification for the First-Order EDM Predictorcited by 0
- 2026Universal Local Error and Realized Amplification for the First-Order EDM Predictor7 Oct 2026
- 2026Correcting CondOT: Exact Finite-Step Sampling in Gaussian Flow Matching30 Sep 2026
- 2026Gaussian Flow-Matching Schedules: Implications for Sampling and Training22 Sep 2026
- 2026Model-Aware Schedules Improve Generation via Fiberwise Optimal Transport10 Sep 2026
- 2026A Quantitative Approximation Framework for Flow Distillation in Diffusion Models2 Jun 2026
- 2026Noise Schedule Design for Diffusion Models: An Optimal Control Perspective21 May 2026
- 2026Geometry-Aware Discretization Error of Diffusion Models8 May 2026
- 2025On The Hidden Biases of Flow Matching Samplers18 Dec 2025
- 2025Scale-Adaptive Generative Flows for Multiscale Scientific Datacited by 4
- 2025Adaptive Path Integral Diffusion: AdaPIDcited by 1
- 2026Variational Optimality of F"ollmer Processes in Generative Diffusionscited by 1
- 2026Two-Parameter Flows for Learning Population Dynamics of Physical Systemscited by 1
- 2026Fast Sampling for Flows and Diffusions with Lazy and Point Mass Stochastic Interpolantscited by 0
- 2026Making Every Step Count: Spatio-Temporal Information Allocation for Imaging Inverse Problemscited by 0
- 2026Making Every Step Count: Spatio-Temporal Information Allocation for Imaging Inverse Problems12 Aug 2026
- 2026Two-Parameter Flows for Learning Population Dynamics of Physical Systems25 May 2026
- 2026Variational Optimality of F"ollmer Processes in Generative Diffusions11 Feb 2026
- 2026Fast Sampling for Flows and Diffusions with Lazy and Point Mass Stochastic Interpolants3 Feb 2026
- 2025Adaptive Path Integral Diffusion: AdaPID5 Dec 2025
- 2025Scale-Adaptive Generative Flows for Multiscale Scientific Data3 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026Formalizing the Sampling Design Space of Diffusion-Based Generative Models via Adaptive Solvers and Wasserstein-Bounded Timesteps
- 2025Distribution estimation via Flow Matching with Lipschitz guarantees
- 2025Hierarchical Schedule Optimization for Fast and Robust Diffusion Model Sampling
- 2026A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models
- 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
- 2022An optimal control perspective on diffusion-based generative modeling
- 2025Multitask Learning with Stochastic Interpolants