mlsanityData to 7 Oct 2026

Lipschitz-Guided Design of Interpolation Schedules in Generative Models

arXiv 2509.01629 ↗First posted 1 Sep 2025stat.ML cs.LG cs.NAcited by 15

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

We study the design of interpolation schedules in flow and diffusion-based generative models from both statistical and numerical perspectives. Within the stochastic interpolants framework, we first show that scalar interpolation schedules are statistically equivalent under the Kullback--Leibler divergence in path space, after optimal a posteriori tuning of the diffusion coefficient. This equivalence motivates focusing on numerical properties of the drift field rather than purely statistical criteria. We propose minimizing the averaged squared Lipschitzness of the drift as a principled criterion for schedule design, in contrast with kinetic-energy minimization in optimal transport. A simple transfer formula expresses the drift of one schedule in terms of the drift of another, allowing the designed schedule to be used at inference time with a model trained under a different (e.g., linear) schedule, without retraining. We work out the optimal schedules analytically for Gaussian and Gaussian-mixture targets: for Gaussians, we obtain exponential improvements in the Lipschitz constant over linear schedules; for Gaussian mixtures, we obtain schedules that mitigate mode collapse in few-step sampling. We then validate the approach on high-dimensional invariant measures of stochastic Allen--Cahn and Navier--Stokes equations, where the designed schedule yields markedly more accurate fine-scale statistics at fixed integrator budget.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 45 of its 50 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

45 of 50 references.

Closest ancestors · 29

Same direction, newest first

  1. 2025On the Contractivity of Stochastic Interpolation Flow14 Apr
  2. 2025Optimizing Noise Schedules of Generative Models in High Dimensionss2 Jan
  3. 2024One Step Diffusion via Shortcut Models16 Oct
  4. 2024Stochastic Runge-Kutta Methods: Provable Acceleration of Diffusion Models7 Oct
  5. 2024Evaluating the design space of diffusion-based generative models18 Jun
  6. 2024Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexity24 May
  7. 2024On the Trajectory Regularity of ODE-based Diffusion Sampling18 May
  8. 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Models22 Apr
  9. 2024Accelerating Convergence of Score-Based Diffusion Models, Provably6 Mar
  10. 2024Accelerating Diffusion Sampling with Optimized Time Steps27 Feb
  11. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion1 Oct
  12. 2023Consistency Models2 Mar
17 more
  1. 2022Wavelet Diffusion Models are fast and scalable Image Generators29 Nov
  2. 2022GENIE: Higher-Order Denoising Diffusion Solvers11 Oct
  3. 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep
  4. 2022Wavelet Score-Based Generative Modeling9 Aug
  5. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  6. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  7. 2022Subspace Diffusion Generative Models3 May
  8. 2022Fast Sampling of Diffusion Models with Exponential Integrator29 Apr
  9. 2021Variational Diffusion Models1 Jul
  10. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
  11. 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
  12. 2021Gotta Go Fast When Generating Data with Score-Based Models28 May
  13. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  14. 2021Noise Estimation for Generative Diffusion Models6 Apr
  15. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  16. 2020Denoising Diffusion Probabilistic Models19 Jun
  17. 2020Improved Techniques for Training Score-Based Generative Models16 Jun

Other references · 16

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  5. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  6. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  7. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  8. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 267
  9. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 99
  10. 2024Probabilistic Forecasting with Stochastic Interpolants and F"ollmer Processescited by 61
  11. 2023Bespoke Solvers for Generative Flow Modelscited by 36
  12. 2020Wavelet Flow: Fast Training of High Resolution Normalizing Flowscited by 33
4 more
  1. 2025Accelerated Diffusion Models via Speculative Samplingcited by 30
  2. 2023Gaussian Interpolation Flowscited by 17
  3. 2025Optimal Scheduling of Dynamic Transportcited by 12
  4. 2025New affine invariant ensemble samplers and their dimensional scalingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 12.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Formalizing the Sampling Design Space of Diffusion-Based Generative Models via Adaptive Solvers and Wasserstein-Bounded Timesteps
  2. 2025Distribution estimation via Flow Matching with Lipschitz guarantees
  3. 2025Hierarchical Schedule Optimization for Fast and Robust Diffusion Model Sampling
  4. 2026A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models
  5. 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models
  6. 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
  7. 2022An optimal control perspective on diffusion-based generative modeling
  8. 2025Multitask Learning with Stochastic Interpolants