mlsanityData to 7 Oct 2026

Conditional Stochastic Interpolation for Generative Learning

arXiv 2312.05579 ↗First posted 9 Dec 2023stat.ML cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

We propose a conditional stochastic interpolation (CSI) method for learning conditional distributions. CSI is based on estimating probability flow equations or stochastic differential equations that transport a reference distribution to the target conditional distribution. This is achieved by first learning the conditional drift and score functions based on CSI, which are then used to construct a deterministic process governed by an ordinary differential equation or a diffusion process for conditional sampling. In our proposed approach, we incorporate an adaptive diffusion term to address the instability issues arising in the diffusion process. We derive explicit expressions of the conditional drift and score functions in terms of conditional expectations, which naturally lead to an nonparametric regression approach to estimating these functions. Furthermore, we establish nonasymptotic error bounds for learning the target conditional distribution. We illustrate the application of CSI on image generation using a benchmark image dataset.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 31 of its 50 references that are in the map. First posted on arXiv 9 Dec 2023.

Builds on

31 of 50 references.

References · 31

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  10. 2014Conditional Generative Adversarial Netscited by 2,152
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  12. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
19 more
  1. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  2. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  3. 2016Generative Adversarial Text to Image Synthesiscited by 735
  4. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 440
  5. 2017Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networkscited by 304
  6. 2022Convergence of denoising diffusion models under the manifold hypothesiscited by 237
  7. 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localizationcited by 230
  8. 2022Improved Analysis of Score-based Generative Modeling: User-Friendly Bounds under Minimal Smoothness Assumptionscited by 215
  9. 2022Convergence of score-based generative modeling for general data distributionscited by 179
  10. 2022Convergence for score-based generative modeling with polynomial complexitycited by 176
  11. 2023Flow Matching in Latent Spacecited by 155
  12. 2022Score-Based Generative Models Detect Manifoldscited by 121
  13. 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimationcited by 95
  14. 2022Poisson Flow Generative Modelscited by 95
  15. 2023Error Bounds for Flow Matching Methodscited by 88
  16. 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Modelscited by 84
  17. 2018Bias and Generalization in Deep Generative Models: An Empirical Studycited by 83
  18. 2023Restoration-Degradation Beyond Linear Diffusions: A Non-Asymptotic Analysis For DDIM-Type Samplerscited by 73
  19. 2023KL Convergence Guarantees for Score diffusion models under minimal data assumptionscited by 61

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 1.

8 papers.