Schr"odinger bridge for generative AI: Soft-constrained formulation and convergence analysis
Not on the map. Why?
Abstract (arXiv)
Generative AI can be framed as the problem of learning a model that maps simple reference measures into complex data distributions, and it has recently found a strong connection to the classical theory of the Schr"odinger bridge problems (SBPs) due partly to their common nature of interpolating between prescribed marginals via entropy-regularized stochastic dynamics. However, the classical SBP enforces hard terminal constraints, which often leads to instability in practical implementations, especially in high-dimensional or data-scarce regimes. To address this challenge, we follow the idea of the so-called soft-constrained Schr"odinger bridge problem (SCSBP), in which the terminal constraint is replaced by a general penalty function. This relaxation leads to a more flexible stochastic control formulation of McKean-Vlasov type. We establish the existence of optimal solutions for all penalty levels and prove that, as the penalty grows, both the controls and value functions converge to those of the classical SBP at a linear rate. Our analysis builds on Doob's h-transform representations, the stability results of Schr"odinger potentials, Gamma-convergence, and a novel fixed-point argument that couples an optimization problem over the space of measures with an auxiliary entropic optimal transport problem. These results not only provide the first quantitative convergence guarantees for soft-constrained bridges but also shed light on how penalty regularization enables robust generative modeling, fine-tuning, and transfer learning.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 40 of its 69 references that are in the map. First posted on arXiv 13 Oct 2025.
Builds on
40 of 69 references.
References · 40
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
- 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 292
- 2021Likelihood Training of Schr"odinger Bridge using Forward-Backward SDEs Theorycited by 219
- 2023Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Datacited by 174
- 2023Diffusion Schr"odinger Bridge Matchingcited by 153
- 2024Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized Controlcited by 143
28 more
- 2021Solving Schr"odinger Bridges via Maximum Likelihoodcited by 141
- 2023On Memorization in Diffusion Modelscited by 125
- 2021Understanding and Improving Early Stopping for Learning with Noisy Labelscited by 113
- 2021Deep Generative Learning via Schr"odinger Bridgecited by 104
- 2023Improved sampling via learned diffusionscited by 104
- 2023Diffusion Bridge Mixture Transports, Schr"odinger Bridge Problems and Generative Modelingcited by 80
- 2020COT-GAN: Generating Sequential Data via Causal Optimal Transportcited by 71
- 2023On the Generalization Properties of Diffusion Modelscited by 68
- 2023Recent Advances in Optimal Transport for Machine Learningcited by 66
- 2024Unveil Conditional Diffusion Models with Classifier-free Guidance: A Sharp Statistical Theorycited by 63
- 2024Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalizationcited by 42
- 2024Fine-tuning of diffusion models via stochastic control: entropy regularization and beyondcited by 42
- 2021Entropic Optimal Transport: Convergence of Potentialscited by 31
- 2024Stochastic Control for Fine-tuning Diffusion Models: Optimality, Regularity, and Convergencecited by 19
- 2024(De)-regularized Maximum Mean Discrepancy Gradient Flowcited by 16
- 2022Displacement smoothness of entropic optimal transportcited by 13
- 2025Diffusion Factor Models: Generating High-Dimensional Returns with Factor Structurecited by 13
- 2024Transfer Learning for Diffusion Modelscited by 10
- 2025Composite Flow Matching for Reinforcement Learning with Shifted-Dynamics Datacited by 9
- 2024Soft-constrained Schrodinger Bridge: a Stochastic Control Approachcited by 8
- 2024Time-Causal VAE: Robust Financial Time Series Generatorcited by 8
- 2025Robust time series generation via Schr"odinger Bridge: a comprehensive evaluationcited by 8
- 2022Applying Regularized Schr"odinger-Bridge-Based Stochastic Process in Generative Modelingcited by 7
- 2023Propagation of chaos for mean field Schr"odinger problemscited by 5
- 2023Risk of Transfer Learning and its Applications in Financecited by 5
- 2025RPO: Fine-Tuning Visual Generative Models via Rich Vision-Language Preferencescited by 5
- 2023Calibration of Local Volatility Models with Stochastic Interest Rates using Optimal Transportcited by 1
- 2024From entropic transport to martingale transport, and applications to model calibrationcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.