mlsanityData to 14 Oct 2026

Convergence analysis of OT-Flow for sample generation

arXiv 2403.16208 ↗First posted 24 Mar 2024math.NA cs.LG cs.NAcited by 1

Not on the map. Why?

Abstract (arXiv)

Deep generative models aim to learn the underlying distribution of data and generate new ones. Despite the diversity of generative models and their high-quality generation performance in practice, most of them lack rigorous theoretical convergence proofs. In this work, we aim to establish some convergence results for OT-Flow, one of the deep generative models. First, by reformulating the framework of OT-Flow model, we establish the Gamma-convergence of the formulation of OT-flow to the corresponding optimal transport (OT) problem as the regularization term parameter α goes to infinity. Second, since the loss function will be approximated by Monte Carlo method in training, we established the convergence between the discrete loss function and the continuous one when the sample number N goes to infinity as well. Meanwhile, the approximation capability of the neural network provides an upper bound for the discrete loss function of the minimizers. The proofs in both aspects provide convincing assurances for OT-Flow.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 35 references that are in the map. First posted on arXiv 24 Mar 2024.

Builds on

11 of 35 references.

References · 11

  1. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2015Variational Inference with Normalizing Flowscited by 2,170
  4. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  5. 2019An Introduction to Variational Autoencoderscited by 1,000
  6. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
  7. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  8. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 334
  9. 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
  10. 2020Higher-order Quasi-Monte Carlo Training of Deep Neural Networkscited by 12
  11. 2023A new approach to generalisation error of machine learning algorithms: Estimates and convergencecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.