mlsanityData to 7 Oct 2026

Analyzing and Improving Optimal-Transport-based Adversarial Networks

arXiv 2310.02611 ↗First posted 4 Oct 2023cs.LG cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Optimal Transport (OT) problem aims to find a transport plan that bridges two distributions while minimizing a given cost function. OT theory has been widely utilized in generative modeling. In the beginning, OT distance has been used as a measure for assessing the distance between data and generated distributions. Recently, OT transport map between data and prior distributions has been utilized as a generative model. These OT-based generative models share a similar adversarial training objective. In this paper, we begin by unifying these OT-based adversarial methods within a single framework. Then, we elucidate the role of each component in training dynamics through a comprehensive analysis of this unified framework. Moreover, we suggest a simple but novel method that improves the previously best-performing OT-based model. Intuitively, our approach conducts a gradual refinement of the generated distribution, progressively aligning it with the data distribution. Our approach achieves a FID score of 2.51 on CIFAR-10 and 5.99 on CelebA-HQ-256, outperforming unified OT-based adversarial approaches.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 53 of its 69 references that are in the map. First posted on arXiv 4 Oct 2023.

Builds on

53 of 69 references.

References · 53

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  7. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  10. 2016Improved Techniques for Training GANscited by 2,938
  11. 2017Improved Training of Wasserstein GANscited by 2,223
  12. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
38 more
  1. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  2. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  3. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  4. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  5. 2016Pixel Recurrent Neural Networkscited by 814
  6. 2018Computational Optimal Transportcited by 765
  7. 2018Which Training Methods for GANs do actually Converge?cited by 672
  8. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
  9. 2021Score-based Generative Modeling in Latent Spacecited by 634
  10. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  11. 2015Optimal Transport for Domain Adaptationcited by 457
  12. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusioncited by 230
  13. 2019Optimal transport mapping via input convex neural networkscited by 202
  14. 2020Geometric Dataset Distances via Optimal Transportcited by 157
  15. 2020Adversarial Latent Autoencoderscited by 155
  16. 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
  17. 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 138
  18. 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 123
  19. 2022Neural Optimal Transportcited by 123
  20. 2020Learning Energy-Based Models by Diffusion Recovery Likelihoodcited by 122
  21. 2017Stabilizing Training of Generative Adversarial Networks through Regularizationcited by 118
  22. 2020VAEBM: A Symbiosis between Variational Autoencoders and Energy-based Modelscited by 103
  23. 2019AutoGAN: Neural Architecture Search for Generative Adversarial Networkscited by 94
  24. 2020Robust Optimal Transport with Applications in Generative Modeling and Domain Adaptationcited by 86
  25. 2021Generative Modeling with Optimal Transport Mapscited by 80
  26. 2022Subspace Diffusion Generative Modelscited by 70
  27. 2017Gradient descent GAN optimization is locally stablecited by 65
  28. 2017On the regularization of Wasserstein GANscited by 65
  29. 2020A Contrastive Learning Approach for Training Variational Autoencoder Priorscited by 65
  30. 2020Dual Contradistinctive Generative Autoencodercited by 58
  31. 2018On the Convergence and Robustness of Training GANs with Regularized Optimal Transportcited by 51
  32. 2020Refining Deep Generative Models via Discriminator Gradient Flowcited by 45
  33. 2018Scalable Unbalanced Optimal Transport using Generative Adversarial Networkscited by 41
  34. 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
  35. 2023Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal Transportcited by 39
  36. 2019On Scalable and Efficient Computation of Large Scale Optimal Transportcited by 29
  37. 2018Disconnected Manifold Learning for Generative Adversarial Networkscited by 27
  38. 2018Is Generator Conditioning Causally Related to GAN Performance?cited by 18

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 2; 2026: 2.

8 papers.

  1. 2024Robust Barycenter Estimation using Semi-Unbalanced Neural Optimal Transportcited by 9
  2. 2024Improving Neural Optimal Transport via Displacement Interpolationcited by 7
  3. 2025Overcoming Spurious Solutions in Semi-Dual Neural Optimal Transport: A Smoothing Approach for Learning the Optimal Transport Plancited by 6
  4. 2024Scalable Simulation-free Entropic Unbalanced Optimal Transportcited by 5
  5. 2025A Statistical Learning Perspective on Semi-dual Adversarial Neural Optimal Transport Solverscited by 2
  6. 2024Unsupervised Point Cloud Completion through Unbalanced Optimal Transportcited by 1
  7. 2026Conditional Unbalanced Optimal Transport Maps: An Outlier-Robust Framework for Conditional Generative Modelingcited by 0
  8. 2026UOTIP: Unbalanced Optimal Transport Map for Unpaired Inverse Problemscited by 0