mlsanityData to 7 Oct 2026

Monotone Generative Modeling via a Gromov-Monge Embedding

arXiv 2311.01375 ↗First posted 2 Nov 2023cs.LG cs.NA math.NAcited by 3

Not on the map. Why?

Abstract (arXiv)

Generative adversarial networks (GANs) are popular for generative tasks; however, they often require careful architecture selection, extensive empirical tuning, and are prone to mode collapse. To overcome these challenges, we propose a novel model that identifies the low-dimensional structure of the underlying data distribution, maps it into a low-dimensional latent space while preserving the underlying geometry, and then optimally transports a reference measure to the embedded distribution. We prove three key properties of our method: 1) The encoder preserves the geometry of the underlying data; 2) The generator is c-cyclically monotone, where c is an intrinsic embedding cost employed by the encoder; and 3) The discriminator's modulus of continuity improves with the geometric preservation of the data. Numerical experiments demonstrate the effectiveness of our approach in generating high-quality images and exhibiting robustness to both mode collapse and training instability.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 39 of its 67 references that are in the map. First posted on arXiv 2 Nov 2023.

Builds on

39 of 67 references.

References · 39

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  3. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  4. 2017Improved Training of Wasserstein GANscited by 2,223
  5. 2015Variational Inference with Normalizing Flowscited by 2,161
  6. 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 460
  7. 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
  8. 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 307
  9. 2016NIPS 2016 Tutorial: Generative Adversarial Networkscited by 284
  10. 2017Are GANs Created Equal? A Large-Scale Studycited by 267
  11. 2016Unrolled Generative Adversarial Networkscited by 208
  12. 2018Statistical Aspects of Wasserstein Distancescited by 202
27 more
  1. 2019Optimal transport mapping via input convex neural networkscited by 202
  2. 2017VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learningcited by 199
  3. 2017Generalization and Equilibrium in Generative Adversarial Nets (GANs)cited by 165
  4. 2017Optimizing the Latent Space of Generative Networkscited by 157
  5. 2019Gromov-Wasserstein Learning for Graph Matching and Node Embeddingcited by 125
  6. 2018Gromov-Wasserstein Alignment of Word Embedding Spacescited by 119
  7. 2019Scalable Gromov-Wasserstein Learning for Graph Partitioning and Matchingcited by 102
  8. 2019Wasserstein-2 Generative Networkscited by 96
  9. 2021Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein-2 Benchmarkcited by 95
  10. 2021Generative Modeling with Optimal Transport Mapscited by 80
  11. 2020Faster Wasserstein Distance Estimation with the Sinkhorn Divergencecited by 73
  12. 2019Sliced Gromov-Wassersteincited by 66
  13. 2017On the regularization of Wasserstein GANscited by 65
  14. 2019Learning Generative Models across Incomparable Spacescited by 53
  15. 2017CVAE-GAN: Fine-Grained Image Generation through Asymmetric Trainingcited by 42
  16. 20192-Wasserstein Approximation via Restricted Convex Potentials with Application to Improved Training for GANscited by 32
  17. 2017A Geometric View of Optimal Transportation and Generative Modelcited by 31
  18. 2017Wasserstein Divergence for GANscited by 22
  19. 2020Isometric Autoencoderscited by 18
  20. 2022Structure-preserving GANscited by 17
  21. 2022On the existence of Monge maps for the Gromov-Wasserstein problemcited by 16
  22. 2017On the Effects of Batch and Weight Normalization in Generative Adversarial Networkscited by 13
  23. 2022Gromov-Wasserstein Autoencoderscited by 7
  24. 2017Relaxed Wasserstein with Applications to GANscited by 5
  25. 2018Primal-Dual Wasserstein GANcited by 4
  26. 2021Functional Space Analysis of Local GAN Convergencecited by 4
  27. 2023Stabilizing GANs' Training with Brownian Motion Controllercited by 3

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.