Monotone Generative Modeling via a Gromov-Monge Embedding
Not on the map. Why?
Abstract (arXiv)
Generative adversarial networks (GANs) are popular for generative tasks; however, they often require careful architecture selection, extensive empirical tuning, and are prone to mode collapse. To overcome these challenges, we propose a novel model that identifies the low-dimensional structure of the underlying data distribution, maps it into a low-dimensional latent space while preserving the underlying geometry, and then optimally transports a reference measure to the embedded distribution. We prove three key properties of our method: 1) The encoder preserves the geometry of the underlying data; 2) The generator is c-cyclically monotone, where c is an intrinsic embedding cost employed by the encoder; and 3) The discriminator's modulus of continuity improves with the geometric preservation of the data. Numerical experiments demonstrate the effectiveness of our approach in generating high-quality images and exhibiting robustness to both mode collapse and training instability.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 39 of its 67 references that are in the map. First posted on arXiv 2 Nov 2023.
Builds on
39 of 67 references.
References · 39
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 460
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2021The Intrinsic Dimension of Images and Its Impact on Learningcited by 307
- 2016NIPS 2016 Tutorial: Generative Adversarial Networkscited by 284
- 2017Are GANs Created Equal? A Large-Scale Studycited by 267
- 2016Unrolled Generative Adversarial Networkscited by 208
- 2018Statistical Aspects of Wasserstein Distancescited by 202
27 more
- 2019Optimal transport mapping via input convex neural networkscited by 202
- 2017VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learningcited by 199
- 2017Generalization and Equilibrium in Generative Adversarial Nets (GANs)cited by 165
- 2017Optimizing the Latent Space of Generative Networkscited by 157
- 2019Gromov-Wasserstein Learning for Graph Matching and Node Embeddingcited by 125
- 2018Gromov-Wasserstein Alignment of Word Embedding Spacescited by 119
- 2019Scalable Gromov-Wasserstein Learning for Graph Partitioning and Matchingcited by 102
- 2019Wasserstein-2 Generative Networkscited by 96
- 2021Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein-2 Benchmarkcited by 95
- 2021Generative Modeling with Optimal Transport Mapscited by 80
- 2020Faster Wasserstein Distance Estimation with the Sinkhorn Divergencecited by 73
- 2019Sliced Gromov-Wassersteincited by 66
- 2017On the regularization of Wasserstein GANscited by 65
- 2019Learning Generative Models across Incomparable Spacescited by 53
- 2017CVAE-GAN: Fine-Grained Image Generation through Asymmetric Trainingcited by 42
- 20192-Wasserstein Approximation via Restricted Convex Potentials with Application to Improved Training for GANscited by 32
- 2017A Geometric View of Optimal Transportation and Generative Modelcited by 31
- 2017Wasserstein Divergence for GANscited by 22
- 2020Isometric Autoencoderscited by 18
- 2022Structure-preserving GANscited by 17
- 2022On the existence of Monge maps for the Gromov-Wasserstein problemcited by 16
- 2017On the Effects of Batch and Weight Normalization in Generative Adversarial Networkscited by 13
- 2022Gromov-Wasserstein Autoencoderscited by 7
- 2017Relaxed Wasserstein with Applications to GANscited by 5
- 2018Primal-Dual Wasserstein GANcited by 4
- 2021Functional Space Analysis of Local GAN Convergencecited by 4
- 2023Stabilizing GANs' Training with Brownian Motion Controllercited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.
- 2025Geometry-Preserving Encoder/Decoder in Latent Generative Models16 Jan 2025
- 2024Geometry-Aware Generative Autoencoders for Warped Riemannian Metric Learning and Generative Modeling on Data Manifolds16 Oct 2024
- 2024Improving Hyperbolic Representations via Gromov-Wasserstein Regularization15 Jul 2024