Discriminating Against Unrealistic Interpolations in Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Interpolations in the latent space of deep generative models is one of the standard tools to synthesize semantically meaningful mixtures of generated samples. As the generator function is non-linear, commonly used linear interpolations in the latent space do not yield the shortest paths in the sample space, resulting in non-smooth interpolations. Recent work has therefore equipped the latent space with a suitable metric to enforce shortest paths on the manifold of generated samples. These are often, however, susceptible of veering away from the manifold of real samples, resulting in smooth but unrealistic generation that requires an additional method to assess the sample quality along paths. Generative Adversarial Networks (GANs), by construction, measure the sample quality using its discriminator network. In this paper, we establish that the discriminator can be used effectively to avoid regions of low sample quality along shortest paths. By reusing the discriminator network to modify the metric on the latent space, we propose a lightweight solution for improved interpolations in pre-trained GANs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 2 Mar 2022.
Builds on
24 of 35 references.
References · 24
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
12 more
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2017Latent Space Oddity: on the Curvature of Deep Generative Modelscited by 169
- 2018Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizercited by 87
- 2017The Riemannian Geometry of Deep Generative Modelscited by 81
- 2017On the regularization of Wasserstein GANscited by 65
- 2017Metrics for Deep Generative Modelscited by 53
- 2020Geometrically Enriched Latent Spacescited by 45
- 2020Learning Flat Latent Manifolds with VAEscited by 33
- 2018Geodesic Clustering in Deep Generative Modelscited by 14
- 2018Fast Approximate Geodesics for Deep Generative Modelscited by 13
- 2018Latent Space Non-Linear Statisticscited by 12
- 2021Atlas Generative Models and Geodesic Interpolationcited by 4
Built on by
Not cited yet.