Are conditional GANs explicitly conditional?
Not on the map. Why?
Abstract (arXiv)
This paper proposes two important contributions for conditional Generative Adversarial Networks (cGANs) to improve the wide variety of applications that exploit this architecture. The first main contribution is an analysis of cGANs to show that they are not explicitly conditional. In particular, it will be shown that the discriminator and subsequently the cGAN does not automatically learn the conditionality between inputs. The second contribution is a new method, called a contrario cGAN, that explicitly models conditionality for both parts of the adversarial architecture via a novel a contrario loss that involves training the discriminator to learn unconditional (adverse) examples. This leads to a novel type of data augmentation approach for GANs (a contrario learning) which allows to restrict the search space of the generator to conditional outputs using adverse examples. Extensive experimentation is carried out to evaluate the conditionality of the discriminator by proposing a probability distribution analysis. Comparisons with the cGAN architecture for different applications show significant improvements in performance on well known datasets including, semantic image synthesis, image segmentation, monocular depth prediction and "single label"-to-image using different metrics including Fr'echet Inception Distance (FID), mean Intersection over Union (mIoU), Root Mean Square Error log (RMSE log) and Number of statistically-Different Bins (NDB).
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 52 of its 76 references that are in the map. First posted on arXiv 28 Jun 2021.
Builds on
52 of 76 references.
References · 52
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016Improved Techniques for Training GANscited by 2,970
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
38 more
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 596
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 565
- 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 464
- 2018Video-to-Video Synthesiscited by 390
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
- 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 363
- 2016A Learned Representation For Artistic Stylecited by 341
- 2018Everybody Dance Nowcited by 315
- 2018cGANs with Projection Discriminatorcited by 254
- 2017Geometric GANcited by 233
- 2017StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 229
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2017VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learningcited by 200
- 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
- 2017Modulating early visual processing by languagecited by 167
- 2017Generalization and Equilibrium in Generative Adversarial Nets (GANs)cited by 166
- 2019Consistency Regularization for Generative Adversarial Networkscited by 136
- 2020You Only Need Adversarial Supervision for Semantic Image Synthesiscited by 129
- 2019Object-driven Text-to-Image Synthesis via Adversarial Trainingcited by 117
- 2019Adversarial AutoAugmentcited by 111
- 2019Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesiscited by 108
- 2017Good Semi-supervised Learning that Requires a Bad GANcited by 86
- 2020Image Augmentations for GAN Trainingcited by 78
- 2019Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generationcited by 75
- 2020Improved Consistency Regularization for GANscited by 69
- 2018On GANs and GMMscited by 62
- 2021Negative Data Augmentationcited by 46
- 2020SESAME: Semantic Editing of Scenes by Adding, Manipulating or Erasing Objectscited by 43
- 2020Towards GAN Benchmarks Which Require Generalizationcited by 31
- 2017Coulomb GANs: Provably Optimal Nash Equilibria via Potential Fieldscited by 20
- 2020GANs May Have No Nash Equilibriacited by 20
- 2020Searching towards Class-Aware Generators for Conditional Generative Adversarial Networkscited by 6
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1.
2 papers.