mlsanityData to 7 Oct 2026

GAN-Control: Explicitly Controllable GANs

arXiv 2101.02477 ↗First posted 7 Jan 2021cs.CVcited by 91

Not on the map. Why?

Abstract (arXiv)

We present a framework for training GANs with explicit control over generated images. We are able to control the generated image by settings exact attributes such as age, pose, expression, etc. Most approaches for editing GAN-generated images achieve partial control by leveraging the latent space disentanglement properties, obtained implicitly after standard GAN training. Such methods are able to change the relative intensity of certain attributes, but not explicitly set their values. Recently proposed methods, designed for explicit control over human faces, harness morphable 3D face models to allow fine-grained control capabilities in GANs. Unlike these methods, our control is not constrained to morphable 3D face model parameters and is extendable beyond the domain of human faces. Using contrastive learning, we obtain GANs with an explicitly disentangled latent space. This disentanglement is utilized to train control-encoders mapping human-interpretable inputs to suitable latent vectors, thus allowing explicit control. In the domain of human faces we demonstrate control over identity, age, pose, expression, hair color and illumination. We also demonstrate control capabilities of our framework in the domains of painted portraits and dog image generation. We demonstrate that our approach achieves state-of-the-art performance both qualitatively and quantitatively.

Key facts. Cited by 91 papers in the map (data through 7 Oct 2026). Builds on 43 of its 62 references that are in the map. First posted on arXiv 7 Jan 2021.

Builds on

43 of 62 references.

References · 43

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  5. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  6. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  8. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  9. 2016Pyramid Scene Parsing Networkcited by 2,472
  10. 2014Conditional Generative Adversarial Netscited by 2,152
  11. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  12. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
31 more
  1. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  2. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  3. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  4. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  5. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  6. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  7. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  8. 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
  9. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  10. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  11. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  12. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  13. 20193D Morphable Face Models -- Past, Present and Futurecited by 269
  14. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
  15. 2018cGANs with Projection Discriminatorcited by 253
  16. 2019On the "steerability" of generative adversarial networkscited by 247
  17. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
  18. 2020Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learningcited by 219
  19. 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
  20. 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
  21. 2019Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesiscited by 106
  22. 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
  23. 2020Towards causal benchmarking of bias in face analysis algorithmscited by 64
  24. 2020CONFIG: Controllable Neural Face Image Generationcited by 61
  25. 2019HoloGAN: Unsupervised learning of 3D representations from natural imagescited by 59
  26. 2020GAN "Steerability" without optimizationcited by 48
  27. 2019Breaking the cycle -- Colleagues are all you needcited by 40
  28. 2020Efficient Facial Feature Learning with Wide Ensemble-based Convolutional Neural Networkscited by 24
  29. 2020High Resolution Face Age Editingcited by 23
  30. 2017Semantically Decomposing the Latent Spaces of Generative Adversarial Networkscited by 19
  31. 2018FaceFeat-GAN: a Two-Stage Approach for Identity-Preserving Face Synthesiscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 14; 2022: 26; 2023: 28; 2024: 11; 2025: 8; 2026: 4.

91 papers.

Sort:

By area:

  1. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  2. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  3. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  4. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  5. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
  6. 2023Human Motion Generation: A Surveycited by 95
  7. 2023IDiff-Face: Synthetic-based Face Recognition through Fizzy Identity-Conditioned Diffusion Modelscited by 72
  8. 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 62
  9. 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
  10. 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
  11. 2021Style and Pose Control for Image Synthesis of Humans from a Single Monocular Viewcited by 53
  12. 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
38 more
  1. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Modelcited by 47
  2. 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
  3. 2023StyleGAN knows Normal, Depth, Albedo, and Morecited by 44
  4. 2023Synthetic Data for Face Recognition: Current State and Future Prospectscited by 38
  5. 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 37
  6. 2023OmniAvatar: Geometry-Guided Controllable 3D Head Synthesiscited by 34
  7. 2021VariTex: Variational Neural Face Texturescited by 30
  8. 2022PrintsGAN: Synthetic Fingerprint Generatorcited by 30
  9. 2022Finding Directions in GAN's Latent Space for Neural Face Reenactmentcited by 27
  10. 2022Generative Visual Prompt: Unifying Distributional Control of Pre-Trained Generative Modelscited by 27
  11. 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
  12. 20223DFaceShop: Explicitly Controllable 3D-Aware Portrait Generationcited by 22
  13. 2023ExFaceGAN: Exploring Identity Directions in GAN's Learned Latent Space for Synthetic Identity Generationcited by 22
  14. 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
  15. 2023ID-Blau: Image Deblurring by Implicit Diffusion-based reBLurring AUgmentationcited by 20
  16. 20223D-Aware Video Generationcited by 17
  17. 20223D-FM GAN: Towards 3D-Controllable Face Manipulationcited by 17
  18. 2022GAN-based Facial Attribute Manipulationcited by 16
  19. 2022A Survey on Deep Generative 3D-aware Image Synthesiscited by 16
  20. 2023LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesiscited by 15
  21. 2021StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGANcited by 14
  22. 2024Second FRCSyn-onGoing: Winning Solutions and Post-Challenge Analysis to Improve Face Recognition with Synthetic Datacited by 13
  23. 2023Painterly Image Harmonization using Diffusion Modelcited by 12
  24. 2024Synthetic Face Datasets Generation via Latent Space Exploration from Brownian Identity Diffusioncited by 12
  25. 2022Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesiscited by 11
  26. 2025Flux Already Knows -- Activating Subject-Driven Image Generation without Trainingcited by 11
  27. 2024Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Surveycited by 9
  28. 2022IA-FaceS: A Bidirectional Method for Semantic Face Editingcited by 8
  29. 2023MyStyle++: A Controllable Personalized Generative Priorcited by 8
  30. 2021DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editingcited by 7
  31. 2021A Multi-attribute Controllable Generative Model for Histopathology Image Synthesiscited by 7
  32. 2023BallGAN: 3D-aware Image Synthesis with a Spherical Backgroundcited by 7
  33. 2023NAISR: A 3D Neural Additive Model for Interpretable Shape Representationcited by 7
  34. 2021Transforming the Latent Space of StyleGAN for Real Face Editingcited by 6
  35. 20233D Generative Model Latent Disentanglement via Local Eigenprojectioncited by 6
  36. 2023FPGAN-Control: A Controllable Fingerprint Generator for Training with Synthetic Datacited by 6
  37. 2024One-shot Neural Face Reenactment via Finding Directions in GAN's Latent Spacecited by 6
  38. 2025CGS-GAN: 3D Consistent Gaussian Splatting GANs for High Resolution Human Head Synthesiscited by 6

50 most cited of 91 All 91 (JSON)