Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation
Not on the map. Why?
Abstract (arXiv)
Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial Net (GAN) to learn a latent space and suitable latent-space transformations. However, current approaches often suffer from attribute edits that are entangled, global image identity changes, and diminished photo-realism. To address these concerns, we learn multiple attribute transformations simultaneously, integrate attribute regression into the training of transformation functions, and apply a content loss and an adversarial loss that encourages the maintenance of image identity and photo-realism. We propose quantitative evaluation strategies for measuring controllable editing performance, unlike prior work, which primarily focuses on qualitative evaluation. Our model permits better control for both single- and multiple-attribute editing while preserving image identity and realism during transformation. We provide empirical results for both natural and synthetic images, highlighting that our model achieves state-of-the-art performance for targeted image manipulation.
Key facts. Cited by 53 papers in the map (data through 13 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 1 Feb 2021.
Builds on
33 of 39 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 51,950
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,476
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,000
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,585
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,975
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,619
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,296
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,178
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
21 more
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 913
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 846
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 692
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2017Universal Style Transfer via Feature Transformscited by 353
- 2017Toward Multimodal Image-to-Image Translationcited by 295
- 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 288
- 2019On the "steerability" of generative adversarial networkscited by 247
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2018The relativistic discriminator: a key element missing from standard GANcited by 237
- 2019Controllable Text-to-Image Generationcited by 187
- 2017Deep Photo Style Transfercited by 168
- 2020Controlling generative models with continuous factors of variationscited by 93
- 2020StyleGAN2 Distillation for Feed-forward Image Manipulationcited by 78
- 2020CONFIG: Controllable Neural Face Image Generationcited by 61
- 2019RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributescited by 56
- 2019Detecting Photoshopped Faces by Scripting Photoshopcited by 55
- 2020Inducing Optimal Attribute Representations for Conditional GANscited by 6
Built on by
Citing papers per year: 2021: 8; 2022: 22; 2023: 10; 2024: 5; 2025: 6; 2026: 2.
53 papers.
Sort:
By area:
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2022StyleLight: HDR Panorama Generation for Lighting Estimation and Editingcited by 59
- 2023StyleGAN knows Normal, Depth, Albedo, and Morecited by 44
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 39
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 37
- 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Fieldcited by 37
- 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
- 2022StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesiscited by 33
- 2022FlexIT: Towards Flexible Semantic Image Translationcited by 28
- 2022Finding Directions in GAN's Latent Space for Neural Face Reenactmentcited by 27
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generationcited by 19
38 more
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulationcited by 18
- 2022Style Your Hair: Latent Optimization for Pose-Invariant Hairstyle Transfer via Local-Style-Aware Hair Alignmentcited by 16
- 2022GAN-based Facial Attribute Manipulationcited by 16
- 2023VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANscited by 16
- 2022UnGANable: Defending Against GAN-based Face Manipulationcited by 15
- 2023AdaptNet: Policy Adaptation for Physics-Based Character Controlcited by 15
- 2021A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines -- From Medical to Remote Sensingcited by 13
- 2021Latent Transformations via NeuralODEs for GAN-based Image Editingcited by 11
- 2023Adaptive Nonlinear Latent Transformation for Conditional Face Editingcited by 9
- 2022Controllable Radiance Fields for Dynamic Face Synthesiscited by 8
- 2022End-to-End Visual Editing with a Generatively Pre-Trained Artistcited by 7
- 2022Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editabilitycited by 7
- 2022DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Datacited by 7
- 2023HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworkscited by 7
- 2024ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Databasecited by 6
- 2025Point Prompting: Counterfactual Tracking with Video Diffusion Modelscited by 5
- 2021Multi-Attribute Balanced Sampling for Disentangled GAN Controlscited by 4
- 2022Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulationcited by 4
- 2023Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Modelscited by 4
- 2023Robust Sequential DeepFake Detectioncited by 4
- 2025Aligning Compound AI Systems via System-level DPOcited by 4
- 2021Diamond in the rough: Improving image realism by traversing the GAN latent spacecited by 3
- 2022Deep Curvilinear Editing: Commutative and Nonlinear Image Manipulation for Pretrained Deep Generative Modelcited by 3
- 2024Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editingcited by 3
- 2025Towards Consistent and Controllable Image Synthesis for Face Editingcited by 3
- 2025Manipulating 3D Molecules in a Fixed-Dimensional E(3)-Equivariant Latent Spacecited by 3
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Modelscited by 3
- 2022Contrastive Monotonic Pixel-Level Modulationcited by 2
- 2024Manipulating Vehicle 3D Shapes through Latent Space Editingcited by 2
- 2021Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generationcited by 1
- 2022A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restorationcited by 1
- 2022S2-Flow: Joint Semantic and Style Editing of Facial Imagescited by 1
- 20233D GANs and Latent Space: A comprehensive surveycited by 1
- 2021DGL-GAN: Discriminator Guided Learning for GAN Compressioncited by 0
- 2022Discovering Multiple and Diverse Directions for Cognitive Image Propertiescited by 0
- 2022Controllable Face Manipulation and UV Map Generation by Self-supervised Learningcited by 0
- 2022CGOF++: Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 0
- 2024Leveraging LLMs for On-the-Fly Instruction Guided Image Editingcited by 0
50 most cited of 53 All 53 (JSON)
- 2026MD-Face: MoE-Enhanced Label-Free Disentangled Representation for Interactive Facial Attribute Editing22 Apr 2026
- 2026U-Face: An Efficient and Generalizable Framework for Unsupervised Facial Attribute Editing via Subspace Learning14 Mar 2026
- 2025Point Prompting: Counterfactual Tracking with Video Diffusion Models13 Oct 2025
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models7 Oct 2025
- 2025Manipulating 3D Molecules in a Fixed-Dimensional E(3)-Equivariant Latent Space1 Jun 2025
- 2025My Emotion on your face: The use of Facial Keypoint Detection to preserve Emotions in Latent Space Editing9 May 2025
- 2025Aligning Compound AI Systems via System-level DPO24 Feb 2025
- 2025Towards Consistent and Controllable Image Synthesis for Face Editing4 Feb 2025
- 2024Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editing24 Nov 2024
- 2024Manipulating Vehicle 3D Shapes through Latent Space Editing31 Oct 2024
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing24 Oct 2024
- 2024ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Database4 Oct 2024
38 more
- 2024Leveraging LLMs for On-the-Fly Instruction Guided Image Editing12 Mar 2024
- 2023AdaptNet: Policy Adaptation for Physics-Based Character Control30 Sep 2023
- 2023Robust Sequential DeepFake Detection26 Sep 2023
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation31 Aug 2023
- 2023Adaptive Nonlinear Latent Transformation for Conditional Face Editing15 Jul 2023
- 2023StyleGAN knows Normal, Depth, Albedo, and More1 Jun 2023
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation24 Apr 2023
- 2023HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworks19 Apr 2023
- 20233D GANs and Latent Space: A comprehensive survey8 Apr 2023
- 2023VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANs28 Mar 2023
- 2023Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Models15 Mar 2023
- 2022DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Data27 Nov 2022
- 2022Deep Curvilinear Editing: Commutative and Nonlinear Image Manipulation for Pretrained Deep Generative Model26 Nov 2022
- 2022CGOF++: Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields23 Nov 2022
- 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field23 Nov 2022
- 2022S2-Flow: Joint Semantic and Style Editing of Facial Images22 Nov 2022
- 2022GAN-based Facial Attribute Manipulation23 Oct 2022
- 2022Controllable Radiance Fields for Dynamic Face Synthesis11 Oct 2022
- 2022UnGANable: Defending Against GAN-based Face Manipulation3 Oct 2022
- 2022Controllable Face Manipulation and UV Map Generation by Self-supervised Learning24 Sep 2022
- 2022Style Your Hair: Latent Optimization for Pose-Invariant Hairstyle Transfer via Local-Style-Aware Hair Alignment16 Aug 2022
- 2022StyleLight: HDR Panorama Generation for Lighting Estimation and Editing29 Jul 2022
- 2022Contrastive Monotonic Pixel-Level Modulation23 Jul 2022
- 2022A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restoration21 Jul 2022
- 2022Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editability19 Jul 2022
- 2022Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation19 Jul 2022
- 2022Detecting and Recovering Sequential DeepFake Manipulation5 Jul 2022
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields16 Jun 2022
- 2022End-to-End Visual Editing with a Generatively Pre-Trained Artist3 May 2022
- 2022StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis29 Mar 2022
- 2022FlexIT: Towards Flexible Semantic Image Translation9 Mar 2022
- 2022Discovering Multiple and Diverse Directions for Cognitive Image Properties23 Feb 2022
- 2022Finding Directions in GAN's Latent Space for Neural Face Reenactment31 Jan 2022
- 2021DGL-GAN: Discriminator Guided Learning for GAN Compression13 Dec 2021
- 2021Latent Transformations via NeuralODEs for GAN-based Image Editing29 Nov 2021
- 2021Multi-Attribute Balanced Sampling for Disentangled GAN Controls28 Oct 2021
- 2021Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation13 Oct 2021
- 2021A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines -- From Medical to Remote Sensing1 Oct 2021
50 newest of 53 All 53 (JSON)
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 39
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulationcited by 18
- 2025Point Prompting: Counterfactual Tracking with Video Diffusion Modelscited by 5
- 2023Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Modelscited by 4
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Modelscited by 3
- 2025Point Prompting: Counterfactual Tracking with Video Diffusion Models13 Oct 2025
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models7 Oct 2025
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing24 Oct 2024
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation24 Apr 2023
- 2023Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Models15 Mar 2023
- 2025Aligning Compound AI Systems via System-level DPOcited by 4
- 2025Aligning Compound AI Systems via System-level DPO24 Feb 2025
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2022StyleLight: HDR Panorama Generation for Lighting Estimation and Editingcited by 59
- 2023StyleGAN knows Normal, Depth, Albedo, and Morecited by 44
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 37
- 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Fieldcited by 37
- 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
- 2022StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesiscited by 33
- 2022FlexIT: Towards Flexible Semantic Image Translationcited by 28
- 2022Finding Directions in GAN's Latent Space for Neural Face Reenactmentcited by 27
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generationcited by 19
- 2022Style Your Hair: Latent Optimization for Pose-Invariant Hairstyle Transfer via Local-Style-Aware Hair Alignmentcited by 16
12 most cited of 46 All 46 (JSON)
- 2026U-Face: An Efficient and Generalizable Framework for Unsupervised Facial Attribute Editing via Subspace Learning14 Mar 2026
- 2025Manipulating 3D Molecules in a Fixed-Dimensional E(3)-Equivariant Latent Space1 Jun 2025
- 2025My Emotion on your face: The use of Facial Keypoint Detection to preserve Emotions in Latent Space Editing9 May 2025
- 2025Towards Consistent and Controllable Image Synthesis for Face Editing4 Feb 2025
- 2024Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editing24 Nov 2024
- 2024Manipulating Vehicle 3D Shapes through Latent Space Editing31 Oct 2024
- 2024ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Database4 Oct 2024
- 2024Leveraging LLMs for On-the-Fly Instruction Guided Image Editing12 Mar 2024
- 2023AdaptNet: Policy Adaptation for Physics-Based Character Control30 Sep 2023
- 2023Robust Sequential DeepFake Detection26 Sep 2023
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation31 Aug 2023
- 2023Adaptive Nonlinear Latent Transformation for Conditional Face Editing15 Jul 2023
12 newest of 46 All 46 (JSON)