Editing in Style: Uncovering the Local Semantics of GANs
Not on the map. Why?
Abstract (arXiv)
While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local, semantically-aware edits to a target output image. This is accomplished by borrowing elements from a source image, also a GAN output, via a novel manipulation of style vectors. Our method requires neither supervision from an external model, nor involves complex spatial morphing operations. Instead, it relies on the emergent disentanglement of semantic objects that is learned by StyleGAN during its training. Semantic editing is demonstrated on GANs producing human faces, indoor scenes, cats, and cars. We measure the locality and photorealism of the edits produced by our method, and find that it accomplishes both.
Key facts. Cited by 183 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 58; 2022: 63; 2023: 42; 2024: 16; 2025: 4.
183 papers.
Sort:
By area:
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2021GAN Inversion: A Surveycited by 366
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
38 more
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Modelscited by 142
- 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
- 2021HairCLIP: Design Your Hair by Text and Reference Imagecited by 79
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversioncited by 79
- 2021CLIP2StyleGAN: Unsupervised Extraction of StyleGAN Edit Directionscited by 78
- 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
- 2021A Latent Transformer for Disentangled Face Editing in Images and Videoscited by 67
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
- 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
- 2022Disentangling visual and written concepts in CLIPcited by 57
- 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
- 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fieldscited by 55
- 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
- 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
- 2021Ensembling with Deep Generative Viewscited by 53
- 20223D GAN Inversion for Controllable Portrait Image Animationcited by 53
- 2021Low-Rank Subspaces in GANscited by 52
- 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Modelscited by 42
- 2021Image-Based CLIP-Guided Essence Transfercited by 39
- 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
- 2022Style Transformer for Image Inversion and Editingcited by 37
- 2022TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editingcited by 36
- 2021Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translationcited by 35
- 2022BlobGAN: Spatially Disentangled Scene Representationscited by 35
- 2023Make Encoder Great Again in 3D GAN Inversion through Geometry and Occlusion-Aware Encodingcited by 35
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketchescited by 34
- 2021TryOnGAN: Body-Aware Try-On via Layered Interpolationcited by 31
- 2023General Image-to-Image Translation with One-Shot Image Guidancecited by 31
- 2022Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fieldscited by 29
50 most cited of 183 All 183 (JSON)
- 2025A Turn Toward Better Alignment: Few-Shot Generative Adaptation with Equivariant Feature Rotation24 Dec 2025
- 2025Learning Common and Salient Generative Factors Between Two Image Datasets14 Dec 2025
- 2025LoRAverse: A Submodular Framework to Retrieve Diverse Adapters for Diffusion Models16 Oct 2025
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space13 May 2025
- 2024Unsupervised Segmentation by Diffusing, Walking and Cutting6 Dec 2024
- 2024Controllable retinal image synthesis using conditional StyleGAN and latent space manipulation for improved diagnosis and grading of diabetic retinopathy11 Sep 2024
- 2024PS-StyleGAN: Illustrative Portrait Sketching using Attention-Based Style Adaptation31 Aug 2024
- 2024Prediction Exposes Your Face: Black-box Model Inversion via Prediction Alignment11 Jul 2024
- 2024Latent Space Imaging9 Jul 2024
- 2024SwinStyleformer is a favorable choice for image inversion19 Jun 2024
- 2024Efficient 3D-Aware Facial Image Editing via Attribute-Specific Prompt Learning6 Jun 2024
- 2024ComFace: Facial Representation Learning with Synthetic Data for Comparing Faces25 May 2024
38 more
- 2024Customize Your Own Paired Data via Few-shot Way21 May 2024
- 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AI22 Apr 2024
- 2024Multi-view X-ray Image Synthesis with Multiple Domain Disentanglement from CT Scans18 Apr 2024
- 2024UP-FacE: User-predictable Fine-grained Face Shape Editing20 Mar 2024
- 2024Semantic Image Synthesis with Unconditional Generator22 Feb 2024
- 2024CTGAN: Semantic-guided Conditional Texture Generator for 3D Shapes8 Feb 2024
- 2024Unsupervised Discovery of Steerable Factors When Graph Deep Generative Models Are Entangled29 Jan 2024
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models22 Jan 2024
- 2023Spatial-Contextual Discrepancy Information Compensation for GAN Inversion12 Dec 2023
- 2023Editable Stain Transformation Of Histological Images Using Unpaired GANs6 Dec 2023
- 2023Disentangle Before Anonymize: A Two-stage Framework for Attribute-preserved and Occlusion-robust De-identification15 Nov 2023
- 2023Improving the Effectiveness of Deep Generative Data7 Nov 2023
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversion23 Oct 2023
- 2023HairCLIPv2: Unifying Hair Editing via Proxy Feature Blending16 Oct 2023
- 2023Face Cartoonisation For Various Poses Using StyleGAN26 Sep 2023
- 2023TextCLIP: Text-Guided Face Image Generation And Manipulation Without Adversarial Training21 Sep 2023
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep 2023
- 2023General Image-to-Image Translation with One-Shot Image Guidance20 Jul 2023
- 2023CLIP-Guided StyleGAN Inversion for Text-Driven Real Image Editing17 Jul 2023
- 2023Householder Projector for Unsupervised Latent Semantics Discovery16 Jul 2023
- 2023Adaptive Nonlinear Latent Transformation for Conditional Face Editing15 Jul 2023
- 2023Intra- & Extra-Source Exemplar-Based Style Synthesis for Improved Domain Generalization2 Jul 2023
- 2023GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation7 Jun 2023
- 2023SF-FSDA: Source-Free Few-Shot Domain Adaptive Object Detection with Efficient Labeled Data Factory7 Jun 2023
- 2023SR-OOD: Out-of-Distribution Detection via Sample Repairing26 May 2023
- 2023ReDirTrans: Latent-to-Latent Translation for Gaze and Head Redirection19 May 2023
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold18 May 2023
- 2023Meta-Auxiliary Network for 3D GAN Inversion18 May 2023
- 2023WeditGAN: Few-Shot Image Generation via Latent Space Relocation11 May 2023
- 2023StyleGenes: Discrete and Efficient Latent Distributions for GANs30 Apr 2023
- 2023Make It So: Steering StyleGAN for Any Image Inversion and Editing27 Apr 2023
- 2023PREIM3D: 3D Consistent Precise Image Attribute Editing from a Single Image20 Apr 2023
- 2023Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIP3 Apr 2023
- 20234D Facial Expression Diffusion Model29 Mar 2023
- 2023Zero-shot Model Diagnosis27 Mar 2023
- 2023Make Encoder Great Again in 3D GAN Inversion through Geometry and Occlusion-Aware Encoding22 Mar 2023
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar 2023
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketches20 Mar 2023
50 newest of 183 All 183 (JSON)
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Modelscited by 142
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversioncited by 79
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Modelscited by 42
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic spacecited by 17
- 20234D Facial Expression Diffusion Modelcited by 15
- 2022Image Embedding for Denoising Generative Modelscited by 7
- 2023Improving the Effectiveness of Deep Generative Datacited by 4
- 2024Unsupervised Segmentation by Diffusing, Walking and Cuttingcited by 3
- 2025LoRAverse: A Submodular Framework to Retrieve Diverse Adapters for Diffusion Modelscited by 3
- 2023Divide and Compose with Score Based Generative Modelscited by 0
- 2025LoRAverse: A Submodular Framework to Retrieve Diverse Adapters for Diffusion Models16 Oct 2025
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space13 May 2025
- 2024Unsupervised Segmentation by Diffusing, Walking and Cutting6 Dec 2024
- 2024EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models22 Jan 2024
- 2023Improving the Effectiveness of Deep Generative Data7 Nov 2023
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversion10 Sep 2023
- 20234D Facial Expression Diffusion Model29 Mar 2023
- 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Models20 Mar 2023
- 2023Divide and Compose with Score Based Generative Models5 Feb 2023
- 2022Image Embedding for Denoising Generative Models30 Dec 2022
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct 2022
- 2022Pretraining is All You Need for Image-to-Image Translation25 May 2022
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2021GAN Inversion: A Surveycited by 366
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
12 most cited of 171 All 171 (JSON)
- 2025A Turn Toward Better Alignment: Few-Shot Generative Adaptation with Equivariant Feature Rotation24 Dec 2025
- 2025Learning Common and Salient Generative Factors Between Two Image Datasets14 Dec 2025
- 2024Controllable retinal image synthesis using conditional StyleGAN and latent space manipulation for improved diagnosis and grading of diabetic retinopathy11 Sep 2024
- 2024PS-StyleGAN: Illustrative Portrait Sketching using Attention-Based Style Adaptation31 Aug 2024
- 2024Prediction Exposes Your Face: Black-box Model Inversion via Prediction Alignment11 Jul 2024
- 2024Latent Space Imaging9 Jul 2024
- 2024SwinStyleformer is a favorable choice for image inversion19 Jun 2024
- 2024Efficient 3D-Aware Facial Image Editing via Attribute-Specific Prompt Learning6 Jun 2024
- 2024ComFace: Facial Representation Learning with Synthetic Data for Comparing Faces25 May 2024
- 2024Customize Your Own Paired Data via Few-shot Way21 May 2024
- 2024U Can't Gen This? A Survey of Intellectual Property Protection Methods for Data in Generative AI22 Apr 2024
- 2024Multi-view X-ray Image Synthesis with Multiple Domain Disentanglement from CT Scans18 Apr 2024
12 newest of 171 All 171 (JSON)