FEAT: Face Editing with Attention
Not on the map. Why?
Abstract (arXiv)
Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the generator. However, face manipulation often intends to affect local regions only, while common generators do not tend to have the necessary spatial disentanglement. In this paper, we build on the StyleGAN generator, and present a method that explicitly encourages face manipulation to focus on the intended regions by incorporating learned attention maps. During the generation of the edited image, the attention map serves as a mask that guides a blending between the original features and the modified ones. The guidance for the latent space edits is achieved by employing CLIP, which has recently been shown to be effective for text-driven edits. We perform extensive experiments and show that our method can perform disentangled and controllable face manipulations based on text descriptions by attending to the relevant regions only. Both qualitative and quantitative experimental results demonstrate the superiority of our method for facial region editing over alternative methods.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 42 of its 50 references that are in the map. First posted on arXiv 6 Feb 2022.
Builds on
42 of 50 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
30 more
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2021GAN Inversion: A Surveycited by 366
- 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
- 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
- 2015Stacked Attention Networks for Image Question Answeringcited by 273
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
- 2019MirrorGAN: Learning Text-to-image Generation by Redescriptioncited by 176
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2019Object-driven Text-to-Image Synthesis via Adversarial Trainingcited by 117
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2020Generative Hierarchical Features from Synthesizing Imagescited by 83
- 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
- 2019Semantics Disentangling for Text-to-Image Generationcited by 61
- 2020GuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editingcited by 37
- 2018Attention-GAN for Object Transfiguration in Wild Imagescited by 32
- 2021StyleFusion: A Generative Model for Disentangling Spatial Segmentscited by 28
- 2018Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attentioncited by 10
- 2021StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulationcited by 9
- 2019Mask Based Unsupervised Content Transfercited by 8
Built on by
Citing papers per year: 2022: 3; 2023: 8; 2024: 4; 2025: 1.
16 papers.
Sort:
By area:
- 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 61
- 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
- 2022CLIP-PAE: Projection-Augmentation Embedding to Extract Relevant Features for a Disentangled, Interpretable, and Controllable Text-Guided Face Manipulationcited by 19
- 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpointcited by 18
- 2023ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulationcited by 16
- 2023Text-guided Eyeglasses Manipulation with Spatial Constraintscited by 10
- 2025Hadamard product in deep learning: Introduction, Advances and Challengescited by 9
- 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editingcited by 6
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editingcited by 6
- 2023CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editingcited by 5
- 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
- 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semanticscited by 4
4 more
- 2023DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editingcited by 3
- 2024CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMscited by 3
- 2023Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIPcited by 1
- 2024UP-FacE: User-predictable Fine-grained Face Shape Editingcited by 0
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
- 2024A Survey of Multimodal Composite Editing and Retrieval9 Sep 2024
- 2024CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMs5 Jun 2024
- 2024UP-FacE: User-predictable Fine-grained Face Shape Editing20 Mar 2024
- 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation15 Dec 2023
- 2023DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editing12 Oct 2023
- 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semantics20 Sep 2023
- 2023ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulation24 May 2023
- 2023Text-guided Eyeglasses Manipulation with Spatial Constraints25 Apr 2023
- 2023Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIP3 Apr 2023
- 2023CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editing9 Mar 2023
4 more
- 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editing31 Jan 2023
- 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpoint21 Nov 2022
- 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulations14 Oct 2022
- 2022CLIP-PAE: Projection-Augmentation Embedding to Extract Relevant Features for a Disentangled, Interpretable, and Controllable Text-Guided Face Manipulation8 Oct 2022
- 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 61
- 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
- 2022CLIP-PAE: Projection-Augmentation Embedding to Extract Relevant Features for a Disentangled, Interpretable, and Controllable Text-Guided Face Manipulationcited by 19
- 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpointcited by 18
- 2023Text-guided Eyeglasses Manipulation with Spatial Constraintscited by 10
- 2025Hadamard product in deep learning: Introduction, Advances and Challengescited by 9
- 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editingcited by 6
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editingcited by 6
- 2023CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editingcited by 5
- 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
- 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semanticscited by 4
- 2023DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editingcited by 3
12 most cited of 15 All 15 (JSON)
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
- 2024A Survey of Multimodal Composite Editing and Retrieval9 Sep 2024
- 2024CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMs5 Jun 2024
- 2024UP-FacE: User-predictable Fine-grained Face Shape Editing20 Mar 2024
- 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation15 Dec 2023
- 2023DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editing12 Oct 2023
- 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semantics20 Sep 2023
- 2023Text-guided Eyeglasses Manipulation with Spatial Constraints25 Apr 2023
- 2023Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIP3 Apr 2023
- 2023CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editing9 Mar 2023
- 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editing31 Jan 2023
12 newest of 15 All 15 (JSON)