mlsanityData to 7 Oct 2026

FEAT: Face Editing with Attention

arXiv 2202.02713 ↗First posted 6 Feb 2022cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the generator. However, face manipulation often intends to affect local regions only, while common generators do not tend to have the necessary spatial disentanglement. In this paper, we build on the StyleGAN generator, and present a method that explicitly encourages face manipulation to focus on the intended regions by incorporating learned attention maps. During the generation of the edited image, the attention map serves as a mask that guides a blending between the original features and the modified ones. The guidance for the latent space edits is achieved by employing CLIP, which has recently been shown to be effective for text-driven edits. We perform extensive experiments and show that our method can perform disentangled and controllable face manipulations based on text descriptions by attending to the relevant regions only. Both qualitative and quantitative experimental results demonstrate the superiority of our method for facial region editing over alternative methods.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 42 of its 50 references that are in the map. First posted on arXiv 6 Feb 2022.

Builds on

42 of 50 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  6. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  7. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  8. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  9. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  10. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  11. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  12. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
30 more
  1. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  2. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  3. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  4. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  5. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  6. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  7. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  8. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  9. 2021GAN Inversion: A Surveycited by 366
  10. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  11. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  12. 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
  13. 2015Stacked Attention Networks for Image Question Answeringcited by 273
  14. 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
  15. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  16. 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
  17. 2019MirrorGAN: Learning Text-to-image Generation by Redescriptioncited by 176
  18. 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
  19. 2019Object-driven Text-to-Image Synthesis via Adversarial Trainingcited by 117
  20. 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
  21. 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
  22. 2020Generative Hierarchical Features from Synthesizing Imagescited by 83
  23. 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
  24. 2019Semantics Disentangling for Text-to-Image Generationcited by 61
  25. 2020GuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editingcited by 37
  26. 2018Attention-GAN for Object Transfiguration in Wild Imagescited by 32
  27. 2021StyleFusion: A Generative Model for Disentangling Spatial Segmentscited by 28
  28. 2018Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attentioncited by 10
  29. 2021StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulationcited by 9
  30. 2019Mask Based Unsupervised Content Transfercited by 8

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 8; 2024: 4; 2025: 1.

16 papers.

Sort:

By area:

  1. 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 61
  2. 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
  3. 2022CLIP-PAE: Projection-Augmentation Embedding to Extract Relevant Features for a Disentangled, Interpretable, and Controllable Text-Guided Face Manipulationcited by 19
  4. 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpointcited by 18
  5. 2023ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulationcited by 16
  6. 2023Text-guided Eyeglasses Manipulation with Spatial Constraintscited by 10
  7. 2025Hadamard product in deep learning: Introduction, Advances and Challengescited by 9
  8. 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editingcited by 6
  9. 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editingcited by 6
  10. 2023CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editingcited by 5
  11. 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
  12. 2023SEMPART: Self-supervised Multi-resolution Partitioning of Image Semanticscited by 4
4 more
  1. 2023DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editingcited by 3
  2. 2024CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMscited by 3
  3. 2023Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIPcited by 1
  4. 2024UP-FacE: User-predictable Fine-grained Face Shape Editingcited by 0