Face Identity-Aware Disentanglement in StyleGAN
Not on the map. Why?
Abstract (arXiv)
Conditional GANs are frequently used for manipulating the attributes of face images, such as expression, hairstyle, pose, or age. Even though the state-of-the-art models successfully modify the requested attributes, they simultaneously modify other important characteristics of the image, such as a person's identity. In this paper, we focus on solving this problem by introducing PluGeN4Faces, a plugin to StyleGAN, which explicitly disentangles face attributes from a person's identity. Our key idea is to perform training on images retrieved from movie frames, where a given person appears in various poses and with different attributes. By applying a type of contrastive loss, we encourage the model to group images of the same person in similar regions of latent space. Our experiments demonstrate that the modifications of face attributes performed by PluGeN4Faces are significantly less invasive on the remaining characteristics of the image than in the existing state-of-the-art models.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 29 of its 37 references that are in the map. First posted on arXiv 21 Sep 2023.
Builds on
29 of 37 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
17 more
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
- 2016Invertible Conditional GANs for image editingcited by 118
- 2017Fader Networks: Manipulating Images by Sliding Attributescited by 118
- 2015Attribute2Image: Conditional Image Generation from Visual Attributescited by 93
- 2020Improved StyleGAN Embedding: Where are the Good Latents?cited by 88
- 2017On Loss Functions for Deep Neural Networks in Classificationcited by 68
- 2018Learning Latent Subspaces in Variational Autoencoderscited by 51
- 2021High-Fidelity and Arbitrary Face Editingcited by 35
- 2020Hijack-GAN: Unintended-Use of Pretrained, Black-Box GANscited by 23
- 2020Face Identity Disentanglement via Latent Space Mappingcited by 10
- 2021PluGeN: Multi-Label Conditional Generation From Pre-Trained Modelscited by 5
- 2017Spherical Wards clustering and generalized Voronoi diagramscited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 4; 2025: 0; 2026: 2.
8 papers.
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2024Deep Privacy Funnel Model: From a Discriminative to a Generative Approach with an Application to Face Recognitioncited by 1
- 2023Subjective Face Transform using Human First Impressionscited by 0
- 2023Disentangle Before Anonymize: A Two-stage Framework for Attribute-preserved and Occlusion-robust De-identificationcited by 0
- 2024TCDiff: Triple Condition Diffusion Model with 3D Constraints for Stylizing Synthetic Facescited by 0
- 2024StyleAutoEncoder for manipulating image attributes using pre-trained StyleGANcited by 0
- 2026FaceParts: Segmentation and Editing of Gaussian Splattingcited by 0
- 2026Conceptualizing Embeddings: Sparse Disentanglement for Vision-Language Modelscited by 0
- 2026Conceptualizing Embeddings: Sparse Disentanglement for Vision-Language Models21 May 2026
- 2026FaceParts: Segmentation and Editing of Gaussian Splatting25 Mar 2026
- 2024StyleAutoEncoder for manipulating image attributes using pre-trained StyleGAN28 Dec 2024
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook29 Nov 2024
- 2024TCDiff: Triple Condition Diffusion Model with 3D Constraints for Stylizing Synthetic Faces5 Sep 2024
- 2024Deep Privacy Funnel Model: From a Discriminative to a Generative Approach with an Application to Face Recognition3 Apr 2024
- 2023Disentangle Before Anonymize: A Two-stage Framework for Attribute-preserved and Occlusion-robust De-identification15 Nov 2023
- 2023Subjective Face Transform using Human First Impressions27 Sep 2023