Image-to-Image Translation with Disentangled Latent Vectors for Face Editing
Not on the map. Why?
Abstract (arXiv)
We propose an image-to-image translation framework for facial attribute editing with disentangled interpretable latent directions. Facial attribute editing task faces the challenges of targeted attribute editing with controllable strength and disentanglement in the representations of attributes to preserve the other attributes during edits. For this goal, inspired by the latent space factorization works of fixed pretrained GANs, we design the attribute editing by latent space factorization, and for each attribute, we learn a linear direction that is orthogonal to the others. We train these directions with orthogonality constraints and disentanglement losses. To project images to semantically organized latent spaces, we set an encoder-decoder architecture with attention-based skip connections. We extensively compare with previous image translation algorithms and editing with pretrained GAN works. Our extensive experiments show that our method significantly improves over the state-of-the-arts.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 11 Jan 2023.
Builds on
31 of 41 references.
References · 31
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
19 more
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 288
- 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
- 2018ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributescited by 50
- 2016Learning Residual Images for Face Attribute Manipulationcited by 40
- 2020GuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editingcited by 37
- 2022Style Transformer for Image Inversion and Editingcited by 37
- 2021Dual Contrastive Loss and Attention for GANscited by 30
- 2020Panoptic-based Image Synthesiscited by 23
- 2021SOGAN: 3D-Aware Shadow and Occlusion Robust GAN for Makeup Transfercited by 22
- 2022VecGAN: Image-to-Image Translation with Interpretable Latent Directionscited by 17
- 2019SDIT: Scalable and Diverse Cross-domain Image Translationcited by 11
- 2019Attribute Guided Unpaired Image-to-Image Translation with Semi-supervised Learningcited by 8
- 2021DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesiscited by 6
Built on by
Citing papers per year: 2023: 4; 2024: 3; 2025: 1; 2026: 5.
13 papers.
Sort:
By area:
- 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 46
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 41
- 2024Reference-Based 3D-Aware Image Editing with Triplanescited by 9
- 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulationcited by 7
- 2023Warping the Residuals for Image Editing with StyleGANcited by 6
- 2026Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulationcited by 2
- 2023Diverse Semantic Image Editing with Style Codescited by 1
- 2024Ultra-High-Resolution Image Synthesis with Pyramid Diffusion Modelcited by 1
- 2023Subjective Face Transform using Human First Impressionscited by 0
- 2026U-Face: An Efficient and Generalizable Framework for Unsupervised Facial Attribute Editing via Subspace Learningcited by 0
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulationcited by 0
- 2026AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editingcited by 0
1 more
- 2026Encoder-Decoder Manifold Alignment for Idempotent Generation21 Jun 2026
- 2026AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing23 Apr 2026
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation23 Apr 2026
- 2026Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulation22 Apr 2026
- 2026U-Face: An Efficient and Generalizable Framework for Unsupervised Facial Attribute Editing via Subspace Learning14 Mar 2026
- 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulation8 Apr 2025
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation22 May 2024
- 2024Reference-Based 3D-Aware Image Editing with Triplanes4 Apr 2024
- 2024Ultra-High-Resolution Image Synthesis with Pyramid Diffusion Model19 Mar 2024
- 2023Warping the Residuals for Image Editing with StyleGAN18 Dec 2023
- 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Models8 Dec 2023
- 2023Subjective Face Transform using Human First Impressions27 Sep 2023
1 more
- 2023Diverse Semantic Image Editing with Style Codes25 Sep 2023
- 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Modelscited by 46
- 2024Ultra-High-Resolution Image Synthesis with Pyramid Diffusion Modelcited by 1
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulationcited by 0
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation23 Apr 2026
- 2024Ultra-High-Resolution Image Synthesis with Pyramid Diffusion Model19 Mar 2024
- 2023NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Models8 Dec 2023
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 41
- 2024Reference-Based 3D-Aware Image Editing with Triplanescited by 9
- 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulationcited by 7
- 2023Warping the Residuals for Image Editing with StyleGANcited by 6
- 2026Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulationcited by 2
- 2023Diverse Semantic Image Editing with Style Codescited by 1
- 2023Subjective Face Transform using Human First Impressionscited by 0
- 2026U-Face: An Efficient and Generalizable Framework for Unsupervised Facial Attribute Editing via Subspace Learningcited by 0
- 2026AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editingcited by 0
- 2026Encoder-Decoder Manifold Alignment for Idempotent Generationcited by 0
- 2026Encoder-Decoder Manifold Alignment for Idempotent Generation21 Jun 2026
- 2026AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing23 Apr 2026
- 2026Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulation22 Apr 2026
- 2026U-Face: An Efficient and Generalizable Framework for Unsupervised Facial Attribute Editing via Subspace Learning14 Mar 2026
- 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulation8 Apr 2025
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation22 May 2024
- 2024Reference-Based 3D-Aware Image Editing with Triplanes4 Apr 2024
- 2023Warping the Residuals for Image Editing with StyleGAN18 Dec 2023
- 2023Subjective Face Transform using Human First Impressions27 Sep 2023
- 2023Diverse Semantic Image Editing with Style Codes25 Sep 2023