mlsanityData to 7 Oct 2026

A Compact and Semantic Latent Space for Disentangled and Controllable Image Editing

arXiv 2312.08256 ↗First posted 13 Dec 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in the field of generative models and in particular generative adversarial networks (GANs) have lead to substantial progress for controlled image editing, especially compared with the pre-deep learning era. Despite their powerful ability to apply realistic modifications to an image, these methods often lack properties like disentanglement (the capacity to edit attributes independently). In this paper, we propose an auto-encoder which re-organizes the latent space of StyleGAN, so that each attribute which we wish to edit corresponds to an axis of the new latent space, and furthermore that the latent axes are decorrelated, encouraging disentanglement. We work in a compressed version of the latent space, using Principal Component Analysis, meaning that the parameter complexity of our autoencoder is reduced, leading to short training times (~ 45 mins). Qualitative and quantitative results demonstrate the editing capabilities of our approach, with greater disentanglement than competing methods, while maintaining fidelity to the original image with respect to identity. Our autoencoder architecture simple and straightforward, facilitating implementation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 13 Dec 2023.

Builds on

18 of 24 references.

References · 18

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  8. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  9. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  10. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  11. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  12. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
6 more
  1. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  2. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  3. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  4. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  5. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  6. 2017GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibriumcited by 208

Built on by

Not cited yet.