mlsanityData to 7 Oct 2026

Revisiting Latent Space of GAN Inversion for Real Image Editing

arXiv 2307.08995 ↗First posted 18 Jul 2023cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit StyleGANs' hyperspherical prior Z and combine it with highly capable latent spaces to build combined spaces that faithfully invert real images while maintaining the quality of edited images. More specifically, we propose F/Z+ space consisting of two subspaces: F space of an intermediate feature map of StyleGANs enabling faithful reconstruction and Z+ space of an extended StyleGAN prior supporting high editing quality. We project the real images into the proposed space to obtain the inverted codes, by which we then move along Z+, enabling semantic editing without sacrificing image quality. Comprehensive experiments show that Z+ can replace the most commonly-used W, W+, and S spaces while preserving reconstruction quality, resulting in reduced distortion of edited images.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 42 references that are in the map. First posted on arXiv 18 Jul 2023.

Builds on

39 of 42 references.

References · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  6. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  7. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  8. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  9. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  11. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  12. 2021Alias-Free Generative Adversarial Networkscited by 1,181
27 more
  1. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  2. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  3. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  4. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  5. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  6. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  7. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  8. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  9. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  10. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  11. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  12. 2021GAN Inversion: A Surveycited by 366
  13. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  14. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  15. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  16. 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
  17. 2020Improved StyleGAN Embedding: Where are the Good Latents?cited by 88
  18. 2021GAN Inversion for Out-of-Range Images with Geometric Transformationscited by 55
  19. 2021Low-Rank Subspaces in GANscited by 52
  20. 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
  21. 20233D generation on ImageNetcited by 47
  22. 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
  23. 2020Improving Inversion and Generation Diversity in StyleGAN using a Gaussianized Latent Spacecited by 34
  24. 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
  25. 2021Do Not Escape From the Manifold: Discovering the Local Coordinates on the Latent Space of GANscited by 26
  26. 2022Near Perfect GAN Inversioncited by 15
  27. 2021Surrogate Gradient Field for Latent Space Manipulationcited by 12

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.