Revisiting Latent Space of GAN Inversion for Real Image Editing
Not on the map. Why?
Abstract (arXiv)
The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit StyleGANs' hyperspherical prior Z and combine it with highly capable latent spaces to build combined spaces that faithfully invert real images while maintaining the quality of edited images. More specifically, we propose F/Z+ space consisting of two subspaces: F space of an intermediate feature map of StyleGANs enabling faithful reconstruction and Z+ space of an extended StyleGAN prior supporting high editing quality. We project the real images into the proposed space to obtain the inverted codes, by which we then move along Z+, enabling semantic editing without sacrificing image quality. Comprehensive experiments show that Z+ can replace the most commonly-used W, W+, and S spaces while preserving reconstruction quality, resulting in reduced distortion of edited images.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 39 of its 42 references that are in the map. First posted on arXiv 18 Jul 2023.
Builds on
39 of 42 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
27 more
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2021GAN Inversion: A Surveycited by 366
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
- 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
- 2020Improved StyleGAN Embedding: Where are the Good Latents?cited by 88
- 2021GAN Inversion for Out-of-Range Images with Geometric Transformationscited by 55
- 2021Low-Rank Subspaces in GANscited by 52
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 20233D generation on ImageNetcited by 47
- 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
- 2020Improving Inversion and Generation Diversity in StyleGAN using a Gaussianized Latent Spacecited by 34
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2021Do Not Escape From the Manifold: Discovering the Local Coordinates on the Latent Space of GANscited by 26
- 2022Near Perfect GAN Inversioncited by 15
- 2021Surrogate Gradient Field for Latent Space Manipulationcited by 12
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.