mlsanityData to 13 Oct 2026

Balancing Reconstruction and Editing Quality of GAN Inversion for Real Image Editing with StyleGAN Prior Latent Space

arXiv 2306.00241 ↗First posted 31 May 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit StyleGANs' hyperspherical prior Z and Z^+ and integrate them into seminal GAN inversion methods to improve editing quality. Besides faithful reconstruction, our extensions achieve sophisticated editing quality with the aid of the StyleGAN prior. We project the real images into the proposed space to obtain the inverted codes, by which we then move along Z+, enabling semantic editing without sacrificing image quality. Comprehensive experiments show that Z+ can replace the most commonly-used W, W+, and S spaces while preserving reconstruction quality, resulting in reduced distortion of edited images.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 27 of its 30 references that are in the map. First posted on arXiv 31 May 2023.

Builds on

27 of 30 references.

References · 27

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,000
  2. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,585
  3. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,975
  4. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  5. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  6. 2021Alias-Free Generative Adversarial Networkscited by 1,183
  7. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 913
  8. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 898
  9. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 692
  10. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  11. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  12. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
15 more
  1. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  2. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  3. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  4. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  5. 2021GAN Inversion: A Surveycited by 366
  6. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  7. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  8. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  9. 2020Improved StyleGAN Embedding: Where are the Good Latents?cited by 88
  10. 2021GAN Inversion for Out-of-Range Images with Geometric Transformationscited by 55
  11. 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
  12. 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
  13. 2020Improving Inversion and Generation Diversity in StyleGAN using a Gaussianized Latent Spacecited by 34
  14. 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
  15. 2022Near Perfect GAN Inversioncited by 15

Built on by

Not cited yet.