mlsanityData to 14 Oct 2026

Robust GAN inversion

arXiv 2308.16510 ↗First posted 31 Aug 2023cs.CV eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advancements in real image editing have been attributed to the exploration of Generative Adversarial Networks (GANs) latent space. However, the main challenge of this procedure is GAN inversion, which aims to map the image to the latent space accurately. Existing methods that work on extended latent space W+ are unable to achieve low distortion and high editability simultaneously. To address this issue, we propose an approach which works in native latent space W and tunes the generator network to restore missing image details. We introduce a novel regularization strategy with learnable coefficients obtained by training randomized StyleGAN 2 model - WRanGAN. This method outperforms traditional approaches in terms of reconstruction quality and computational efficiency, achieving the lowest distortion with 4 times fewer parameters. Furthermore, we observe a slight improvement in the quality of constructing hyperplanes corresponding to binary image attributes. We demonstrate the effectiveness of our approach on two complex datasets: Flickr-Faces-HQ and LSUN Church.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 32 references that are in the map. First posted on arXiv 31 Aug 2023.

Builds on

26 of 32 references.

References · 26

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  4. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  5. 2018Demystifying MMD GANscited by 1,293
  6. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  7. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  8. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  9. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
  10. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  11. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  12. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
14 more
  1. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  2. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  3. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  4. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
  5. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  6. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  7. 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
  8. 2020The Hessian Penalty: A Weak Prior for Unsupervised Disentanglementcited by 92
  9. 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
  10. 2020Collaborative Learning for Faster StyleGAN Embeddingcited by 65
  11. 2022Style Transformer for Image Inversion and Editingcited by 37
  12. 2017Bayesian GANcited by 32
  13. 2020Disentangling by Subspace Diffusioncited by 28
  14. 2021Disentangled Representations from Non-Disentangled Modelscited by 13

Built on by

Not cited yet.