Robust GAN inversion
Not on the map. Why?
Abstract (arXiv)
Recent advancements in real image editing have been attributed to the exploration of Generative Adversarial Networks (GANs) latent space. However, the main challenge of this procedure is GAN inversion, which aims to map the image to the latent space accurately. Existing methods that work on extended latent space W+ are unable to achieve low distortion and high editability simultaneously. To address this issue, we propose an approach which works in native latent space W and tunes the generator network to restore missing image details. We introduce a novel regularization strategy with learnable coefficients obtained by training randomized StyleGAN 2 model - WRanGAN. This method outperforms traditional approaches in terms of reconstruction quality and computational efficiency, achieving the lowest distortion with 4 times fewer parameters. Furthermore, we observe a slight improvement in the quality of constructing hyperplanes corresponding to binary image attributes. We demonstrate the effectiveness of our approach on two complex datasets: Flickr-Faces-HQ and LSUN Church.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 32 references that are in the map. First posted on arXiv 31 Aug 2023.
Builds on
26 of 32 references.
References · 26
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2018Demystifying MMD GANscited by 1,293
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
14 more
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2020The Hessian Penalty: A Weak Prior for Unsupervised Disentanglementcited by 92
- 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
- 2020Collaborative Learning for Faster StyleGAN Embeddingcited by 65
- 2022Style Transformer for Image Inversion and Editingcited by 37
- 2017Bayesian GANcited by 32
- 2020Disentangling by Subspace Diffusioncited by 28
- 2021Disentangled Representations from Non-Disentangled Modelscited by 13
Built on by
Not cited yet.