mlsanityData to 14 Oct 2026

Trained Latent Space Navigation to Prevent Lack of Photorealism in Generated Images on Style-based Models

arXiv 2310.00936 ↗First posted 2 Oct 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent studies on StyleGAN variants show promising performances for various generation tasks. In these models, latent codes have traditionally been manipulated and searched for the desired images. However, this approach sometimes suffers from a lack of photorealism in generated images due to a lack of knowledge about the geometry of the trained latent space. In this paper, we show a simple unsupervised method that provides well-trained local latent subspace, enabling latent code navigation while preserving the photorealism of the generated images. Specifically, the method identifies densely mapped latent spaces and restricts latent manipulations within the local latent subspace. Experimental results demonstrate that images generated within the local latent subspace maintain photorealism even when the latent codes are significantly and repeatedly manipulated. Moreover, experiments show that the method can be applied to latent code optimization for various types of style-based models. Our empirical evidence of the method will benefit applications in style-based models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 2 Oct 2023.

Builds on

32 of 49 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  7. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  8. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  9. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  11. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  12. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
20 more
  1. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  2. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  3. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
  4. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  5. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  6. 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
  7. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
  8. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
  9. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
  10. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
  11. 2019On the "steerability" of generative adversarial networkscited by 248
  12. 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
  13. 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
  14. 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
  15. 2021Low-Rank Subspaces in GANscited by 53
  16. 2018A Spectral Regularizer for Unsupervised Disentanglementcited by 30
  17. 2021LOHO: Latent Optimization of Hairstyles via Orthogonalizationcited by 30
  18. 2021Do Not Escape From the Manifold: Discovering the Local Coordinates on the Latent Space of GANscited by 26
  19. 2021Surrogate Gradient Field for Latent Space Manipulationcited by 12
  20. 2021Diamond in the rough: Improving image realism by traversing the GAN latent spacecited by 3

Built on by

Not cited yet.