Improved StyleGAN Embedding: Where are the Good Latents?
Not on the map. Why?
Abstract (arXiv)
StyleGAN is able to produce photorealistic images that are almost indistinguishable from real photos. The reverse problem of finding an embedding for a given image poses a challenge. Embeddings that reconstruct an image well are not always robust to editing operations. In this paper, we address the problem of finding an embedding that both reconstructs images and also supports image editing tasks. First, we introduce a new normalized space to analyze the diversity and the quality of the reconstructed latent codes. This space can help answer the question of where good latent codes are located in latent space. Second, we propose an improved embedding algorithm using a novel regularization method based on our analysis. Finally, we analyze the quality of different embedding algorithms. We compare our results with the current state-of-the-art methods and achieve a better trade-off between reconstruction quality and editing quality.
Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 28; 2023: 21; 2024: 16; 2025: 4.
88 papers.
Sort:
By area:
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2021GAN Inversion: A Surveycited by 366
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
- 2023Generalizing Dataset Distillation via Deep Generative Priorcited by 125
38 more
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
- 2021Paint by Wordcited by 107
- 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Modelscited by 98
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesiscited by 93
- 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
- 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
- 2021CLIP2StyleGAN: Unsupervised Extraction of StyleGAN Edit Directionscited by 78
- 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
- 2022Stitch it in Time: GAN-Based Facial Editing of Real Videoscited by 68
- 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Modelscited by 64
- 2021GAN Inversion for Out-of-Range Images with Geometric Transformationscited by 55
- 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
- 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
- 2021JoJoGAN: One Shot Face Stylizationcited by 49
- 20223D GAN Inversion with Pose Optimizationcited by 44
- 2021Image-Based CLIP-Guided Essence Transfercited by 39
- 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatarscited by 38
- 2022Style Transformer for Image Inversion and Editingcited by 37
- 2022TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editingcited by 36
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2022One-Shot Adaptation of GAN in Just One CLIPcited by 31
- 2021StyleFusion: A Generative Model for Disentangling Spatial Segmentscited by 28
- 2022Everything is There in Latent Space: Attribute Editing and Attribute Style Manipulation by StyleGAN Latent Space Explorationcited by 21
- 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
- 2022HyperDomainNet: Universal Domain Adaptation for Generative Adversarial Networkscited by 19
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generationcited by 19
- 2024VRMM: A Volumetric Relightable Morphable Head Modelcited by 19
- 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpointcited by 18
- 2023HairCLIPv2: Unifying Hair Editing via Proxy Feature Blendingcited by 17
- 2021Few-shot Image Generation with Mixup-based Distance Learningcited by 16
- 2022Style Your Hair: Latent Optimization for Pose-Invariant Hairstyle Transfer via Local-Style-Aware Hair Alignmentcited by 16
- 2022clip2latent: Text driven sampling of a pre-trained StyleGAN using denoising diffusion and CLIPcited by 16
- 2021Barbershop: GAN-based Image Compositing using Segmentation Maskscited by 14
- 2023Robust Unsupervised StyleGAN Image Restorationcited by 14
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidancecited by 14
50 most cited of 88 All 88 (JSON)
- 2025MambaStyle: Efficient StyleGAN Inversion for Real Image Editing with State-Space Models6 May 2025
- 2025DIVE: Inverting Conditional Diffusion Models for Discriminative Tasks24 Apr 2025
- 2025Pose and Facial Expression Transfer by using StyleGAN17 Apr 2025
- 2025Personalized Image Generation with Deep Generative Models: A Decade Survey18 Feb 2025
- 2024Stable Flow: Vital Layers for Training-Free Image Editing21 Nov 2024
- 2024HairDiffusion: Vivid Multi-Colored Hair Editing via Latent Diffusion29 Oct 2024
- 2024Rejection Sampling IMLE: Designing Priors for Better Few-Shot Image Synthesis26 Sep 2024
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug 2024
- 2024Learning Feature-Preserving Portrait Editing from Generated Pairs29 Jul 2024
- 2024Assessing Sample Quality via the Latent Space of Generative Models21 Jul 2024
- 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models27 Jun 2024
- 2024Reconstructing Interpretable Features in Computational Super-Resolution microscopy via Regularized Latent Search29 May 2024
38 more
- 2024HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach1 Apr 2024
- 2024Model-Agnostic Human Preference Inversion in Diffusion Models1 Apr 2024
- 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar 2024
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidance1 Mar 2024
- 2024Visual Concept-driven Image Generation with Text-to-Image Diffusion Model18 Feb 2024
- 2024VRMM: A Volumetric Relightable Morphable Head Model6 Feb 2024
- 2024SpecRef: A Fast Training-free Baseline of Specific Reference-Condition Real Image Editing7 Jan 2024
- 2024Few-shot Image Generation via Information Transfer from the Built Geodesic Surface3 Jan 2024
- 2023Cross Initialization for Personalized Text-to-Image Generation26 Dec 2023
- 2023One-for-All: Towards Universal Domain Translation with a Single StyleGAN22 Oct 2023
- 2023HairCLIPv2: Unifying Hair Editing via Proxy Feature Blending16 Oct 2023
- 2023SC2GAN: Rethinking Entanglement by Self-correcting Correlated GAN Space10 Oct 2023
- 2023Face Identity-Aware Disentanglement in StyleGAN21 Sep 2023
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation31 Aug 2023
- 2023Revisiting Latent Space of GAN Inversion for Real Image Editing18 Jul 2023
- 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Models13 Jul 2023
- 2023Balancing Reconstruction and Editing Quality of GAN Inversion for Real Image Editing with StyleGAN Prior Latent Space31 May 2023
- 2023Multi-Modal Face Stylization with a Generative Prior29 May 2023
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Image25 May 2023
- 2023A Neural Space-Time Representation for Text-to-Image Personalization24 May 2023
- 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models8 May 2023
- 2023Generalizing Dataset Distillation via Deep Generative Prior2 May 2023
- 2023Scaling up GANs for Text-to-Image Synthesis9 Mar 2023
- 2023Learning Input-agnostic Manipulation Directions in StyleGAN with Text Guidance26 Feb 2023
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb 2023
- 2023LC-NeRF: Local Controllable Face Generation in Neural Randiance Field19 Feb 2023
- 2023Robust Unsupervised StyleGAN Image Restoration13 Feb 2023
- 20233D-aware Blending with Generative NeRFs13 Feb 2023
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatars6 Jan 2023
- 2022Learning Representations for Masked Facial Recovery28 Dec 2022
- 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection12 Dec 2022
- 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimization28 Nov 2022
- 2022Progressive Disentangled Representation Learning for Fine-Grained Controllable Talking Head Synthesis26 Nov 2022
- 2022Learning Detailed Radiance Manifolds for High-Fidelity and 3D-Consistent Portrait Synthesis from Monocular Image25 Nov 2022
- 2022Semantics-Preserving Sketch Embedding for Face Generation23 Nov 2022
- 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpoint21 Nov 2022
- 2022HyperDomainNet: Universal Domain Adaptation for Generative Adversarial Networks17 Oct 2022
- 20223D GAN Inversion with Pose Optimization13 Oct 2022
50 newest of 88 All 88 (JSON)
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 127
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
- 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Modelscited by 98
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Modelscited by 64
- 2022clip2latent: Text driven sampling of a pre-trained StyleGAN using denoising diffusion and CLIPcited by 16
- 2023Cross Initialization for Personalized Text-to-Image Generationcited by 10
- 2024SpecRef: A Fast Training-free Baseline of Specific Reference-Condition Real Image Editingcited by 4
- 2024Visual Concept-driven Image Generation with Text-to-Image Diffusion Modelcited by 4
- 2024Model-Agnostic Human Preference Inversion in Diffusion Modelscited by 3
- 2024HairDiffusion: Vivid Multi-Colored Hair Editing via Latent Diffusioncited by 3
- 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Modelscited by 2
12 most cited of 13 All 13 (JSON)
- 2025DIVE: Inverting Conditional Diffusion Models for Discriminative Tasks24 Apr 2025
- 2024Stable Flow: Vital Layers for Training-Free Image Editing21 Nov 2024
- 2024HairDiffusion: Vivid Multi-Colored Hair Editing via Latent Diffusion29 Oct 2024
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug 2024
- 2024AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models27 Jun 2024
- 2024Model-Agnostic Human Preference Inversion in Diffusion Models1 Apr 2024
- 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar 2024
- 2024Visual Concept-driven Image Generation with Text-to-Image Diffusion Model18 Feb 2024
- 2024SpecRef: A Fast Training-free Baseline of Specific Reference-Condition Real Image Editing7 Jan 2024
- 2023Cross Initialization for Personalized Text-to-Image Generation26 Dec 2023
- 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models8 May 2023
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb 2023
12 newest of 13 All 13 (JSON)
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2021GAN Inversion: A Surveycited by 366
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2023Generalizing Dataset Distillation via Deep Generative Priorcited by 125
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2021Paint by Wordcited by 107
12 most cited of 75 All 75 (JSON)
- 2025MambaStyle: Efficient StyleGAN Inversion for Real Image Editing with State-Space Models6 May 2025
- 2025Pose and Facial Expression Transfer by using StyleGAN17 Apr 2025
- 2025Personalized Image Generation with Deep Generative Models: A Decade Survey18 Feb 2025
- 2024Rejection Sampling IMLE: Designing Priors for Better Few-Shot Image Synthesis26 Sep 2024
- 2024Learning Feature-Preserving Portrait Editing from Generated Pairs29 Jul 2024
- 2024Assessing Sample Quality via the Latent Space of Generative Models21 Jul 2024
- 2024Reconstructing Interpretable Features in Computational Super-Resolution microscopy via Regularized Latent Search29 May 2024
- 2024HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach1 Apr 2024
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidance1 Mar 2024
- 2024VRMM: A Volumetric Relightable Morphable Head Model6 Feb 2024
- 2024Few-shot Image Generation via Information Transfer from the Built Geodesic Surface3 Jan 2024
- 2023One-for-All: Towards Universal Domain Translation with a Single StyleGAN22 Oct 2023
12 newest of 75 All 75 (JSON)