Optimizing Latent Space Directions For GAN-based Local Image Editing
Not on the map. Why?
Abstract (arXiv)
Generative Adversarial Network (GAN) based localized image editing can suffer from ambiguity between semantic attributes. We thus present a novel objective function to evaluate the locality of an image edit. By introducing the supervision from a pre-trained segmentation network and optimizing the objective function, our framework, called Locally Effective Latent Space Direction (LELSD), is applicable to any dataset and GAN architecture. Our method is also computationally fast and exhibits a high extent of disentanglement, which allows users to interactively perform a sequence of edits on an image. Our experiments on both GAN-generated and real images qualitatively demonstrate the high quality and advantages of our method.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 25 of its 27 references that are in the map. First posted on arXiv 24 Nov 2021.
Builds on
25 of 27 references.
References · 25
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
13 more
- 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 288
- 2019On the "steerability" of generative adversarial networkscited by 247
- 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
- 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
- 2020Rewriting a Deep Generative Modelcited by 105
- 2020Controlling generative models with continuous factors of variationscited by 93
- 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
- 2021Low-Rank Subspaces in GANscited by 52
- 2021Linear Semantics in Generative Adversarial Networkscited by 25
- 2020GarmentGAN: Photo-realistic Adversarial Fashion Transfercited by 16
- 2021Barbershop: GAN-based Image Compositing using Segmentation Maskscited by 14
- 2021Decorating Your Own Bedroom: Locally Controlling Image Generation with Generative Adversarial Networkscited by 8
- 2019Aesthetics of Neural Network Artcited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 4.
5 papers.
- 2023A Unified Framework for Generative Data Augmentation: A Comprehensive Surveycited by 4
- 2023Class Attribute Inference Attacks: Inferring Sensitive Class Information by Diffusion-Based Attribute Manipulationscited by 2
- 2022Discovering Class-Specific GAN Controls for Semantic Image Synthesiscited by 1
- 20233D GANs and Latent Space: A comprehensive surveycited by 1
- 2023Editable Stain Transformation Of Histological Images Using Unpaired GANscited by 1
- 2023Editable Stain Transformation Of Histological Images Using Unpaired GANs6 Dec 2023
- 2023A Unified Framework for Generative Data Augmentation: A Comprehensive Survey30 Sep 2023
- 20233D GANs and Latent Space: A comprehensive survey8 Apr 2023
- 2023Class Attribute Inference Attacks: Inferring Sensitive Class Information by Diffusion-Based Attribute Manipulations16 Mar 2023
- 2022Discovering Class-Specific GAN Controls for Semantic Image Synthesis2 Dec 2022