Rethinking the editing of generative adversarial networks: a method to estimate editing vectors based on dimension reduction
Not on the map. Why?
Abstract (arXiv)
While Generative Adversarial Networks (GANs) have recently found applications in image editing, most previous GAN-based image editing methods require largescale datasets with semantic segmentation annotations for training, only provide high level control, or merely interpolate between different images. Previous researchers have proposed EditGAN for high-quality, high-precision semantic image editing with limited semantic annotations by finding `editing vectors'. However, it is noticed that there are many features that are not highly associated with semantics, and EditGAN may fail on them. Based on the orthogonality of latent space observed by EditGAN, we propose a method to estimate editing vectors that do not rely on semantic segmentation nor differentiable feature estimation network. Our method assumes that there is a correlation between the intensity distribution of features and the distribution of hidden vectors, and estimates the relationship between the above distributions by sampling the feature intensity of the image corresponding to several hidden vectors. We modified Linear Discriminant Analysis (LDA) to deal with both binary feature editing and continuous feature editing. We then found that this method has a good effect in processing features such as clothing type and texture, skin color and hair.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 56 references that are in the map. First posted on arXiv 7 Mar 2023.
Builds on
49 of 56 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2017Unsupervised Image-to-Image Translation Networkscited by 603
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
37 more
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
- 2016Adversarial Feature Learningcited by 350
- 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
- 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
- 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
- 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
- 2019On the "steerability" of generative adversarial networkscited by 248
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
- 2016Adversarially Learned Inferencecited by 216
- 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
- 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
- 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
- 2020Semantic Photo Manipulation with a Generative Image Priorcited by 178
- 2017Deep Photo Style Transfercited by 168
- 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
- 2016Semantic Image Inpainting with Deep Generative Modelscited by 157
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2019Seeing What a GAN Cannot Generatecited by 148
- 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
- 2016Inverting The Generator Of A Generative Adversarial Networkcited by 140
- 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
- 2016Invertible Conditional GANs for image editingcited by 118
- 2016Neural Photo Editing with Introspective Adversarial Networkscited by 109
- 2020Rewriting a Deep Generative Modelcited by 107
- 2021Paint by Wordcited by 107
- 2020Controlling generative models with continuous factors of variationscited by 93
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2020Transforming and Projecting Images into Class-conditional Generative Networkscited by 76
- 2020Navigating the GAN Parameter Space for Semantic Image Editingcited by 49
- 2020Cascade EF-GAN: Progressive Facial Expression Editing with Local Focusescited by 43
- 2020Disentangled Image Generation Through Structured Noise Injectioncited by 39
- 2020GuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editingcited by 37
- 2021The Geometry of Deep Generative Image Models and its Applicationscited by 35
- 2020Deep Generation of Face Images from Sketchescited by 32
- 2018Style and Content Disentanglement in Generative Adversarial Networkscited by 29
- 2021Linear Semantics in Generative Adversarial Networkscited by 25
Built on by
Not cited yet.