mlsanityData to 14 Oct 2026

Rethinking the editing of generative adversarial networks: a method to estimate editing vectors based on dimension reduction

arXiv 2305.09454 ↗First posted 7 Mar 2023cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

While Generative Adversarial Networks (GANs) have recently found applications in image editing, most previous GAN-based image editing methods require largescale datasets with semantic segmentation annotations for training, only provide high level control, or merely interpolate between different images. Previous researchers have proposed EditGAN for high-quality, high-precision semantic image editing with limited semantic annotations by finding `editing vectors'. However, it is noticed that there are many features that are not highly associated with semantics, and EditGAN may fail on them. Based on the orthogonality of latent space observed by EditGAN, we propose a method to estimate editing vectors that do not rely on semantic segmentation nor differentiable feature estimation network. Our method assumes that there is a correlation between the intensity distribution of features and the distribution of hidden vectors, and estimates the relationship between the above distributions by sampling the feature intensity of the image corresponding to several hidden vectors. We modified Linear Discriminant Analysis (LDA) to deal with both binary feature editing and continuous feature editing. We then found that this method has a good effect in processing features such as clothing type and texture, skin color and hair.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 56 references that are in the map. First posted on arXiv 7 Mar 2023.

Builds on

49 of 56 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  4. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  5. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  6. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  7. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
  8. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  9. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  10. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  11. 2017Unsupervised Image-to-Image Translation Networkscited by 603
  12. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
37 more
  1. 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
  2. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
  3. 2016Adversarial Feature Learningcited by 350
  4. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  5. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
  6. 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
  7. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  8. 2019On the "steerability" of generative adversarial networkscited by 248
  9. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
  10. 2016Adversarially Learned Inferencecited by 216
  11. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  12. 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
  13. 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
  14. 2020Semantic Photo Manipulation with a Generative Image Priorcited by 178
  15. 2017Deep Photo Style Transfercited by 168
  16. 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
  17. 2016Semantic Image Inpainting with Deep Generative Modelscited by 157
  18. 2021EditGAN: High-Precision Semantic Image Editingcited by 156
  19. 2019Seeing What a GAN Cannot Generatecited by 148
  20. 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
  21. 2016Inverting The Generator Of A Generative Adversarial Networkcited by 140
  22. 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
  23. 2016Invertible Conditional GANs for image editingcited by 118
  24. 2016Neural Photo Editing with Introspective Adversarial Networkscited by 109
  25. 2020Rewriting a Deep Generative Modelcited by 107
  26. 2021Paint by Wordcited by 107
  27. 2020Controlling generative models with continuous factors of variationscited by 93
  28. 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
  29. 2020Transforming and Projecting Images into Class-conditional Generative Networkscited by 76
  30. 2020Navigating the GAN Parameter Space for Semantic Image Editingcited by 49
  31. 2020Cascade EF-GAN: Progressive Facial Expression Editing with Local Focusescited by 43
  32. 2020Disentangled Image Generation Through Structured Noise Injectioncited by 39
  33. 2020GuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editingcited by 37
  34. 2021The Geometry of Deep Generative Image Models and its Applicationscited by 35
  35. 2020Deep Generation of Face Images from Sketchescited by 32
  36. 2018Style and Content Disentanglement in Generative Adversarial Networkscited by 29
  37. 2021Linear Semantics in Generative Adversarial Networkscited by 25

Built on by

Not cited yet.