mlsanityData to 14 Oct 2026

StyleMC: Multi-Channel Based Fast Text-Guided Image Generation and Manipulation

arXiv 2112.08493 ↗First posted 15 Dec 2021cs.CV cs.LGcited by 40

Not on the map. Why?

Abstract (arXiv)

Discovering meaningful directions in the latent space of GANs to manipulate semantic attributes typically requires large amounts of labeled data. Recent work aims to overcome this limitation by leveraging the power of Contrastive Language-Image Pre-training (CLIP), a joint text-image model. While promising, these methods require several hours of preprocessing or training to achieve the desired manipulations. In this paper, we present StyleMC, a fast and efficient method for text-driven image generation and manipulation. StyleMC uses a CLIP-based loss and an identity loss to manipulate images via a single text prompt without significantly affecting other attributes. Unlike prior work, StyleMC requires only a few seconds of training per text prompt to find stable global directions, does not require prompt engineering and can be used with any pre-trained StyleGAN2 model. We demonstrate the effectiveness of our method and compare it to state-of-the-art methods. Our code can be found at http://catlab-team.github.io/stylemc.

Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 15 Dec 2021.

Builds on

34 of 40 references.

References · 34

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  2. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  3. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  4. 2014Conditional Generative Adversarial Netscited by 2,162
  5. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  6. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  7. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  8. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  9. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
  10. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  11. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  12. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
22 more
  1. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  2. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  3. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
  4. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
  5. 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
  6. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
  7. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
  8. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
  9. 2019On the "steerability" of generative adversarial networkscited by 248
  10. 2017StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 229
  11. 2018DeepFakes: a New Threat to Face Recognition? Assessment and Detectioncited by 209
  12. 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
  13. 2019ManiGAN: Text-Guided Image Manipulationcited by 156
  14. 2021Paint by Wordcited by 107
  15. 2020Controlling generative models with continuous factors of variationscited by 93
  16. 2018Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Languagecited by 90
  17. 2017Semantic Image Synthesis via Adversarial Learningcited by 87
  18. 2016Deep Feature Interpolation for Image Content Changescited by 80
  19. 2019Learned Image Downscaling for Upscaling using Content Adaptive Resamplercited by 55
  20. 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
  21. 2020Lightweight Generative Adversarial Networks for Text-Guided Image Manipulationcited by 33
  22. 2020TediGAN: Text-Guided Diverse Face Image Generation and Manipulationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 12; 2023: 17; 2024: 3; 2025: 5; 2026: 2.

40 papers.

Sort:

By area:

  1. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
  2. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 144
  3. 2022ClipFace: Text-guided Editing of Textured 3D Morphable Modelscited by 60
  4. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  5. 2022DeepPrivacy2: Towards Realistic Full-Body Anonymizationcited by 51
  6. 2022SinDiffusion: Learning a Diffusion Model from a Single Natural Imagecited by 42
  7. 2022Text and Image Guided 3D Avatar Generation and Manipulationcited by 35
  8. 2023TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervisioncited by 28
  9. 2023DeltaEdit: Exploring Text-free Training for Text-Driven Image Manipulationcited by 27
  10. 2022FairStyle: Debiasing StyleGAN2 with Style Channel Manipulationscited by 20
  11. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  12. 2022CLIP-PAE: Projection-Augmentation Embedding to Extract Relevant Features for a Disentangled, Interpretable, and Controllable Text-Guided Face Manipulationcited by 19
28 more
  1. 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulationcited by 18
  2. 2023Catch Missing Details: Image Reconstruction with Frequency Augmented Variational Autoencodercited by 18
  3. 2022clip2latent: Text driven sampling of a pre-trained StyleGAN using denoising diffusion and CLIPcited by 16
  4. 2023ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulationcited by 16
  5. 2022Bridging CLIP and StyleGAN through Latent Alignment for Image Editingcited by 12
  6. 2023CLIP-Guided StyleGAN Inversion for Text-Driven Real Image Editingcited by 12
  7. 2023Not All Steps are Created Equal: Selective Diffusion Distillation for Image Manipulationcited by 11
  8. 2025Balancing Preservation and Modification: A Region and Semantic Aware Metric for Instruction-Based Image Editingcited by 10
  9. 2022CLIP2GAN: Towards Bridging Text with the Latent Space of GANscited by 8
  10. 2023DialogPaint: A Dialog-based Image Editing Modelcited by 8
  11. 2024Preserve or Modify? Context-Aware Evaluation for Balancing Preservation and Modification in Text-Guided Image Editingcited by 6
  12. 2023CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editingcited by 5
  13. 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
  14. 20233D-CLFusion: Fast Text-to-3D Rendering with Contrastive Latent Diffusioncited by 4
  15. 2023DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editingcited by 3
  16. 2023Learning Input-agnostic Manipulation Directions in StyleGAN with Text Guidancecited by 2
  17. 2023Synthesizing Anyone, Anywhere, in Any Posecited by 2
  18. 2023Urban-StyleGAN: Learning to Generate and Manipulate Images of Urban Scenescited by 2
  19. 2025Identity-Preserving Text-to-Image Generation via Dual-Level Feature Decoupling and Expert-Guided Fusioncited by 2
  20. 2023Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIPcited by 1
  21. 2023HyperEditor: Achieving Both Authenticity and Cross-Domain Capability in Image Editing via Hypernetworkscited by 1
  22. 2024HyperGAN-CLIP: A Unified Framework for Domain Adaptation, Image Synthesis and Manipulationcited by 1
  23. 2025Prompting Forgetting: Unlearning in GANs via Textual Guidancecited by 1
  24. 2025Reverse Personalizationcited by 1
  25. 2022Discovering Multiple and Diverse Directions for Cognitive Image Propertiescited by 0
  26. 2023Subjective Face Transform using Human First Impressionscited by 0
  27. 2026High-Fidelity 3D Facial Avatar Synthesis with Controllable Fine-Grained Expressionscited by 0
  28. 2026Neural Architecture Search for Generative Adversarial Networks: A Comprehensive Review and Critical Analysiscited by 0