mlsanityData to 7 Oct 2026

StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators

arXiv 2108.00946 ↗First posted 2 Aug 2021cs.CV cs.CL cs.GRcited by 164

Not on the map. Why?

Cited by 49 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Can a generative model be trained to produce images from a specific domain, guided by a text prompt only, without seeing any image? In other words: can an image generator be trained "blindly"? Leveraging the semantic power of large scale Contrastive-Language-Image-Pre-training (CLIP) models, we present a text-driven method that allows shifting a generative model to new domains, without having to collect even a single image. We show that through natural language prompts and a few minutes of training, our method can adapt a generator across a multitude of domains characterized by diverse styles and shapes. Notably, many of these modifications would be difficult or outright impossible to reach with existing methods. We conduct an extensive set of experiments and comparisons across a wide range of domains. These demonstrate the effectiveness of our approach and show that our shifted models maintain the latent-space properties that make generative models appealing for downstream tasks.

Key facts. Cited by 164 papers in the map (data through 7 Oct 2026). Builds on 63 of its 79 references that are in the map. First posted on arXiv 2 Aug 2021.

Builds on

63 of 79 references.

References · 63

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  9. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  10. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  11. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  12. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
38 more
  1. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
  2. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  3. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  4. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
  5. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
  6. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  7. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  8. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  9. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  10. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  11. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
  12. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  13. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  14. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  15. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  16. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  17. 2019Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-trainingcited by 451
  18. 2021GAN Inversion: A Surveycited by 366
  19. 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 361
  20. 2017Universal Style Transfer via Feature Transformscited by 352
  21. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  22. 2020VirTex: Learning Visual Representations from Textual Annotationscited by 338
  23. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  24. 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
  25. 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
  26. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
  27. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  28. 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
  29. 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
  30. 2018Transferring GANs: generating images from limited datacited by 134
  31. 2020Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANscited by 132
  32. 2020You Only Need Adversarial Supervision for Semantic Image Synthesiscited by 129
  33. 2017Visual Attribute Transfer through Deep Image Analogycited by 123
  34. 2020Learning Visual Representations with Caption Annotationscited by 123
  35. 2020Few-shot Image Generation with Elastic Weight Consolidationcited by 122
  36. 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
  37. 2021Paint by Wordcited by 107
  38. 2019MineGAN: effective knowledge transfer from GANs to target domains with few imagescited by 106

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 45; 2023: 54; 2024: 38; 2025: 16; 2026: 7.

164 papers.

Sort:

By area:

  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  3. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  4. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  5. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
  6. 2023Erasing Concepts from Diffusion Modelscited by 530
  7. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  8. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  9. 2022Blended Latent Diffusioncited by 430
  10. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  11. 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
  12. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
38 more
  1. 2023Teaching CLIP to Count to Tencited by 194
  2. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
  3. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 156
  4. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  5. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  6. 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
  7. 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
  8. 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 63
  9. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  10. 2023Concept Decomposition for Visual Exploration and Inspirationcited by 61
  11. 2022CLIP-GEN: Language-Free Training of a Text-to-Image Generator with CLIPcited by 60
  12. 2022PODA: Prompt-driven Zero-shot Domain Adaptationcited by 60
  13. 2022Rickrolling the Artist: Injecting Backdoors into Text Encoders for Text-to-Image Synthesiscited by 59
  14. 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfercited by 59
  15. 2023PromptStyler: Prompt-driven Style Generation for Source-free Domain Generalizationcited by 59
  16. 2023Shape-aware Text-driven Layered Video Editingcited by 54
  17. 2021JoJoGAN: One Shot Face Stylizationcited by 49
  18. 2023GeneCIS: A Benchmark for General Conditional Image Similaritycited by 46
  19. 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Imagecited by 42
  20. 2021Image-Based CLIP-Guided Essence Transfercited by 39
  21. 20223D GAN Inversion with Facial Symmetry Priorcited by 39
  22. 2022Diffusion Video Autoencoders: Toward Temporally Consistent Face Video Editing via Disentangled Video Encodingcited by 39
  23. 2023Highly Personalized Text Embedding for Image Manipulation by Stable Diffusioncited by 39
  24. 2024Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videoscited by 38
  25. 2022Self-Distilled StyleGAN: Towards Generation from Internet Photoscited by 37
  26. 2024Customizing Text-to-Image Models with a Single Image Paircited by 36
  27. 2024PALP: Prompt Aligned Personalization of Text-to-Image Modelscited by 35
  28. 2021Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Modelcited by 34
  29. 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protectioncited by 31
  30. 2022DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generationcited by 30
  31. 2022Draw Your Art Dream: Diverse Digital Art Synthesis with Multimodal Guided Diffusioncited by 30
  32. 2024StyleBooth: Image Style Editing with Multimodal Instructioncited by 28
  33. 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directionscited by 27
  34. 2023Zero-shot Generative Model Adaptation via Image-specific Prompt Learningcited by 27
  35. 2022SNeRF: Stylized Neural Implicit Representations for 3D Scenescited by 26
  36. 2023Zero-shot Generation of Coherent Storybook from Plain Text Story using Diffusion Modelscited by 26
  37. 2022Rewriting Geometric Rules of a GANcited by 25
  38. 2024TexSliders: Diffusion-Based Texture Editing in CLIP Spacecited by 23

50 most cited of 164 All 164 (JSON)