mlsanityData to 7 Oct 2026

HairCLIP: Design Your Hair by Text and Reference Image

arXiv 2112.05142 ↗First posted 9 Dec 2021cs.CV cs.GRcited by 79

Not on the map. Why?

Abstract (arXiv)

Hair editing is an interesting and challenging problem in computer vision and graphics. Many existing methods require well-drawn sketches or masks as conditional inputs for editing, however these interactions are neither straightforward nor efficient. In order to free users from the tedious interaction process, this paper proposes a new hair editing interaction mode, which enables manipulating hair attributes individually or jointly based on the texts or reference images provided by users. For this purpose, we encode the image and text conditions in a shared embedding space and propose a unified hair editing framework by leveraging the powerful image text representation capability of the Contrastive Language-Image Pre-Training (CLIP) model. With the carefully designed network structures and loss functions, our framework can perform high-quality hair editing in a disentangled manner. Extensive experiments demonstrate the superiority of our approach in terms of manipulation accuracy, visual realism of editing results, and irrelevant attribute preservation. Project repo is https://github.com/wty-ustc/HairCLIP.

Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). Builds on 36 of its 51 references that are in the map. First posted on arXiv 9 Dec 2021.

Builds on

36 of 51 references.

References · 36

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  6. 2017Improved Training of Wasserstein GANscited by 2,223
  7. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  8. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  9. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
  10. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  11. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  12. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
24 more
  1. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  2. 2021Florence: A New Foundation Model for Computer Visioncited by 802
  3. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  4. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  5. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  6. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  7. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  8. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
  9. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  10. 2019On the "steerability" of generative adversarial networkscited by 247
  11. 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
  12. 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
  13. 2020A U-Net Based Discriminator for Generative Adversarial Networkscited by 128
  14. 2019SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Colorcited by 105
  15. 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
  16. 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
  17. 2020Efficient Semantic Image Synthesis via Class-Adaptive Normalizationcited by 58
  18. 2017Language-Based Image Editing with Recurrent Attentive Modelscited by 53
  19. 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
  20. 2021LOHO: Latent Optimization of Hairstyles via Orthogonalizationcited by 30
  21. 2019A Characteristic Function Approach to Deep Implicit Generative Modelingcited by 25
  22. 2021Cross-Domain and Disentangled Face Manipulation with 3D Guidancecited by 17
  23. 2020On Positive-Unlabeled Classification in GANcited by 14
  24. 2019Alleviation of Gradient Exploding in GANs: Fake Can Be Realcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 15; 2023: 38; 2024: 11; 2025: 9; 2026: 5.

79 papers.

Sort:

By area:

  1. 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 148
  2. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  3. 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
  4. 2024Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restorationcited by 60
  5. 2022ClipFace: Text-guided Editing of Textured 3D Morphable Modelscited by 59
  6. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  7. 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
  8. 2022Multimodal Fake News Detection via CLIP-Guided Learningcited by 42
  9. 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 42
  10. 2023Text-Guided Generation and Editing of Compositional 3D Avatarscited by 39
  11. 2023High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learningcited by 37
  12. 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 34
38 more
  1. 2023Learning Emotion Representations from Verbal and Nonverbal Communicationcited by 31
  2. 2023DeltaEdit: Exploring Text-free Training for Text-Driven Image Manipulationcited by 27
  3. 2022Bootstrapping Multi-view Representations for Fake News Detectioncited by 25
  4. 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
  5. 2025FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image Editingcited by 21
  6. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  7. 2023Tell2Design: A Dataset for Language-Guided Floor Plan Generationcited by 19
  8. 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpointcited by 18
  9. 2023TextIR: A Simple Framework for Text-based Editable Image Restorationcited by 17
  10. 2023Pluralistic Aging Diffusion Autoencodercited by 17
  11. 2023Language-guided Human Motion Synthesis with Atomic Actionscited by 17
  12. 2023HairCLIPv2: Unifying Hair Editing via Proxy Feature Blendingcited by 17
  13. 2023ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulationcited by 16
  14. 2023Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creationcited by 15
  15. 2023Multi-modal Fake News Detection on Social Media via Multi-grained Information Fusioncited by 15
  16. 2024PromptRR: Diffusion Models as Prompt Generators for Single Image Reflection Removalcited by 14
  17. 2022Bridging CLIP and StyleGAN through Latent Alignment for Image Editingcited by 12
  18. 2023CHATEDIT: Towards Multi-turn Interactive Facial Image Editing via Dialoguecited by 12
  19. 2023Exploring the Application of Large-scale Pre-trained Models on Adverse Weather Removalcited by 12
  20. 2023CLIP-Guided StyleGAN Inversion for Text-Driven Real Image Editingcited by 12
  21. 2024Diffusion-driven GAN Inversion for Multi-Modal Face Image Generationcited by 12
  22. 2023VGSG: Vision-Guided Semantic-Group Network for Text-based Person Searchcited by 11
  23. 2023Text-guided Eyeglasses Manipulation with Spatial Constraintscited by 10
  24. 2023InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Imagecited by 10
  25. 2023DemoCaricature: Democratising Caricature Generation with a Rough Sketchcited by 10
  26. 2024HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approachcited by 10
  27. 2022Language-Guided Face Animation by Recurrent StyleGAN-based Generatorcited by 9
  28. 2023FashionTex: Controllable Virtual Try-on with Text and Texturecited by 9
  29. 2023Masked-Attention Diffusion Guidance for Spatially Controlling Text-to-Image Generationcited by 9
  30. 2023Controllable 3D Face Generation with Conditional Style Code Diffusioncited by 9
  31. 2022ManiCLIP: Multi-Attribute Face Manipulation from Textcited by 8
  32. 2022CLIP2GAN: Towards Bridging Text with the Latent Space of GANscited by 8
  33. 20253DGH: 3D Head Generation with Composable Hair and Facecited by 8
  34. 2024What to Preserve and What to Transfer: Faithful, Identity-Preserving Diffusion-based Hairstyle Transfercited by 7
  35. 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Datacited by 5
  36. 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
  37. 2023Towards Sample-specific Backdoor Attack with Clean Labels via Attribute Triggercited by 4
  38. 2023ITstyler: Image-optimized Text-based Style Transfercited by 3

50 most cited of 79 All 79 (JSON)