mlsanityData to 14 Oct 2026

StyleHumanCLIP: Text-guided Garment Manipulation for StyleGAN-Human

arXiv 2305.16759 ↗First posted 26 May 2023cs.CV cs.GRcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper tackles text-guided control of StyleGAN for editing garments in full-body human images. Existing StyleGAN-based methods suffer from handling the rich diversity of garments and body shapes and poses. We propose a framework for text-guided full-body human image synthesis via an attention-based latent code mapper, which enables more disentangled control of StyleGAN than existing mappers. Our latent code mapper adopts an attention mechanism that adaptively manipulates individual latent codes on different StyleGAN layers under text guidance. In addition, we introduce feature-space masking at inference time to avoid unwanted changes caused by text inputs. Our quantitative and qualitative evaluations reveal that our method can control generated images more faithfully to given texts than existing methods.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 52 references that are in the map. First posted on arXiv 26 May 2023.

Builds on

42 of 52 references.

References · 42

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  8. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  9. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  10. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  11. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  12. 2018Self-Attention Generative Adversarial Networkscited by 809
30 more
  1. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
  2. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  3. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  4. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  5. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
  6. 2023Zero-shot Image-to-Image Translationcited by 505
  7. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  8. 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
  9. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
  10. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
  11. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
  12. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  13. 2017VITON: An Image-based Virtual Try-on Networkcited by 286
  14. 2019On the "steerability" of generative adversarial networkscited by 248
  15. 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
  16. 2019Self-Correction for Human Parsingcited by 180
  17. 2020Towards Photo-Realistic Virtual Try-On by Adaptively GeneratingleftrightarrowPreserving Image Contentcited by 149
  18. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 144
  19. 2022High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditionscited by 130
  20. 2021HairCLIP: Design Your Hair by Text and Reference Imagecited by 80
  21. 2021CLIP2StyleGAN: Unsupervised Extraction of StyleGAN Edit Directionscited by 78
  22. 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
  23. 2021Low-Rank Subspaces in GANscited by 53
  24. 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
  25. 2020GAN "Steerability" without optimizationcited by 48
  26. 2021EigenGAN: Layer-Wise Eigen-Learning for GANscited by 34
  27. 2022C-VTON: Context-Driven Image-Based Virtual Try-On Networkcited by 29
  28. 2022PandA: Unsupervised Learning of Parts and Appearances in the Feature Maps of GANscited by 20
  29. 2023FashionTex: Controllable Virtual Try-on with Text and Texturecited by 9
  30. 2022ManiCLIP: Multi-Attribute Face Manipulation from Textcited by 8

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.