StableGarment: Garment-Centric Generation via Stable Diffusion
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
In this paper, we introduce StableGarment, a unified framework to tackle garment-centric(GC) generation tasks, including GC text-to-image, controllable GC text-to-image, stylized GC text-to-image, and robust virtual try-on. The main challenge lies in retaining the intricate textures of the garment while maintaining the flexibility of pre-trained Stable Diffusion. Our solution involves the development of a garment encoder, a trainable copy of the denoising UNet equipped with additive self-attention (ASA) layers. These ASA layers are specifically devised to transfer detailed garment textures, also facilitating the integration of stylized base models for the creation of stylized images. Furthermore, the incorporation of a dedicated try-on ControlNet enables StableGarment to execute virtual try-on tasks with precision. We also build a novel data engine that produces high-quality synthesized data to preserve the model's ability to follow prompts. Extensive experiments demonstrate that our approach delivers state-of-the-art (SOTA) results among existing virtual try-on methods and exhibits high flexibility with broad potential applications in various garment-centric image generation.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 43 of its 55 references that are in the map. First posted on arXiv 16 Mar 2024.
Builds on
43 of 55 references.
Closest ancestors · 5
Same direction, newest first
- 2023WarpDiffusion: Efficient Diffusion Model for High-Fidelity Virtual Try-on6 Dec
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On4 Dec
- 2023Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flow11 Aug
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On22 May
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
Other references · 38
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
26 more
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2018Demystifying MMD GANscited by 1,268
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2017VITON: An Image-based Virtual Try-on Networkcited by 285
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 161
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2023TryOnDiffusion: A Tale of Two UNetscited by 141
- 2022High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditionscited by 129
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
- 2020Do Not Mask What You Do Not Need to Mask: a Parser-Free Virtual Try-Oncited by 77
- 2022Single Stage Virtual Try-on via Deformable Attention Flowscited by 64
- 2021Toward Accurate and Realistic Outfits Visualization with Attention to Detailscited by 33
- 2023Pluralistic Aging Diffusion Autoencodercited by 17
- 2021Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systemscited by 13
- 2022Layered-Garment Net: Generating Multiple Implicit Garment Layers from a Single Imagecited by 9
Built on by
Citing papers per year: 2024: 7; 2025: 14; 2026: 6.
27 papers.
Sort:
By area:
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 99
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 62
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 34
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 23
- 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenationcited by 22
- 2025FastFit: Accelerating Multi-Reference Virtual Try-On via Cacheable Diffusion Modelscited by 11
- 2025IC-Custom: Diverse Image Customization via In-Context Learningcited by 10
- 2024AnyDressing: Customizable Multi-Garment Virtual Dressing via Latent Diffusion Modelscited by 7
- 2025JCo-MVTON: Jointly Controllable Multi-Modal Diffusion Transformer for Mask-Free Virtual Try-oncited by 7
15 more
- 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanismcited by 6
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editingcited by 5
- 2025HF-VTON: High-Fidelity Virtual Try-On via Consistent Geometric and Semantic Alignmentcited by 2
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Modelcited by 2
- 2025Dress&Dance: Dress up and Dance as You Like It - Technical Previewcited by 2
- 2025Fashion-RAG: Multimodal Fashion Image Editing via Retrieval-Augmented Generationcited by 1
- 2025One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusioncited by 1
- 2026OmniDiT: Extending Diffusion Transformer to Omni-VTON Frameworkcited by 1
- 2026Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenescited by 1
- 2024FashionComposer: Compositional Fashion Image Generationcited by 0
- 2025Virtual Fitting Room: Generating Arbitrarily Long Videos of Virtual Try-On from a Single Image -- Technical Previewcited by 0
- 2026VersaVogue: Visual Expert Orchestration and Preference Alignment for Unified Fashion Synthesiscited by 0
- 2026Fashion130K: An E-commerce Fashion Dataset for Outfit Generation with Unified Multi-modal Conditioncited by 0
- 2026DiverAge: Reliable Pluralistic Face Aging with Cross-Age Identity Relation Guidancecited by 0
- 2026TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioningcited by 0
- 2026TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioning30 Sep 2026
- 2026DiverAge: Reliable Pluralistic Face Aging with Cross-Age Identity Relation Guidance2 Jun 2026
- 2026Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenes22 May 2026
- 2026Fashion130K: An E-commerce Fashion Dataset for Outfit Generation with Unified Multi-modal Condition11 May 2026
- 2026VersaVogue: Visual Expert Orchestration and Preference Alignment for Unified Fashion Synthesis8 Apr 2026
- 2026OmniDiT: Extending Diffusion Transformer to Omni-VTON Framework20 Mar 2026
- 2025Virtual Fitting Room: Generating Arbitrarily Long Videos of Virtual Try-On from a Single Image -- Technical Preview4 Sep 2025
- 2025Dress&Dance: Dress up and Dance as You Like It - Technical Preview28 Aug 2025
- 2025FastFit: Accelerating Multi-Reference Virtual Try-On via Cacheable Diffusion Models28 Aug 2025
- 2025JCo-MVTON: Jointly Controllable Multi-Modal Diffusion Transformer for Mask-Free Virtual Try-on25 Aug 2025
- 2025One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusion6 Aug 2025
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Model10 Jul 2025
15 more
- 2025IC-Custom: Diverse Image Customization via In-Context Learning2 Jul 2025
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Rendering30 May 2025
- 2025HF-VTON: High-Fidelity Virtual Try-On via Consistent Geometric and Semantic Alignment26 May 2025
- 2025Fashion-RAG: Multimodal Fashion Image Editing via Retrieval-Augmented Generation18 Apr 2025
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformer10 Mar 2025
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Data20 Feb 2025
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks27 Jan 2025
- 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenation20 Jan 2025
- 2024FashionComposer: Compositional Fashion Image Generation18 Dec 2024
- 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanism13 Dec 2024
- 2024AnyDressing: Customizable Multi-Garment Virtual Dressing via Latent Diffusion Models5 Dec 2024
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models21 Jul 2024
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Model19 Jul 2024
- 2024ProcessPainter: Learn Painting Process from Sequence Data10 Jun 2024
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing21 Mar 2024
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 99
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 34
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
- 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenationcited by 22
- 2025FastFit: Accelerating Multi-Reference Virtual Try-On via Cacheable Diffusion Modelscited by 11
- 2024AnyDressing: Customizable Multi-Garment Virtual Dressing via Latent Diffusion Modelscited by 7
- 2025JCo-MVTON: Jointly Controllable Multi-Modal Diffusion Transformer for Mask-Free Virtual Try-oncited by 7
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editingcited by 5
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Modelcited by 2
- 2025Dress&Dance: Dress up and Dance as You Like It - Technical Previewcited by 2
- 2026OmniDiT: Extending Diffusion Transformer to Omni-VTON Frameworkcited by 1
12 most cited of 13 All 13 (JSON)
- 2026VersaVogue: Visual Expert Orchestration and Preference Alignment for Unified Fashion Synthesis8 Apr 2026
- 2026OmniDiT: Extending Diffusion Transformer to Omni-VTON Framework20 Mar 2026
- 2025Dress&Dance: Dress up and Dance as You Like It - Technical Preview28 Aug 2025
- 2025FastFit: Accelerating Multi-Reference Virtual Try-On via Cacheable Diffusion Models28 Aug 2025
- 2025JCo-MVTON: Jointly Controllable Multi-Modal Diffusion Transformer for Mask-Free Virtual Try-on25 Aug 2025
- 2025Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Model10 Jul 2025
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Rendering30 May 2025
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformer10 Mar 2025
- 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenation20 Jan 2025
- 2024AnyDressing: Customizable Multi-Garment Virtual Dressing via Latent Diffusion Models5 Dec 2024
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models21 Jul 2024
- 2024Stable-Hair: Real-World Hair Transfer via Diffusion Model19 Jul 2024
12 newest of 13 All 13 (JSON)
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 62
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 23
- 2025IC-Custom: Diverse Image Customization via In-Context Learningcited by 10
- 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanismcited by 6
- 2025HF-VTON: High-Fidelity Virtual Try-On via Consistent Geometric and Semantic Alignmentcited by 2
- 2025One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusioncited by 1
- 2026Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenescited by 1
- 2024FashionComposer: Compositional Fashion Image Generationcited by 0
- 2025Virtual Fitting Room: Generating Arbitrarily Long Videos of Virtual Try-On from a Single Image -- Technical Previewcited by 0
- 2026Fashion130K: An E-commerce Fashion Dataset for Outfit Generation with Unified Multi-modal Conditioncited by 0
- 2026DiverAge: Reliable Pluralistic Face Aging with Cross-Age Identity Relation Guidancecited by 0
12 most cited of 13 All 13 (JSON)
- 2026TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioning30 Sep 2026
- 2026DiverAge: Reliable Pluralistic Face Aging with Cross-Age Identity Relation Guidance2 Jun 2026
- 2026Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenes22 May 2026
- 2026Fashion130K: An E-commerce Fashion Dataset for Outfit Generation with Unified Multi-modal Condition11 May 2026
- 2025Virtual Fitting Room: Generating Arbitrarily Long Videos of Virtual Try-On from a Single Image -- Technical Preview4 Sep 2025
- 2025One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusion6 Aug 2025
- 2025IC-Custom: Diverse Image Customization via In-Context Learning2 Jul 2025
- 2025HF-VTON: High-Fidelity Virtual Try-On via Consistent Geometric and Semantic Alignment26 May 2025
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Data20 Feb 2025
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks27 Jan 2025
- 2024FashionComposer: Compositional Fashion Image Generation18 Dec 2024
- 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanism13 Dec 2024
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Improving Virtual Try-On with Garment-focused Diffusion Models
- 2024Magic Clothing: Controllable Garment-Driven Image Synthesis
- 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
- 2025HiGarment: Cross-modal Harmony Based Diffusion Model for Flat Sketch to Realistic Garment Image
- 2024DreamFit: Garment-Centric Human Generation via a Lightweight Anything-Dressing Encoder
- 2024Product-Level Try-on: Characteristics-preserving Try-on with Realistic Clothes Shading and Wrinkles
- 2026GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Model
- 2024Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-On