TryOnGAN: Body-Aware Try-On via Layered Interpolation
Not on the map. Why?
Abstract (arXiv)
Given a pair of images-target person and garment on another person-we automatically generate the target person in the given garment. Previous methods mostly focused on texture transfer via paired data training, while overlooking body shape deformations, skin color, and seamless blending of garment with the person. This work focuses on those three components, while also not requiring paired data training. We designed a pose conditioned StyleGAN2 architecture with a clothing segmentation branch that is trained on images of people wearing garments. Once trained, we propose a new layered latent space interpolation method that allows us to preserve and synthesize skin color and target body shape while transferring the garment from a different person. We demonstrate results on high resolution 512x512 images, and extensively compare to state of the art in try-on on both latent space generated and real images.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 6 Jan 2021.
Builds on
30 of 43 references.
References · 30
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2016A Learned Representation For Artistic Stylecited by 340
- 2017VITON: An Image-based Virtual Try-on Networkcited by 285
18 more
- 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
- 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
- 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
- 2020Towards Photo-Realistic Virtual Try-On by Adaptively GeneratingleftrightarrowPreserving Image Contentcited by 148
- 2019Towards Multi-pose Guided Virtual Try-on Networkcited by 95
- 2017Exploring the structure of a real-time, arbitrary neural artistic stylization networkcited by 89
- 2019Graphonomy: Universal Human Parsing via Graph Transfer Learningcited by 81
- 2020Disentangled Image Generation Through Structured Noise Injectioncited by 39
- 2020Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Networkcited by 36
- 2018M2E-Try On Net: Fashion from Model to Everyonecited by 27
- 2020Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesiscited by 26
- 2020SieveNet: A Unified Framework for Robust Image-Based Virtual Try-Oncited by 23
- 2020GarmentGAN: Photo-realistic Adversarial Fashion Transfercited by 16
- 2019Generating High-Resolution Fashion Model Images Wearing Custom Outfitscited by 15
- 2019End-to-End Learning of Geometric Deformations of Feature Maps for Virtual Try-Oncited by 8
- 2018The GAN that Warped: Semantic Attribute Editing with Unpaired Datacited by 7
- 2017Learning Unified Embedding for Apparel Recognitioncited by 3
- 2020S2cGAN: Semi-Supervised Training of Conditional GANs with Fewer Labelscited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 16; 2023: 8; 2024: 4; 2025: 1.
31 papers.
Sort:
By area:
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 161
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2023TryOnDiffusion: A Tale of Two UNetscited by 141
- 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 2022InsetGAN for Full-Body Image Generationcited by 45
- 2023Single-Image 3D Human Digitization with Shape-Guided Diffusioncited by 42
- 2022Self-Distilled StyleGAN: Towards Generation from Internet Photoscited by 37
- 2022BlobGAN: Spatially Disentangled Scene Representationscited by 35
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Imagescited by 34
19 more
- 2022Text2Human: Text-Driven Controllable Human Image Generationcited by 31
- 2024M&M VTO: Multi-Garment Virtual Try-On and Editingcited by 29
- 2022Rewriting Geometric Rules of a GANcited by 25
- 2023AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusioncited by 20
- 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesiscited by 20
- 2023Image-Based Virtual Try-On: A Surveycited by 19
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-Oncited by 16
- 2021Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesiscited by 14
- 2023Vision + Language Applications: A Surveycited by 8
- 2022Content-Based Search for Deep Generative Modelscited by 7
- 2022DeepPortraitDrawing: Generating Human Body Images from Freehand Sketchescited by 5
- 2022FitGAN: Fit- and Shape-Realistic Generative Adversarial Networks for Fashioncited by 4
- 2024TryOn-Adapter: Efficient Fine-Grained Clothing Identity Adaptation for High-Fidelity Virtual Try-Oncited by 3
- 2025DEFT-VTON: Efficient Virtual Try-On with Consistent Generalised H-Transformcited by 2
- 2022Probing TryOnGANcited by 1
- 2022SizeGAN: Improving Size Representation in Clothing Catalogscited by 1
- 2022Single Stage Multi-Pose Virtual Try-Oncited by 1
- 2024Size-Variable Virtual Try-On with Physical Clothes Sizecited by 1
- 2023One-Shot Stylization for Full-Body Human Imagescited by 0
- 2025DEFT-VTON: Efficient Virtual Try-On with Consistent Generalised H-Transform16 Sep 2025
- 2024Size-Variable Virtual Try-On with Physical Clothes Size9 Dec 2024
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-On31 Oct 2024
- 2024M&M VTO: Multi-Garment Virtual Try-On and Editing6 Jun 2024
- 2024TryOn-Adapter: Efficient Fine-Grained Clothing Identity Adaptation for High-Fidelity Virtual Try-On1 Apr 2024
- 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images27 Nov 2023
- 2023Single-Image 3D Human Digitization with Shape-Guided Diffusion15 Nov 2023
- 2023Image-Based Virtual Try-On: A Survey8 Nov 2023
- 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesis15 Aug 2023
- 2023AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion13 Jul 2023
- 2023TryOnDiffusion: A Tale of Two UNets14 Jun 2023
- 2023Vision + Language Applications: A Survey24 May 2023
19 more
- 2023One-Shot Stylization for Full-Body Human Images14 Apr 2023
- 2022Single Stage Multi-Pose Virtual Try-On19 Nov 2022
- 2022SizeGAN: Improving Size Representation in Clothing Catalogs5 Nov 2022
- 2022Content-Based Search for Deep Generative Models6 Oct 2022
- 2022Rewriting Geometric Rules of a GAN28 Jul 2022
- 2022FitGAN: Fit- and Shape-Realistic Generative Adversarial Networks for Fashion23 Jun 2022
- 2022Text2Human: Text-Driven Controllable Human Image Generation31 May 2022
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars17 May 2022
- 2022BlobGAN: Spatially Disentangled Scene Representations5 May 2022
- 2022DeepPortraitDrawing: Generating Human Body Images from Freehand Sketches4 May 2022
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generation25 Apr 2022
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-On18 Apr 2022
- 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesis13 Apr 2022
- 2022InsetGAN for Full-Body Image Generation14 Mar 2022
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGAN28 Feb 2022
- 2022Self-Distilled StyleGAN: Towards Generation from Internet Photos24 Feb 2022
- 2022Probing TryOnGAN5 Jan 2022
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editing30 Nov 2021
- 2021Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesis10 Nov 2021
- 2023Single-Image 3D Human Digitization with Shape-Guided Diffusioncited by 42
- 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesiscited by 20
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-Oncited by 16
- 2025DEFT-VTON: Efficient Virtual Try-On with Consistent Generalised H-Transformcited by 2
- 2025DEFT-VTON: Efficient Virtual Try-On with Consistent Generalised H-Transform16 Sep 2025
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-On31 Oct 2024
- 2023Single-Image 3D Human Digitization with Shape-Guided Diffusion15 Nov 2023
- 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesis15 Aug 2023
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 161
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 143
- 2023TryOnDiffusion: A Tale of Two UNetscited by 141
- 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
- 2022AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatarscited by 55
- 2022InsetGAN for Full-Body Image Generationcited by 45
- 2022Self-Distilled StyleGAN: Towards Generation from Internet Photoscited by 37
- 2022BlobGAN: Spatially Disentangled Scene Representationscited by 35
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Imagescited by 34
- 2022Text2Human: Text-Driven Controllable Human Image Generationcited by 31
12 most cited of 27 All 27 (JSON)
- 2024Size-Variable Virtual Try-On with Physical Clothes Size9 Dec 2024
- 2024M&M VTO: Multi-Garment Virtual Try-On and Editing6 Jun 2024
- 2024TryOn-Adapter: Efficient Fine-Grained Clothing Identity Adaptation for High-Fidelity Virtual Try-On1 Apr 2024
- 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images27 Nov 2023
- 2023Image-Based Virtual Try-On: A Survey8 Nov 2023
- 2023AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion13 Jul 2023
- 2023TryOnDiffusion: A Tale of Two UNets14 Jun 2023
- 2023Vision + Language Applications: A Survey24 May 2023
- 2023One-Shot Stylization for Full-Body Human Images14 Apr 2023
- 2022Single Stage Multi-Pose Virtual Try-On19 Nov 2022
- 2022SizeGAN: Improving Size Representation in Clothing Catalogs5 Nov 2022
- 2022Content-Based Search for Deep Generative Models6 Oct 2022
12 newest of 27 All 27 (JSON)