# TryOnGAN: Body-Aware Try-On via Layered Interpolation

arXiv: https://arxiv.org/abs/2101.02285 · HTML: https://mlsanity.com/paper/2101.02285/

## Key facts

- Cited by 31 papers in the map (data through 14 Oct 2026).
- Builds on 30 of its 43 references that are in the map.
- First posted on arXiv 6 Jan 2021.

## Builds on (most cited first, 30 of 30)

- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [Analyzing and Improving the Image Quality of StyleGAN](https://mlsanity.com/paper/1912.04958/) (2019)
- [Progressive Growing of GANs for Improved Quality, Stability, and Variation](https://mlsanity.com/paper/1710.10196/) (2017)
- [Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization](https://mlsanity.com/paper/1703.06868/) (2017)
- [High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs](https://mlsanity.com/paper/1711.11585/) (2017)
- [Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation](https://mlsanity.com/paper/2008.00951/) (2020)
- [In-Domain GAN Inversion for Real Image Editing](https://mlsanity.com/paper/2004.00049/) (2020)
- [Image2StyleGAN++: How to Edit the Embedded Images?](https://mlsanity.com/paper/1911.11544/) (2019)
- [A Learned Representation For Artistic Style](https://mlsanity.com/paper/1610.07629/) (2016)
- [VITON: An Image-based Virtual Try-on Network](https://mlsanity.com/paper/1711.08447/) (2017)
- [Toward Characteristic-Preserving Image-based Virtual Try-On Network](https://mlsanity.com/paper/1807.07688/) (2018)
- [Editing in Style: Uncovering the Local Semantics of GANs](https://mlsanity.com/paper/2004.14367/) (2020)
- [Controllable Person Image Synthesis with Attribute-Decomposed GAN](https://mlsanity.com/paper/2003.12267/) (2020)
- [Towards Photo-Realistic Virtual Try-On by Adaptively GeneratingleftrightarrowPreserving Image Content](https://mlsanity.com/paper/2003.05863/) (2020)
- [Towards Multi-pose Guided Virtual Try-on Network](https://mlsanity.com/paper/1902.11026/) (2019)
- [Exploring the structure of a real-time, arbitrary neural artistic stylization network](https://mlsanity.com/paper/1705.06830/) (2017)
- [Graphonomy: Universal Human Parsing via Graph Transfer Learning](https://mlsanity.com/paper/1904.04536/) (2019)
- [Disentangled Image Generation Through Structured Noise Injection](https://mlsanity.com/paper/2004.12411/) (2020)
- [Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network](https://mlsanity.com/paper/2010.05713/) (2020)
- [M2E-Try On Net: Fashion from Model to Everyone](https://mlsanity.com/paper/1811.08599/) (2018)
- [Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis](https://mlsanity.com/paper/2011.09055/) (2020)
- [SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On](https://mlsanity.com/paper/2001.06265/) (2020)
- [GarmentGAN: Photo-realistic Adversarial Fashion Transfer](https://mlsanity.com/paper/2003.01894/) (2020)
- [Generating High-Resolution Fashion Model Images Wearing Custom Outfits](https://mlsanity.com/paper/1908.08847/) (2019)
- [End-to-End Learning of Geometric Deformations of Feature Maps for Virtual Try-On](https://mlsanity.com/paper/1906.01347/) (2019)
- [The GAN that Warped: Semantic Attribute Editing with Unpaired Data](https://mlsanity.com/paper/1811.12784/) (2018)
- [Learning Unified Embedding for Apparel Recognition](https://mlsanity.com/paper/1707.05929/) (2017)
- [S2cGAN: Semi-Supervised Training of Conditional GANs with Fewer Labels](https://mlsanity.com/paper/2010.12622/) (2020)

## Built on by (most cited first, 30 of 31)

- [HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editing](https://mlsanity.com/paper/2111.15666/) (2021)
- [Dress Code: High-Resolution Multi-Category Virtual Try-On](https://mlsanity.com/paper/2204.08532/) (2022)
- [StyleGAN-Human: A Data-Centric Odyssey of Human Generation](https://mlsanity.com/paper/2204.11823/) (2022)
- [TryOnDiffusion: A Tale of Two UNets](https://mlsanity.com/paper/2306.08276/) (2023)
- [Neural Texture Extraction and Distribution for Controllable Person Image Synthesis](https://mlsanity.com/paper/2204.06160/) (2022)
- [AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars](https://mlsanity.com/paper/2205.08535/) (2022)
- [InsetGAN for Full-Body Image Generation](https://mlsanity.com/paper/2203.07293/) (2022)
- [Single-Image 3D Human Digitization with Shape-Guided Diffusion](https://mlsanity.com/paper/2311.09221/) (2023)
- [Self-Distilled StyleGAN: Towards Generation from Internet Photos](https://mlsanity.com/paper/2202.12211/) (2022)
- [BlobGAN: Spatially Disentangled Scene Representations](https://mlsanity.com/paper/2205.02837/) (2022)
- [State-of-the-Art in the Architecture, Methods and Applications of StyleGAN](https://mlsanity.com/paper/2202.14020/) (2022)
- [Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images](https://mlsanity.com/paper/2311.16094/) (2023)
- [Text2Human: Text-Driven Controllable Human Image Generation](https://mlsanity.com/paper/2205.15996/) (2022)
- [M&M VTO: Multi-Garment Virtual Try-On and Editing](https://mlsanity.com/paper/2406.04542/) (2024)
- [Rewriting Geometric Rules of a GAN](https://mlsanity.com/paper/2207.14288/) (2022)
- [AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion](https://mlsanity.com/paper/2307.06526/) (2023)
- [SGDiff: A Style Guided Diffusion Model for Fashion Synthesis](https://mlsanity.com/paper/2308.07605/) (2023)
- [Image-Based Virtual Try-On: A Survey](https://mlsanity.com/paper/2311.04811/) (2023)
- [Fashion-VDM: Video Diffusion Model for Virtual Try-On](https://mlsanity.com/paper/2411.00225/) (2024)
- [Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesis](https://mlsanity.com/paper/2111.05916/) (2021)
- [Vision + Language Applications: A Survey](https://mlsanity.com/paper/2305.14598/) (2023)
- [Content-Based Search for Deep Generative Models](https://mlsanity.com/paper/2210.03116/) (2022)
- [DeepPortraitDrawing: Generating Human Body Images from Freehand Sketches](https://mlsanity.com/paper/2205.02070/) (2022)
- [FitGAN: Fit- and Shape-Realistic Generative Adversarial Networks for Fashion](https://mlsanity.com/paper/2206.11768/) (2022)
- [TryOn-Adapter: Efficient Fine-Grained Clothing Identity Adaptation for High-Fidelity Virtual Try-On](https://mlsanity.com/paper/2404.00878/) (2024)
- [DEFT-VTON: Efficient Virtual Try-On with Consistent Generalised H-Transform](https://mlsanity.com/paper/2509.13506/) (2025)
- [Probing TryOnGAN](https://mlsanity.com/paper/2201.01703/) (2022)
- [SizeGAN: Improving Size Representation in Clothing Catalogs](https://mlsanity.com/paper/2211.02892/) (2022)
- [Single Stage Multi-Pose Virtual Try-On](https://mlsanity.com/paper/2211.10715/) (2022)
- [Size-Variable Virtual Try-On with Physical Clothes Size](https://mlsanity.com/paper/2412.06201/) (2024)

## Abstract (arXiv)

Given a pair of images-target person and garment on another person-we automatically generate the target person in the given garment. Previous methods mostly focused on texture transfer via paired data training, while overlooking body shape deformations, skin color, and seamless blending of garment with the person. This work focuses on those three components, while also not requiring paired data training. We designed a pose conditioned StyleGAN2 architecture with a clothing segmentation branch that is trained on images of people wearing garments. Once trained, we propose a new layered latent space interpolation method that allows us to preserve and synthesize skin color and target body shape while transferring the garment from a different person. We demonstrate results on high resolution 512x512 images, and extensively compare to state of the art in try-on on both latent space generated and real images.