# Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images

arXiv: https://arxiv.org/abs/2311.16094 · HTML: https://mlsanity.com/paper/2311.16094/

## Key facts

- Cited by 34 papers in the map (data through 14 Oct 2026).
- Builds on 32 of its 43 references that are in the map.
- First posted on arXiv 27 Nov 2023.

## Builds on (most cited first, 30 of 32)

- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Hierarchical Text-Conditional Image Generation with CLIP Latents](https://mlsanity.com/paper/2204.06125/) (2022)
- [Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding](https://mlsanity.com/paper/2205.11487/) (2022)
- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [Adding Conditional Control to Text-to-Image Diffusion Models](https://mlsanity.com/paper/2302.05543/) (2023)
- [Free-Form Image Inpainting with Gated Convolution](https://mlsanity.com/paper/1806.03589/) (2018)
- [DensePose: Dense Human Pose Estimation In The Wild](https://mlsanity.com/paper/1802.00434/) (2018)
- [StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets](https://mlsanity.com/paper/2202.00273/) (2022)
- [VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization](https://mlsanity.com/paper/2103.16874/) (2021)
- [VITON: An Image-based Virtual Try-on Network](https://mlsanity.com/paper/1711.08447/) (2017)
- [Self-Correction for Human Parsing](https://mlsanity.com/paper/1910.09777/) (2019)
- [Dress Code: High-Resolution Multi-Category Virtual Try-On](https://mlsanity.com/paper/2204.08532/) (2022)
- [Controllable Person Image Synthesis with Attribute-Decomposed GAN](https://mlsanity.com/paper/2003.12267/) (2020)
- [StyleGAN-Human: A Data-Centric Odyssey of Human Generation](https://mlsanity.com/paper/2204.11823/) (2022)
- [Parser-Free Virtual Try-on via Distilling Appearance Flows](https://mlsanity.com/paper/2103.04559/) (2021)
- [TryOnDiffusion: A Tale of Two UNets](https://mlsanity.com/paper/2306.08276/) (2023)
- [DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Images](https://mlsanity.com/paper/1901.07973/) (2019)
- [High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditions](https://mlsanity.com/paper/2206.14180/) (2022)
- [GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learning](https://mlsanity.com/paper/2303.13756/) (2023)
- [Towards Multi-pose Guided Virtual Try-on Network](https://mlsanity.com/paper/1902.11026/) (2019)
- [Style-Based Global Appearance Flow for Virtual Try-On](https://mlsanity.com/paper/2204.01046/) (2022)
- [Single Stage Virtual Try-on via Deformable Attention Flows](https://mlsanity.com/paper/2207.09161/) (2022)
- [Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing](https://mlsanity.com/paper/2104.07021/) (2021)
- [Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN](https://mlsanity.com/paper/2109.06166/) (2021)
- [Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN](https://mlsanity.com/paper/2111.10544/) (2021)
- [TryOnGAN: Body-Aware Try-On via Layered Interpolation](https://mlsanity.com/paper/2101.02285/) (2021)
- [Dressing in the Wild by Watching Dance Videos](https://mlsanity.com/paper/2203.15320/) (2022)
- [PASTA-GAN++: A Versatile Framework for High-Resolution Unpaired Virtual Try-on](https://mlsanity.com/paper/2207.13475/) (2022)

## Built on by (most cited first, 30 of 34)

- [Improving Diffusion Models for Authentic Virtual Try-on in the Wild](https://mlsanity.com/paper/2403.05139/) (2024)
- [Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks](https://mlsanity.com/paper/2501.15891/) (2025)
- [BooW-VTON: Boosting In-the-Wild Virtual Try-On via Mask-Free Pseudo Data Training](https://mlsanity.com/paper/2408.06047/) (2024)
- [Learning Flow Fields in Attention for Controllable Person Image Generation](https://mlsanity.com/paper/2412.08486/) (2024)
- [Fashion-VDM: Video Diffusion Model for Virtual Try-On](https://mlsanity.com/paper/2411.00225/) (2024)
- [DreamFit: Garment-Centric Human Generation via a Lightweight Anything-Dressing Encoder](https://mlsanity.com/paper/2412.17644/) (2024)
- [OmniVTON: Training-Free Universal Virtual Try-On](https://mlsanity.com/paper/2507.15037/) (2025)
- [TED-VITON: Transformer-Empowered Diffusion Models for Virtual Try-On](https://mlsanity.com/paper/2411.17017/) (2024)
- [MF-VITON: High-Fidelity Mask-Free Virtual Try-On with Minimal Input](https://mlsanity.com/paper/2503.08650/) (2025)
- [VTBench: Comprehensive Benchmark Suite Towards Real-World Virtual Try-on Models](https://mlsanity.com/paper/2505.19571/) (2025)
- [IGR: Improving Diffusion Model for Garment Restoration from Person Image](https://mlsanity.com/paper/2412.11513/) (2024)
- [Better Fit: Accommodate Variations in Clothing Types for Virtual Try-on](https://mlsanity.com/paper/2403.08453/) (2024)
- [Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessories](https://mlsanity.com/paper/2603.14153/) (2026)
- [TryOn-Adapter: Efficient Fine-Grained Clothing Identity Adaptation for High-Fidelity Virtual Try-On](https://mlsanity.com/paper/2404.00878/) (2024)
- [TripVVT: A Large-Scale Triplet Dataset and a Coarse-Mask Baseline for In-the-Wild Video Virtual Try-On](https://mlsanity.com/paper/2604.27958/) (2026)
- [MFP-VTON: Enhancing Mask-Free Person-to-Person Virtual Try-On via Diffusion Transformer](https://mlsanity.com/paper/2502.01626/) (2025)
- [MuGa-VTON: Multi-Garment Virtual Try-On via Diffusion Transformers with Prompt Customization](https://mlsanity.com/paper/2508.08488/) (2025)
- [OpenVTON-Bench: A Large-Scale High-Resolution Benchmark for Controllable Virtual Try-On Evaluation](https://mlsanity.com/paper/2601.22725/) (2026)
- [Mobile-VTON: High-Fidelity On-Device Virtual Try-On](https://mlsanity.com/paper/2603.00947/) (2026)
- [One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusion](https://mlsanity.com/paper/2508.04559/) (2025)
- [RefTon: Reference person shot assist virtual Try-on](https://mlsanity.com/paper/2511.00956/) (2025)
- [VTEdit-Bench: A Comprehensive Benchmark for Multi-Reference Image Editing Models in Virtual Try-On](https://mlsanity.com/paper/2603.11734/) (2026)
- [Try-On-Adapter: A Simple and Flexible Try-On Paradigm](https://mlsanity.com/paper/2411.10187/) (2024)
- [FashionComposer: Compositional Fashion Image Generation](https://mlsanity.com/paper/2412.14168/) (2024)
- [Fashionability-Enhancing Outfit Image Editing with Conditional Diffusion Models](https://mlsanity.com/paper/2412.18421/) (2024)
- [Diffusion Model-Based Size Variable Virtual Try-On Technology and Evaluation Method](https://mlsanity.com/paper/2504.00562/) (2025)
- [TalkFashion: Intelligent Virtual Try-On Assistant Based on Multimodal Large Language Model](https://mlsanity.com/paper/2507.05790/) (2025)
- [OmniVTON++: Training-Free Universal Virtual Try-On with Principal Pose Guidance](https://mlsanity.com/paper/2602.14552/) (2026)
- [Dress-ED: Instruction-Guided Editing for Virtual Try-On and Try-Off](https://mlsanity.com/paper/2603.22607/) (2026)
- [FIT: A Large-Scale Dataset for Fit-Aware Virtual Try-On](https://mlsanity.com/paper/2604.08526/) (2026)

## Abstract (arXiv)

Most virtual try-on research is motivated to serve the fashion business by generating images to demonstrate garments on studio models at a lower cost. However, virtual try-on should be a broader application that also allows customers to visualize garments on themselves using their own casual photos, known as in-the-wild try-on. Unfortunately, the existing methods, which achieve plausible results for studio try-on settings, perform poorly in the in-the-wild context. This is because these methods often require paired images (garment images paired with images of people wearing the same garment) for training. While such paired data is easy to collect from shopping websites for studio settings, it is difficult to obtain for in-the-wild scenes. In this work, we fill the gap by (1) introducing a StreetTryOn benchmark to support in-the-wild virtual try-on applications and (2) proposing a novel method to learn virtual try-on from a set of in-the-wild person images directly without requiring paired data. We tackle the unique challenges, including warping garments to more diverse human poses and rendering more complex backgrounds faithfully, by a novel DensePose warping correction method combined with diffusion-based conditional inpainting. Our experiments show competitive performance for standard studio try-on tasks and SOTA performance for street try-on and cross-domain try-on tasks.
