mlsanityData to 7 Oct 2026

TryOnDiffusion: A Tale of Two UNets

arXiv 2306.08276 ↗First posted 14 Jun 2023cs.CV cs.GRcited by 141

Not on the map. Why?

Cited by 61 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Given two images depicting a person and a garment worn by another person, our goal is to generate a visualization of how the garment might look on the input person. A key challenge is to synthesize a photorealistic detail-preserving visualization of the garment, while warping the garment to accommodate a significant body pose and shape change across the subjects. Previous methods either focus on garment detail preservation without effective pose and shape variation, or allow try-on with the desired shape and pose but lack garment details. In this paper, we propose a diffusion-based architecture that unifies two UNets (referred to as Parallel-UNet), which allows us to preserve garment details and warp the garment for significant pose and body change in a single network. The key ideas behind Parallel-UNet include: 1) garment is warped implicitly via a cross attention mechanism, 2) garment warp and person blend happen as part of a unified process as opposed to a sequence of two separate tasks. Experimental results indicate that TryOnDiffusion achieves state-of-the-art performance both qualitatively and quantitatively.

Key facts. Cited by 141 papers in the map (data through 7 Oct 2026). Builds on 42 of its 56 references that are in the map. First posted on arXiv 14 Jun 2023.

Builds on

42 of 56 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
30 more
  1. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  2. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  4. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  5. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  6. 2018Group Normalizationcited by 1,514
  7. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  8. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  9. 2018Demystifying MMD GANscited by 1,268
  10. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  11. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  12. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  13. 2022Novel View Synthesis with Diffusion Modelscited by 299
  14. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  15. 2017VITON: An Image-based Virtual Try-on Networkcited by 285
  16. 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
  17. 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
  18. 2022FILM: Frame Interpolation for Large Motioncited by 149
  19. 2020Towards Photo-Realistic Virtual Try-On by Adaptively GeneratingleftrightarrowPreserving Image Contentcited by 148
  20. 2021Parser-Free Virtual Try-on via Distilling Appearance Flowscited by 142
  21. 2017Towards Accurate Multi-person Pose Estimation in the Wildcited by 131
  22. 2022High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditionscited by 129
  23. 2022Style-Based Global Appearance Flow for Virtual Try-Oncited by 88
  24. 2019Graphonomy: Universal Human Parsing via Graph Transfer Learningcited by 81
  25. 2020Do Not Mask What You Do Not Need to Mask: a Parser-Free Virtual Try-Oncited by 77
  26. 2022Single Stage Virtual Try-on via Deformable Attention Flowscited by 64
  27. 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
  28. 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
  29. 2021TryOnGAN: Body-Aware Try-On via Layered Interpolationcited by 31
  30. 2022Dressing in the Wild by Watching Dance Videoscited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 13; 2024: 56; 2025: 45; 2026: 27.

141 papers.

Sort:

By area:

  1. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  2. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  3. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  4. 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 173
  5. 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 150
  6. 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wildcited by 109
  7. 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
  8. 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
  9. 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
  10. 2024Video Interpolation with Diffusion Modelscited by 67
  11. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 62
  12. 2024A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)cited by 58
38 more
  1. 2023CAT-DM: Controllable Accelerated Virtual Try-on with Diffusion Modelcited by 48
  2. 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 42
  3. 2024Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-Oncited by 38
  4. 2024ViViD: Video Virtual Try-on using Diffusion Modelscited by 38
  5. 2024CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attentioncited by 38
  6. 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Imagescited by 34
  7. 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
  8. 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 30
  9. 2023SSMG: Spatial-Semantic Map Guided Diffusion Model for Free-form Layout-to-Image Generationcited by 29
  10. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  11. 2024M&M VTO: Multi-Garment Virtual Try-On and Editingcited by 29
  12. 2024StableGarment: Garment-Centric Generation via Stable Diffusioncited by 27
  13. 2024Learning Flow Fields in Attention for Controllable Person Image Generationcited by 27
  14. 2024MV-VTON: Multi-View Virtual Try-On with Diffusion Modelscited by 25
  15. 2024MMTryon: Multi-Modal Multi-Reference Control for High-Quality Fashion Generationcited by 22
  16. 2024AnyFit: Controllable Virtual Try-on for Any Combination of Attire Across Any Scenariocited by 22
  17. 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Modelscited by 22
  18. 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillationcited by 21
  19. 2023Image-Based Virtual Try-On: A Surveycited by 19
  20. 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinementcited by 19
  21. 2023WarpDiffusion: Efficient Diffusion Model for High-Fidelity Virtual Try-oncited by 18
  22. 2024OutfitAnyone: Ultra-high Quality Virtual Try-On for Any Clothing and Any Personcited by 16
  23. 2024Fashion-VDM: Video Diffusion Model for Virtual Try-Oncited by 16
  24. 2024TCAN: Animating Human Images with Temporally Consistent Pose Guidance using Diffusion Modelscited by 15
  25. 2024Improving Virtual Try-On with Garment-focused Diffusion Modelscited by 15
  26. 2023PICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsignscited by 14
  27. 2024VirtualModel: Generating Object-ID-retentive Human-object Interaction Image by Diffusion Model for E-commerce Marketingcited by 14
  28. 2024Instant 3D Human Avatar Generation using Image Diffusion Modelscited by 14
  29. 2024FLDM-VTON: Faithful Latent Diffusion Model for Virtual Try-oncited by 13
  30. 2024GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splattingcited by 13
  31. 2025OmniTry: Virtual Try-On Anything without Maskscited by 13
  32. 2023UniHuman: A Unified Model for Editing Human Images in the Wildcited by 12
  33. 2024Diffuse to Choose: Enriching Image Conditioned Inpainting in Latent Diffusion Models for Virtual Try-Allcited by 11
  34. 2024VTON-HandFit: Virtual Try-on for Arbitrary Hand Pose Guided by Hand Priors Embeddingcited by 11
  35. 2025Pursuing Temporal-Consistent Video Virtual Try-On via Dynamic Pose Interactioncited by 11
  36. 2024Alignment is All You Need: A Training-free Augmentation Strategy for Pose-guided Video Generationcited by 10
  37. 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Directioncited by 10
  38. 2025ITA-MDT: Image-Timestep-Adaptive Masked Diffusion Transformer Framework for Image-Based Virtual Try-Oncited by 10

50 most cited of 141 All 141 (JSON)