mlsanityData to 14 Oct 2026

Fashion-VDM: Video Diffusion Model for Virtual Try-On

arXiv 2411.00225 ↗First posted 31 Oct 2024cs.CVcited by 16

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We present Fashion-VDM, a video diffusion model (VDM) for generating virtual try-on videos. Given an input garment image and person video, our method aims to generate a high-quality try-on video of the person wearing the given garment, while preserving the person's identity and motion. Image-based virtual try-on has shown impressive results; however, existing video virtual try-on (VVT) methods are still lacking garment details and temporal consistency. To address these issues, we propose a diffusion-based architecture for video virtual try-on, split classifier-free guidance for increased control over the conditioning inputs, and a progressive temporal training strategy for single-pass 64-frame, 512px video generation. We also demonstrate the effectiveness of joint image-video training for video try-on, especially when video data is limited. Our qualitative and quantitative experiments show that our approach sets the new state-of-the-art for video virtual try-on. For additional results, visit our project page: https://johannakarras.github.io/Fashion-VDM.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 37 of its 55 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

37 of 55 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023WarpDiffusion: Efficient Diffusion Model for High-Fidelity Virtual Try-on6 Dec
  2. 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On4 Dec

Other references · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  8. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  10. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  11. 2016Deep Networks with Stochastic Depthcited by 979
  12. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 740
23 more
  1. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  2. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
  3. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  4. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  5. 2017VITON: An Image-based Virtual Try-on Networkcited by 286
  6. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
  7. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
  8. 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
  9. 2023TryOnDiffusion: A Tale of Two UNetscited by 141
  10. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
  11. 2022High-Resolution Virtual Try-On with Misalignment and Occlusion-Handled Conditionscited by 130
  12. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
  13. 2022Style-Based Global Appearance Flow for Virtual Try-Oncited by 88
  14. 2019Graphonomy: Universal Human Parsing via Graph Transfer Learningcited by 81
  15. 2022VIDM: Video Implicit Diffusion Modelscited by 78
  16. 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
  17. 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
  18. 2023Reuse and Diffuse: Iterative Denoising for Text-to-Video Generationcited by 50
  19. 2023Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Imagescited by 34
  20. 2021TryOnGAN: Body-Aware Try-On via Layered Interpolationcited by 31
  21. 2021MV-TON: Memory-based Video Virtual Try-on networkcited by 23
  22. 2022Dressing in the Wild by Watching Dance Videoscited by 20
  23. 2023Soundini: Sound-Guided Diffusion for Natural Video Editingcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 9; 2026: 5.

16 papers.

Sort:

By area:

  1. 2025VIVA: VLM-Guided Instruction-Based Video Editing with Reward Optimizationcited by 16
  2. 2025MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-oncited by 15
  3. 2025Human-Centric Foundation Models: Perception, Generation and Agentic Modelingcited by 12
  4. 2025Voost: A Unified and Scalable Diffusion Transformer for Bidirectional Virtual Try-On and Try-Offcited by 8
  5. 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanismcited by 7
  6. 2024IGR: Improving Diffusion Model for Garment Restoration from Person Imagecited by 5
  7. 2026iTryOn: Mastering Interactive Video Virtual Try-On with Spatial-Semantic Guidancecited by 4
  8. 2026TripVVT: A Large-Scale Triplet Dataset and a Coarse-Mask Baseline for In-the-Wild Video Virtual Try-Oncited by 3
  9. 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxycited by 3
  10. 2025Dress&Dance: Dress up and Dance as You Like It - Technical Previewcited by 2
  11. 2025Low-Barrier Dataset Collection with Real Human Body for Interactive Per-Garment Virtual Try-Oncited by 1
  12. 2025Real-Time Per-Garment Virtual Try-On with Temporal Consistency for Loose-Fitting Garmentscited by 1
4 more
  1. 2025Virtual Fitting Room: Generating Arbitrarily Long Videos of Virtual Try-On from a Single Image -- Technical Previewcited by 0
  2. 2025From Mannequin to Human: A Pose-Aware and Identity-Preserving Video Generation Framework for Lifelike Clothing Displaycited by 0
  3. 2026Joint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomycited by 0
  4. 2026TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models
  2. 2025Once Is Enough: Lightweight DiT-Based Video Virtual Try-On via One-Time Garment Appearance Injection
  3. 2024ViViD: Video Virtual Try-on using Diffusion Models
  4. 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework
  5. 2024SwiftTry: Fast and Consistent Video Virtual Try-On with Diffusion Models
  6. 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenation
  7. 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wild
  8. 2025Pursuing Temporal-Consistent Video Virtual Try-On via Dynamic Pose Interaction