mlsanityData to 14 Oct 2026

MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on

arXiv 2505.21325 ↗First posted 27 May 2025cs.CVcited by 15

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Video Virtual Try-On (VVT) aims to synthesize garments that appear natural across consecutive video frames, capturing both their dynamics and interactions with human motion. Despite recent progress, existing VVT methods still suffer from inadequate garment fidelity and limited spatiotemporal consistency. The reasons are: (1) under-exploitation of garment information, with limited garment cues being injected, resulting in weaker fine-detail fidelity; and (2) a lack of spatiotemporal modeling, which hampers cross-frame identity consistency and causes temporal jitter and appearance drift. In this paper, we present MagicTryOn, a diffusion-transformer based framework for garment-preserving video virtual try-on. To preserve fine-grained garment details, we propose a fine-grained garment-preservation strategy that disentangles garment cues and injects these decomposed priors into the denoising process. To improve temporal garment consistency and suppress jitter, we introduce a garment-aware spatiotemporal rotary positional embedding (RoPE) that extends RoPE within full self-attention, using spatiotemporal relative positions to modulate garment tokens. We further impose a mask-aware loss during training to enhance fidelity within garment regions. Moreover, we adopt distribution-matching distillation to compress the sampling trajectory to four steps, enabling real-time inference without degrading garment fidelity. Extensive quantitative and qualitative experiments demonstrate that MagicTryOn outperforms existing methods, delivering superior garment-detail fidelity and temporal stability in unconstrained settings.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 57 of its 65 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

57 of 65 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Pursuing Temporal-Consistent Video Virtual Try-On via Dynamic Pose Interaction22 May
  2. 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenation20 Jan
  3. 2025MC-VTON: Minimal Control Virtual Try-On Diffusion Transformer7 Jan
  4. 2024Fashion-VDM: Video Diffusion Model for Virtual Try-On31 Oct
  5. 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models21 Jul
  6. 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models15 Jul
  7. 2024ViViD: Video Virtual Try-on using Diffusion Models20 May
  8. 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wild8 Mar
  9. 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on4 Mar
  10. 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis28 Feb
  11. 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On4 Dec
  12. 2023Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flow11 Aug
1 more
  1. 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On22 May

Other references · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  10. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
32 more
  1. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  2. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  3. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  4. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  5. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  6. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  7. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  8. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  9. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  10. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  11. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  12. 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 162
  13. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  14. 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
  15. 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
  16. 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
  17. 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
  18. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
  19. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  20. 2023I2V-Adapter: A General Image-to-Video Adapter for Diffusion Modelscited by 70
  21. 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesiscited by 59
  22. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
  23. 2024FitDiT: Advancing the Authentic Garment Details for High-fidelity Virtual Try-oncited by 40
  24. 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
  25. 2024TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Modelscited by 31
  26. 2024Learning Flow Fields in Attention for Controllable Person Image Generationcited by 27
  27. 2022ClothFormer:Taming Video Virtual Try-on in All Modulecited by 26
  28. 2024Revisiting Non-Autoregressive Transformers for Efficient Image Synthesiscited by 22
  29. 2024VTON-HandFit: Virtual Try-on for Arbitrary Hand Pose Guided by Hand Priors Embeddingcited by 11
  30. 2025RealVVT: Towards Photorealistic Video Virtual Try-on via Spatio-Temporal Consistencycited by 8
  31. 2024Adapting Diffusion Models for Improved Prompt Compliance and Controllable Image Synthesiscited by 4
  32. 2025CrossVTON: Mimicking the Logic Reasoning on Cross-category Virtual Try-on guided by Tri-zone Priorscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 12.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanism
  2. 2025The devil is in the details: Enhancing Video Virtual Try-On via Keyframe-Driven Details Injection
  3. 2024SwiftTry: Fast and Consistent Video Virtual Try-On with Diffusion Models
  4. 2025DiffFit: Disentangled Garment Warping and Texture Refinement for Virtual Try-On
  5. 2026Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision
  6. 20253DV-TON: Textured 3D-Guided Consistent Video Try-on via Diffusion Models
  7. 2024Improving Virtual Try-On with Garment-focused Diffusion Models
  8. 2025Incorporating Visual Correspondence into Diffusion Model for Virtual Try-On