MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Video Virtual Try-On (VVT) aims to synthesize garments that appear natural across consecutive video frames, capturing both their dynamics and interactions with human motion. Despite recent progress, existing VVT methods still suffer from inadequate garment fidelity and limited spatiotemporal consistency. The reasons are: (1) under-exploitation of garment information, with limited garment cues being injected, resulting in weaker fine-detail fidelity; and (2) a lack of spatiotemporal modeling, which hampers cross-frame identity consistency and causes temporal jitter and appearance drift. In this paper, we present MagicTryOn, a diffusion-transformer based framework for garment-preserving video virtual try-on. To preserve fine-grained garment details, we propose a fine-grained garment-preservation strategy that disentangles garment cues and injects these decomposed priors into the denoising process. To improve temporal garment consistency and suppress jitter, we introduce a garment-aware spatiotemporal rotary positional embedding (RoPE) that extends RoPE within full self-attention, using spatiotemporal relative positions to modulate garment tokens. We further impose a mask-aware loss during training to enhance fidelity within garment regions. Moreover, we adopt distribution-matching distillation to compress the sampling trajectory to four steps, enabling real-time inference without degrading garment fidelity. Extensive quantitative and qualitative experiments demonstrate that MagicTryOn outperforms existing methods, delivering superior garment-detail fidelity and temporal stability in unconstrained settings.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 57 of its 65 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
57 of 65 references.
Closest ancestors · 13
Same direction, newest first
- 2025Pursuing Temporal-Consistent Video Virtual Try-On via Dynamic Pose Interaction22 May
- 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenation20 Jan
- 2025MC-VTON: Minimal Control Virtual Try-On Diffusion Transformer7 Jan
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-On31 Oct
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models21 Jul
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models15 Jul
- 2024ViViD: Video Virtual Try-on using Diffusion Models20 May
- 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wild8 Mar
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on4 Mar
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis28 Feb
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On4 Dec
- 2023Taming the Power of Diffusion Models for High-Quality Virtual Try-On with Appearance Flow11 Aug
Other references · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Generative Adversarial Networkscited by 5,627
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
32 more
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 162
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2023GP-VTON: Towards General Purpose Virtual Try-on via Collaborative Local-Flow Global-Parsing Learningcited by 120
- 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
- 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Modelcited by 89
- 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Modelscited by 86
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2023I2V-Adapter: A General Image-to-Video Adapter for Diffusion Modelscited by 70
- 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesiscited by 59
- 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Modelscited by 55
- 2024FitDiT: Advancing the Authentic Garment Details for High-fidelity Virtual Try-oncited by 40
- 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
- 2024TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Modelscited by 31
- 2024Learning Flow Fields in Attention for Controllable Person Image Generationcited by 27
- 2022ClothFormer:Taming Video Virtual Try-on in All Modulecited by 26
- 2024Revisiting Non-Autoregressive Transformers for Efficient Image Synthesiscited by 22
- 2024VTON-HandFit: Virtual Try-on for Arbitrary Hand Pose Guided by Hand Priors Embeddingcited by 11
- 2025RealVVT: Towards Photorealistic Video Virtual Try-on via Spatio-Temporal Consistencycited by 8
- 2024Adapting Diffusion Models for Improved Prompt Compliance and Controllable Image Synthesiscited by 4
- 2025CrossVTON: Mimicking the Logic Reasoning on Cross-category Virtual Try-on guided by Tri-zone Priorscited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 12.
15 papers.
Sort:
By area:
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 17
- 2025Eevee: Towards Close-up High-resolution Video-based Virtual Try-oncited by 7
- 2026iTryOn: Mastering Interactive Video Virtual Try-On with Spatial-Semantic Guidancecited by 4
- 2025Once Is Enough: Lightweight DiT-Based Video Virtual Try-On via One-Time Garment Appearance Injectioncited by 3
- 2026TripVVT: A Large-Scale Triplet Dataset and a Coarse-Mask Baseline for In-the-Wild Video Virtual Try-Oncited by 3
- 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxycited by 3
- 2026OmniTryOn: Video Try-On Anything at Once!cited by 1
- 2026UniVVT: A Unified End-to-End Framework for High-Fidelity Video Virtual Try-oncited by 1
- 2026VTONGuard: Automatic Detection and Authentication of AI-Generated Virtual Try-On Contentcited by 0
- 2026InstructVVT: Instruction-Driven Video Virtual Try-On without Auxiliary Spatial Priorscited by 0
- 2026LiveVVT: High-Fidelity Video Virtual Try-On in Real Timecited by 0
- 2026FlowVVTON: Flow-Guided Mask-Free Video Virtual Try-Oncited by 0
- 2026TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioning30 Sep 2026
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026BooM-VVT: Boosting Mask-Free Video Virtual Try-On with Image-Level Pseudo Data3 Sep 2026
- 2026FlowVVTON: Flow-Guided Mask-Free Video Virtual Try-On31 Aug 2026
- 2026LiveVVT: High-Fidelity Video Virtual Try-On in Real Time27 Aug 2026
- 2026InstructVVT: Instruction-Driven Video Virtual Try-On without Auxiliary Spatial Priors14 Aug 2026
- 2026UniVVT: A Unified End-to-End Framework for High-Fidelity Video Virtual Try-on6 Aug 2026
- 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxy24 Jun 2026
- 2026OmniTryOn: Video Try-On Anything at Once!7 Jun 2026
- 2026iTryOn: Mastering Interactive Video Virtual Try-On with Spatial-Semantic Guidance20 May 2026
- 2026TripVVT: A Large-Scale Triplet Dataset and a Coarse-Mask Baseline for In-the-Wild Video Virtual Try-On30 Apr 2026
- 2026VTONGuard: Automatic Detection and Authentication of AI-Generated Virtual Try-On Content20 Jan 2026
3 more
- 2025Eevee: Towards Close-up High-resolution Video-based Virtual Try-on24 Nov 2025
- 2025Once Is Enough: Lightweight DiT-Based Video Virtual Try-On via One-Time Garment Appearance Injection9 Oct 2025
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework4 Aug 2025
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 17
- 2025Once Is Enough: Lightweight DiT-Based Video Virtual Try-On via One-Time Garment Appearance Injectioncited by 3
- 2026LiveVVT: High-Fidelity Video Virtual Try-On in Real Timecited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generationcited by 0
- 2026LongLive-Plug: Once-for-All Distillation for Video Generation29 Sep 2026
- 2026LiveVVT: High-Fidelity Video Virtual Try-On in Real Time27 Aug 2026
- 2025Once Is Enough: Lightweight DiT-Based Video Virtual Try-On via One-Time Garment Appearance Injection9 Oct 2025
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework4 Aug 2025
- 2025Eevee: Towards Close-up High-resolution Video-based Virtual Try-oncited by 7
- 2026iTryOn: Mastering Interactive Video Virtual Try-On with Spatial-Semantic Guidancecited by 4
- 2026TripVVT: A Large-Scale Triplet Dataset and a Coarse-Mask Baseline for In-the-Wild Video Virtual Try-Oncited by 3
- 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxycited by 3
- 2026OmniTryOn: Video Try-On Anything at Once!cited by 1
- 2026UniVVT: A Unified End-to-End Framework for High-Fidelity Video Virtual Try-oncited by 1
- 2026VTONGuard: Automatic Detection and Authentication of AI-Generated Virtual Try-On Contentcited by 0
- 2026InstructVVT: Instruction-Driven Video Virtual Try-On without Auxiliary Spatial Priorscited by 0
- 2026FlowVVTON: Flow-Guided Mask-Free Video Virtual Try-Oncited by 0
- 2026BooM-VVT: Boosting Mask-Free Video Virtual Try-On with Image-Level Pseudo Datacited by 0
- 2026TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioningcited by 0
- 2026TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioning30 Sep 2026
- 2026BooM-VVT: Boosting Mask-Free Video Virtual Try-On with Image-Level Pseudo Data3 Sep 2026
- 2026FlowVVTON: Flow-Guided Mask-Free Video Virtual Try-On31 Aug 2026
- 2026InstructVVT: Instruction-Driven Video Virtual Try-On without Auxiliary Spatial Priors14 Aug 2026
- 2026UniVVT: A Unified End-to-End Framework for High-Fidelity Video Virtual Try-on6 Aug 2026
- 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxy24 Jun 2026
- 2026OmniTryOn: Video Try-On Anything at Once!7 Jun 2026
- 2026iTryOn: Mastering Interactive Video Virtual Try-On with Spatial-Semantic Guidance20 May 2026
- 2026TripVVT: A Large-Scale Triplet Dataset and a Coarse-Mask Baseline for In-the-Wild Video Virtual Try-On30 Apr 2026
- 2026VTONGuard: Automatic Detection and Authentication of AI-Generated Virtual Try-On Content20 Jan 2026
- 2025Eevee: Towards Close-up High-resolution Video-based Virtual Try-on24 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanism
- 2025The devil is in the details: Enhancing Video Virtual Try-On via Keyframe-Driven Details Injection
- 2024SwiftTry: Fast and Consistent Video Virtual Try-On with Diffusion Models
- 2025DiffFit: Disentangled Garment Warping and Texture Refinement for Virtual Try-On
- 2026Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision
- 20253DV-TON: Textured 3D-Guided Consistent Video Try-on via Diffusion Models
- 2024Improving Virtual Try-On with Garment-focused Diffusion Models
- 2025Incorporating Visual Correspondence into Diffusion Model for Virtual Try-On