Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision
Not on the map. Why?
Abstract (arXiv)
We present Vanast, a unified framework that generates garment-transferred human animation videos directly from a single human image, garment images, and a pose guidance video. Conventional two-stage pipelines treat image-based virtual try-on and pose-driven animation as separate processes, which often results in identity drift, garment distortion, and front-back inconsistency. Our model addresses these issues by performing the entire process in a single unified step to achieve coherent synthesis. To enable this setting, we construct large-scale triplet supervision. Our data generation pipeline includes generating identity-preserving human images in alternative outfits that differ from garment catalog images, capturing full upper and lower garment triplets to overcome the single-garment-posed video pair limitation, and assembling diverse in-the-wild triplets without requiring garment catalog images. We further introduce a Dual Module architecture for video diffusion transformers to stabilize training, preserve pretrained generative quality, and improve garment accuracy, pose adherence, and identity preservation while supporting zero-shot garment interpolation. Together, these contributions allow Vanast to produce high-fidelity, identity-consistent animation across a wide range of garment types.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 35 of its 38 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
35 of 38 references.
References · 35
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
23 more
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 175
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 151
- 2020Towards Photo-Realistic Virtual Try-On by Adaptively GeneratingleftrightarrowPreserving Image Contentcited by 149
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 102
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 102
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
- 2023DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphingcited by 67
- 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 64
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
- 2024ViViD: Video Virtual Try-on using Diffusion Modelscited by 42
- 2025VisualCloze: A Universal Image Generation Framework via Visual In-Context Learningcited by 39
- 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
- 2023Res-Tuning: A Flexible and Efficient Tuning Paradigm via Unbinding Tuner from Backbonecited by 26
- 2024AnchorCrafter: Animate Cyber-Anchors Selling Your Products via Human-Object Interacting Video Generationcited by 26
- 2024PERSE: Personalized 3D Generative Avatars from A Single Portraitcited by 15
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglementcited by 14
- 2024MegActor-Sigma: Unlocking Flexible Mixed-Modal Control in Portrait Animation with Diffusion Transformercited by 13
- 2025OmniTry: Virtual Try-On Anything without Maskscited by 13
- 2024PEGASUS: Personalized Generative 3D Avatars with Composable Attributescited by 7
- 2025Durian: Dual Reference Image-Guided Portrait Animation with Attribute Transfercited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026FlowVVTON: Flow-Guided Mask-Free Video Virtual Try-Oncited by 0
- 2026FlowVVTON: Flow-Guided Mask-Free Video Virtual Try-On31 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026UniVVT: A Unified End-to-End Framework for High-Fidelity Video Virtual Try-on
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models
- 2025MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on
- 2026TripVVT: A Large-Scale Triplet Dataset and a Coarse-Mask Baseline for In-the-Wild Video Virtual Try-On
- 20253DV-TON: Textured 3D-Guided Consistent Video Try-on via Diffusion Models
- 2025Once Is Enough: Lightweight DiT-Based Video Virtual Try-On via One-Time Garment Appearance Injection
- 2025The devil is in the details: Enhancing Video Virtual Try-On via Keyframe-Driven Details Injection
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework