FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization
Not on the map. Why?
Abstract (arXiv)
Human-centric video customization, particularly at the garment level, has shown significant commercial value. However, existing approaches cannot support low-latency and interactive garment control, which is crucial for applications such as e-commerce and content creation. This paper studies how to achieve interactive multi-garment video customization while preserving motion coherence using only single-garment video data. We present FashionChameleon, a real-time and interactive framework for human-garment customization in autoregressive video generation, where users can interactively switch garment during generation. FashionChameleon consists of three key techniques: (i) Instead of training on multi-garment video data, we train a Teacher Model with In-Context Learning on a single reference-garment pair. By retaining the image-to-video training paradigm while enforcing a mismatch between the reference and garment image, the model is encouraged to implicitly preserve coherence during single-garment switching. (ii) To achieve consistency and efficiency during generation, we introduce Streaming Distillation with In-Context Learning, which fine-tunes the model with in-context teacher forcing and improves extrapolation consistency via gradient-reweighted distribution matching distillation. (iii) To extend the model for interactive multi-garment video customization, we propose Training-Free KV Cache Rescheduling, which includes garment KV refresh, historical KV withdraw, and reference KV disentangle to achieve garment switching while preserving motion coherence. Our FashionChameleon uniquely supports interactive customization and consistent long-video extrapolation, while achieving real-time generation at 23.8 FPS on a single GPU, 30-180× faster than existing baselines.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 54 of its 59 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
54 of 59 references.
References · 54
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2025Qwen-Image Technical Reportcited by 1,044
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
38 more
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2025Test-Time Training Done Rightcited by 130
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
- 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 76
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 76
- 2024Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharingcited by 74
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 57
- 2024ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformercited by 45
- 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolutioncited by 43
- 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 28
- 2025MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglementcited by 23
- 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integrationcited by 23
- 2024DisenStudio: Customized Multi-subject Text-to-Video Generation with Disentangled Spatial Controlcited by 20
- 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfercited by 16
- 2025Kaleido: Open-Sourced Multi-Subject Reference Video Generation Modelcited by 16
- 2024DriveGenVLM: Real-world Video Generation for Vision Language Model based Autonomous Drivingcited by 11
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxycited by 3
- 2026From Corpora to Co-Evolving Capabilities: Capability-Centric Data Design for Generalist Image Generationcited by 2
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesiscited by 1
- 2026Human-Centric Intelligence in the Era of Foundation Models: A Surveycited by 0
- 2026LiveVVT: High-Fidelity Video Virtual Try-On in Real Timecited by 0
- 2026LiveVVT: High-Fidelity Video Virtual Try-On in Real Time27 Aug 2026
- 2026Human-Centric Intelligence in the Era of Foundation Models: A Survey18 Aug 2026
- 2026From Corpora to Co-Evolving Capabilities: Capability-Centric Data Design for Generalist Image Generation18 Aug 2026
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis21 Jul 2026
- 2026TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxy24 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models
- 2025MuGa-VTON: Multi-Garment Virtual Try-On via Diffusion Transformers with Prompt Customization
- 2025MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion
- 2025Once Is Enough: Lightweight DiT-Based Video Virtual Try-On via One-Time Garment Appearance Injection
- 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanism
- 2024Controllable Human Image Generation with Personalized Multi-Garments