mlsanityData to 14 Oct 2026

The devil is in the details: Enhancing Video Virtual Try-On via Keyframe-Driven Details Injection

arXiv 2512.20340 ↗First posted 23 Dec 2025cs.CVcited by 1

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Although diffusion transformer (DiT)-based video virtual try-on (VVT) has made significant progress in synthesizing realistic videos, existing methods still struggle to capture fine-grained garment dynamics and preserve background integrity across video frames. They also incur high computational costs due to additional interaction modules introduced into DiTs, while the limited scale and quality of existing public datasets also restrict model generalization and effective training. To address these challenges, we propose a novel framework, KeyTailor, along with a large-scale, high-definition dataset, ViT-HD. The core idea of KeyTailor is a keyframe-driven details injection strategy, motivated by the fact that keyframes inherently contain both foreground dynamics and background consistency. Specifically, KeyTailor adopts an instruction-guided keyframe sampling strategy to filter informative frames from the input video. Subsequently,two tailored keyframe-driven modules, the garment details enhancement module and the collaborative background optimization module, are employed to distill garment dynamics into garment-related latents and to optimize the integrity of background latents, both guided by keyframes.These enriched details are then injected into standard DiT blocks together with pose, mask, and noise latents, enabling efficient and realistic try-on video synthesis. This design ensures consistency without explicitly modifying the DiT architecture, while simultaneously avoiding additional complexity. In addition, our dataset ViT-HD comprises 15, 070 high-quality video samples at a resolution of 810*1080, covering diverse garments. Extensive experiments demonstrate that KeyTailor outperforms state-of-the-art baselines in terms of garment fidelity and background integrity across both dynamic and static scenarios.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. First posted on arXiv 23 Dec 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on
  2. 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework
  3. 2026TexTailor: Texture-Preserving Video Virtual Try-On via Adaptive Garment Conditioning
  4. 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanism
  5. 2026InstructVVT: Instruction-Driven Video Virtual Try-On without Auxiliary Spatial Priors
  6. 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models
  7. 2025Once Is Enough: Lightweight DiT-Based Video Virtual Try-On via One-Time Garment Appearance Injection
  8. 2025Pursuing Temporal-Consistent Video Virtual Try-On via Dynamic Pose Interaction