mlsanityData to 14 Oct 2026

TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxy

arXiv 2606.26092 ↗First posted 24 Jun 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

While Video Virtual Try-on (VVT) has achieved remarkable progress in synthesizing realistic garment overlays on dynamic subjects, existing paradigms remains fundamentally constrained by a passive dependency on source camera trajectories, failing to accommodate the requisite interactive freedom for omnidirectional viewpoint exploration. To address this limitation, we define a pioneering research frontier: Camera-controllable Video Virtual Try-on (CaM-VVT). Unlike conventional VVT, CaM-VVT not only necessitates viewpoint-agnostic texture hallucination but also strict structural synchronization between non-rigid human dynamics and background contexts under arbitrary, unconstrained camera movements. To tackle these challenges, we present TryOnCrafter, the first unified DiT-based framework specifically architected for the CaM-VVT task. Departing from implicit pixel-space manipulation, we introduce a Renderable 4D Try-on Proxy that explicitly decouples the human subject from the environment. This is achieved by distilling high-fidelity 2D try-on priors into a clothed 3DGS-based avatar, which is subsequently animated via SMPL-X sequences and metric-aligned into a reconstructed background point cloud. This proxy establishes a robust structural foundation with superior texture density and motion integrity. Our Proxy-Anchored Video DiT leverages this robust structural foundation as a primary geometric anchor, ensuring that the synthesized photorealistic videos are strictly constrained by prescribed trajectories and physically plausible deformations. Benefiting from the inherent editability of the 4D proxy, TryOnCrafter facilitates diverse downstream applications, including human relocalization, ``bullet time'' effects, and 360-degree orbital viewing.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 49 of its 54 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

49 of 54 references.

References · 49

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  9. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  10. 2025Qwen-Image Technical Reportcited by 1,044
  11. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  12. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
37 more
  1. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  2. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  3. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  4. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  5. 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-Oncited by 175
  6. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
  7. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  8. 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 151
  9. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
  10. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
  11. 2024Training-free Camera Control for Video Generationcited by 122
  12. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  13. 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wildcited by 109
  14. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
  15. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 77
  16. 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
  17. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
  18. 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
  19. 2024LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervisioncited by 56
  20. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  21. 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generationcited by 45
  22. 2024ViViD: Video Virtual Try-on using Diffusion Modelscited by 42
  23. 2024AniGS: Animatable Gaussian Avatar from a Single Image with Inconsistent Gaussian Reconstructioncited by 36
  24. 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 35
  25. 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
  26. 2025RelationAdapter: Learning and Transferring Visual Relation with Diffusion Transformerscited by 26
  27. 2024Novel View Extrapolation with Video Diffusion Priorscited by 25
  28. 2025CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal Concatenationcited by 25
  29. 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Modelscited by 22
  30. 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 17
  31. 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfercited by 16
  32. 2024Fashion-VDM: Video Diffusion Model for Virtual Try-Oncited by 16
  33. 2025MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-oncited by 15
  34. 2025WorldWander: Bridging Egocentric and Exocentric Worlds in Video Generationcited by 9
  35. 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistencycited by 7
  36. 2025LightMotion: A Light and Tuning-free Method for Simulating Camera Motion in Video Generationcited by 5
  37. 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customizationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.