mlsanityData to 7 Oct 2026

ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integration

arXiv 2604.01043 ↗First posted 1 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in Video Foundation Models (VFMs) have revolutionized human-centric video synthesis, yet fine-grained and independent editing of subjects and scenes remains a critical challenge. Recent attempts to incorporate richer environment control through rigid 3D geometric compositions often encounter a stark trade-off between precise control and generative flexibility. Furthermore, the heavy 3D pre-processing still limits practical scalability. In this paper, we propose ONE-SHOT, a parameter-efficient framework for compositional human-environment video generation. Our key insight is to factorize the generative process into disentangled signals. Specifically, we introduce a canonical-space injection mechanism that decouples human dynamics from environmental cues via cross-attention. We also propose Dynamic-Grounded-RoPE, a novel positional embedding strategy that establishes spatial correspondences between disparate spatial domains without any heuristic 3D alignments. To support long-horizon synthesis, we introduce a Hybrid Context Integration mechanism to maintain subject and scene consistency across minute-level generations. Experiments demonstrate that our method significantly outperforms state-of-the-art methods, offering superior structural control and creative diversity for video synthesis. Our project has been available on: https://martayang.github.io/ONE-SHOT/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 36 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

36 of 36 references.

References · 36

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  7. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  8. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  9. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  10. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  11. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  12. 2025VACE: All-in-One Video Creation and Editingcited by 467
24 more
  1. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  2. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  3. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
  4. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
  5. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
  6. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  7. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  8. 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
  9. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
  10. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
  11. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
  12. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  13. 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
  14. 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 69
  15. 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
  16. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  17. 2025Human3R: Everyone Everywhere All at Oncecited by 35
  18. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  19. 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
  20. 2025EchoMimicV3: 1.3B Parameters are All You Need for Unified Multi-Modal and Multi-Task Human Animationcited by 28
  21. 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integrationcited by 22
  22. 2025MotionV2V: Editing Motion in a Videocited by 13
  23. 2025RealisMotion: Decomposed Human Motion Control and Video Generation in the World Spacecited by 10
  24. 2025DiTraj: training-free trajectory control for video diffusion transformercited by 5

Built on by

Not cited yet.