ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integration
Not on the map. Why?
Abstract (arXiv)
Recent advances in Video Foundation Models (VFMs) have revolutionized human-centric video synthesis, yet fine-grained and independent editing of subjects and scenes remains a critical challenge. Recent attempts to incorporate richer environment control through rigid 3D geometric compositions often encounter a stark trade-off between precise control and generative flexibility. Furthermore, the heavy 3D pre-processing still limits practical scalability. In this paper, we propose ONE-SHOT, a parameter-efficient framework for compositional human-environment video generation. Our key insight is to factorize the generative process into disentangled signals. Specifically, we introduce a canonical-space injection mechanism that decouples human dynamics from environmental cues via cross-attention. We also propose Dynamic-Grounded-RoPE, a novel positional embedding strategy that establishes spatial correspondences between disparate spatial domains without any heuristic 3D alignments. To support long-horizon synthesis, we introduce a Hybrid Context Integration mechanism to maintain subject and scene consistency across minute-level generations. Experiments demonstrate that our method significantly outperforms state-of-the-art methods, offering superior structural control and creative diversity for video synthesis. Our project has been available on: https://martayang.github.io/ONE-SHOT/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 36 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
36 of 36 references.
References · 36
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2025VACE: All-in-One Video Creation and Editingcited by 467
24 more
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2023EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wildcited by 95
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 69
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2025Human3R: Everyone Everywhere All at Oncecited by 35
- 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
- 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
- 2025EchoMimicV3: 1.3B Parameters are All You Need for Unified Multi-Modal and Multi-Task Human Animationcited by 28
- 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integrationcited by 22
- 2025MotionV2V: Editing Motion in a Videocited by 13
- 2025RealisMotion: Decomposed Human Motion Control and Video Generation in the World Spacecited by 10
- 2025DiTraj: training-free trajectory control for video diffusion transformercited by 5
Built on by
Not cited yet.