mlsanityData to 7 Oct 2026

Tri-Prompting: Video Diffusion with Unified Control over Scene, Subject, and Motion

arXiv 2603.15614 ↗First posted 16 Mar 2026cs.CVcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recent video diffusion models achieve strong visual quality and temporal coherence, but still lack coordinated control over scene layout, customized subject identity, and camera/subject motion. We study controllable video generation from three prompts: a first-frame scene image, 3D-aware multi-view subject references, and a motion-driving signal. This setting is challenging because background regions are often trackable under camera motion, while foreground subjects can rotate, self-occlude, and reveal new regions that require identity-consistent appearance. We introduce Tri-Prompting, a video diffusion framework that combines multi-view subject conditioning with dual-conditioned motion control. Tri-Prompting uses XYZ tracking points for visible background motion and low-resolution RGB proxies for foreground subject pose, allowing the model to recover fine appearance from multi-view references while retaining flexibility for plausible subject-scene interactions. An inference-time ControlNet scale schedule further balances motion controllability and visual realism. We evaluate Tri-Prompting against specialized baselines: DaS for motion reconstruction and Phantom for subject-driven generation. Tri-Prompting achieves competitive or improved reconstruction quality, stronger multi-view identity preservation, and better 3D consistency, while enabling 3D-aware subject insertion and in-scene manipulation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 50 of its 56 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

50 of 56 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  2. 2025EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidance28 May
  3. 2025SkyReels-A2: Compose Anything in Video Diffusion Transformers3 Apr
  4. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control7 Jan
  5. 2024Latent-Reframe: Enabling Camera Control for Video Diffusion Model without Training8 Dec
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  7. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion5 Feb
  8. 2023VideoBooth: Diffusion-based Video Generation with Image Prompts1 Dec
  9. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
1 more
  1. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov

Other references · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  8. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  10. 2025SAM 3: Segment Anything with Conceptscited by 835
  11. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  12. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
25 more
  1. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  2. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  3. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  4. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  5. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  6. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  7. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  8. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
  9. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
  10. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  11. 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
  12. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  13. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 93
  14. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
  15. 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
  16. 2024Vlogger: Make Your Dream A Vlogcited by 70
  17. 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
  18. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
  19. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 59
  20. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
  21. 2025OmniVCus: Feedforward Subject-driven Video Customization with Multimodal Control Conditionscited by 17
  22. 2025Yan: Foundational Interactive Video Generationcited by 15
  23. 2025Frame In-N-Out: Unbounded Controllable Image-to-Video Generationcited by 10
  24. 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
  25. 2025CustomX: Unified Character, Action, and Scene Customization in Video World Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers
  2. 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models
  3. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control
  4. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation
  5. 2024Animate Your Motion: Turning Still Images into Dynamic Videos
  6. 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Model
  7. 2026QWERTY: Training-Free Motion Control via Query-Warped Video Diffusion Transformers
  8. 2025BulletTime: Decoupled Control of Time and Camera Pose for Video Generation