SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation
Not on the map. Why?
Abstract (arXiv)
Controlling both camera motion and object dynamics is essential for coherent and expressive video generation, yet current methods typically handle only one motion type or rely on ambiguous 2D cues that entangle camera-induced parallax with true object movement. We present SymphoMotion, a unified motion-control framework that jointly governs camera trajectories and object dynamics within a single model. SymphoMotion features a Camera Trajectory Control mechanism that integrates explicit camera paths with geometry-aware cues to ensure stable, structurally consistent viewpoint transitions, and an Object Dynamics Control mechanism that combines 2D visual guidance with 3D trajectory embeddings to enable depth-aware, spatially coherent object manipulation. To support large-scale training and evaluation, we further construct RealCOD-25K, a comprehensive real-world dataset containing paired camera poses and object-level 3D trajectories across diverse indoor and outdoor scenes, addressing a key data gap in unified motion control. Extensive experiments and user studies show that SymphoMotion significantly outperforms existing methods in visual fidelity, camera controllability, and object-motion accuracy, establishing a new benchmark for unified motion control in video generation. Codes and data are publicly available at https://grenoble-zhang.github.io/SymphoMotion/.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 57 of its 62 references that are in the map. First posted on arXiv 4 Apr 2026.
Builds on
57 of 62 references.
References · 57
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024Depth Anything V2cited by 1,422
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
38 more
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2024Training-free Camera Control for Video Generationcited by 122
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
- 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
- 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 98
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 93
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 87
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 77
- 2023PEEKABOO: Interactive Video Generation via Masked-Diffusioncited by 76
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2024Image Conductor: Precision Control for Interactive Video Synthesiscited by 63
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
- 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 61
- 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Modelscited by 56
- 2024MotionMaster: Training-free Camera Motion Transfer For Video Generationcited by 51
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 43
- 2024TrackGo: A Flexible and Efficient Method for Controllable Video Generationcited by 39
- 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
- 2024LeviTor: 3D Trajectory Oriented Image-to-Video Synthesiscited by 39
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 12
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2026PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interactioncited by 4
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Modelcited by 3
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Imagecited by 2
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Searchcited by 1
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillationcited by 0
- 20264Director: Controlling Video World Models with Rigid 3D Geometrycited by 0
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3Dcited by 0
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3D1 Oct 2026
- 20264Director: Controlling Video World Models with Rigid 3D Geometry1 Oct 2026
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation10 Sep 2026
- 2026Search-to-World: Evaluation of 3D World Delivery from User Request through Web Search7 Sep 2026
- 2026TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image4 Sep 2026
- 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models2 Sep 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control26 Jun 2026
- 2026Holo-World: Unified Camera, Object and Weather Control for Video World Model18 Jun 2026
- 2026PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interaction19 May 2026