mlsanityData to 14 Oct 2026

SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation

arXiv 2604.03723 ↗First posted 4 Apr 2026cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Controlling both camera motion and object dynamics is essential for coherent and expressive video generation, yet current methods typically handle only one motion type or rely on ambiguous 2D cues that entangle camera-induced parallax with true object movement. We present SymphoMotion, a unified motion-control framework that jointly governs camera trajectories and object dynamics within a single model. SymphoMotion features a Camera Trajectory Control mechanism that integrates explicit camera paths with geometry-aware cues to ensure stable, structurally consistent viewpoint transitions, and an Object Dynamics Control mechanism that combines 2D visual guidance with 3D trajectory embeddings to enable depth-aware, spatially coherent object manipulation. To support large-scale training and evaluation, we further construct RealCOD-25K, a comprehensive real-world dataset containing paired camera poses and object-level 3D trajectories across diverse indoor and outdoor scenes, addressing a key data gap in unified motion control. Extensive experiments and user studies show that SymphoMotion significantly outperforms existing methods in visual fidelity, camera controllability, and object-motion accuracy, establishing a new benchmark for unified motion control in video generation. Codes and data are publicly available at https://grenoble-zhang.github.io/SymphoMotion/.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 57 of its 62 references that are in the map. First posted on arXiv 4 Apr 2026.

Builds on

57 of 62 references.

References · 57

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2024Depth Anything V2cited by 1,422
  10. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  11. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  12. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
38 more
  1. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  2. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  3. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  4. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
  5. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
  6. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
  7. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  8. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  9. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  10. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
  11. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
  12. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
  13. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  14. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  15. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  16. 2024Training-free Camera Control for Video Generationcited by 122
  17. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  18. 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
  19. 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
  20. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
  21. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
  22. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 98
  23. 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
  24. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 93
  25. 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 87
  26. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 77
  27. 2023PEEKABOO: Interactive Video Generation via Masked-Diffusioncited by 76
  28. 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
  29. 2024Image Conductor: Precision Control for Interactive Video Synthesiscited by 63
  30. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
  31. 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 61
  32. 2024FreeTraj: Tuning-Free Trajectory Control in Video Diffusion Modelscited by 56
  33. 2024MotionMaster: Training-free Camera Motion Transfer For Video Generationcited by 51
  34. 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
  35. 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 43
  36. 2024TrackGo: A Flexible and Efficient Method for Controllable Video Generationcited by 39
  37. 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
  38. 2024LeviTor: 3D Trajectory Oriented Image-to-Video Synthesiscited by 39

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.