mlsanityData to 14 Oct 2026

Probing into Camera Control of Video Models

arXiv 2605.14815 ↗First posted 14 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Video is a rich and scalable source of 3D/4D visual observations, and camera control is a key capability for video generation models to produce geometrically meaningful content. Existing approaches typically learn a mapping from camera motion to video using additional camera modules and paired data. However, such datasets are often limited in scale, diversity, and scene dynamics, which can bias the model toward a narrow output distribution and compromise the strong prior learned by the base model. These limitations motivate a different perspective on camera control. In this paper, we show that camera control need not be modeled as an implicit mapping problem, but can instead be treated as a form of geometric guidance that induces displacements across frames. Specifically, we reformulate camera control into a set of displacement fields and apply them via differentiable resampling of latent features during denoising. Our simple approach achieves effective camera control with minimal degradation across diverse quality metrics compared to fine-tuned baselines. Since our method is applicable to most video diffusion models without training, it can also serve as a probe to study the camera control capabilities of base models. Using this probe, we identify universal biases shared by representative video models, as well as disparities in their responses to camera control. Finally, we benchmark their performance in multi-view generation, offering insights into their potential for 3D/4D tasks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 58 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

52 of 58 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022Classifier-Free Diffusion Guidancecited by 5,847
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  8. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
38 more
  1. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  4. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  5. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  6. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  7. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  8. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  9. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  10. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
  11. 2022Kubric: A scalable dataset generatorcited by 381
  12. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  13. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  14. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  15. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  16. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  17. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  18. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
  19. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
  20. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
  21. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  22. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  23. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
  24. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 140
  25. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
  26. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
  27. 2024Training-free Camera Control for Video Generationcited by 122
  28. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  29. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 98
  30. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 93
  31. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
  32. 2025Towards Understanding Camera Motions in Any Videocited by 64
  33. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  34. 2024MotionMaster: Training-free Camera Motion Transfer For Video Generationcited by 51
  35. 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
  36. 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 39
  37. 2025Epipolar Geometry Improves Video Generation Modelscited by 26
  38. 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attentioncited by 24

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Control
  2. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Model
  3. 2026DeltaCam: Differential Intrinsic Camera Modeling for Video Generation
  4. 2025CamCtrl3D: Single-Image Scene Exploration with Precise 3D Camera Control
  5. 2024Controlling Space and Time with Diffusion Models
  6. 2025BulletTime: Decoupled Control of Time and Camera Pose for Video Generation
  7. 2024Latent-Reframe: Enabling Camera Control for Video Diffusion Model without Training
  8. 2026PartiCam: Camera Controlled Video Generation with Reward Guidance