mlsanityData to 7 Oct 2026

I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strength

arXiv 2411.06525 ↗First posted 10 Nov 2024cs.CV cs.AIcited by 38

Not on the map. Why?

Abstract (arXiv)

Video generation technologies are developing rapidly and have broad potential applications. Among these technologies, camera control is crucial for generating professional-quality videos that accurately meet user expectations. However, existing camera control methods still suffer from several limitations, including control precision and the neglect of the control for subject motion dynamics. In this work, we propose I2VControl-Camera, a novel camera control method that significantly enhances controllability while providing adjustability over the strength of subject motion. To improve control precision, we employ point trajectory in the camera coordinate system instead of only extrinsic matrix information as our control signal. To accurately control and adjust the strength of subject motion, we explicitly model the higher-order components of the video trajectory expansion, not merely the linear terms, and design an operator that effectively represents the motion strength. We use an adapter architecture that is independent of the base model structure. Experiments on static and dynamic scenes show that our framework outperformances previous methods both quantitatively and qualitatively. The project page is: https://wanquanf.github.io/I2VControlCamera .

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 42 of its 48 references that are in the map. First posted on arXiv 10 Nov 2024.

Builds on

42 of 48 references.

References · 42

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  5. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  6. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  9. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  10. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  12. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
30 more
  1. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  2. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  3. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  4. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  5. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  6. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  7. 2023CoTracker: It is Better to Track Togethercited by 516
  8. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  9. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  10. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  11. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  12. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
  13. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  14. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
  15. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  16. 2023Photorealistic Video Generation with Diffusion Modelscited by 304
  17. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  18. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
  19. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  20. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
  21. 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
  22. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  23. 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
  24. 2024Training-free Camera Control for Video Generationcited by 119
  25. 2022VIDM: Video Implicit Diffusion Modelscited by 78
  26. 2023I2V-Adapter: A General Image-to-Video Adapter for Diffusion Modelscited by 70
  27. 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidancecited by 66
  28. 2022Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Cameracited by 57
  29. 2024MagicVideo-V2: Multi-Stage High-Aesthetic Video Generationcited by 48
  30. 2023PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image Modelscited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 20; 2026: 16.

38 papers.

Sort:

By area:

  1. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
  2. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
  3. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
  4. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 54
  5. 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 42
  6. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  7. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 26
  8. 2025VidCRAFT3: Camera, Object, and Lighting Control for Image-to-Video Generationcited by 25
  9. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  10. 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Modelscited by 23
  11. 2025Perception-as-Control: Fine-grained Controllable Image Animation with 3D-aware Motion Representationcited by 22
  12. 2025EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidancecited by 20
26 more
  1. 2024I2VControl: Disentangled and Unified Video Motion Synthesis Controlcited by 19
  2. 2026INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modelingcited by 18
  3. 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
  4. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 15
  5. 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 13
  6. 2024Video Diffusion Transformers are In-Context Learnerscited by 11
  7. 2026SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generationcited by 9
  8. 2025IDCNet: Guided Video Diffusion for Metric-Consistent RGBD Scene Generation with Precise Camera Controlcited by 7
  9. 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Rewardcited by 7
  10. 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Modelscited by 7
  11. 2026Latent Spatial Memory for Video World Modelscited by 7
  12. 2025LiON-LoRA: Rethinking LoRA Fusion to Unify Controllable Spatial and Temporal Generation for Video Diffusioncited by 6
  13. 2025PostCam: Camera-Controllable Novel-View Video Generation with Query-Shared Cross-Attentioncited by 6
  14. 2025ShotDirector: Directorially Controllable Multi-Shot Video Generation with Cinematographic Transitionscited by 5
  15. 2025PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depthcited by 4
  16. 2025DreaMontage: Arbitrary Frame-Guided One-Shot Video Generationcited by 4
  17. 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planningcited by 4
  18. 2025CustomX: Unified Character, Action, and Scene Customization in Video World Modelscited by 1
  19. 2026TriMotion: Modality-Agnostic Camera Control for Video Generationcited by 1
  20. 2025Layer-Aware Video Composition via Split-then-Mergecited by 0
  21. 2026OmniCamera: A Unified Framework for Multi-task Video Generation with Arbitrary Camera Controlcited by 0
  22. 2026Probing into Camera Control of Video Modelscited by 0
  23. 2026PE-Field 4D: Video Generation Models as Canvascited by 0
  24. 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mappingcited by 0
  25. 2026CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generationcited by 0
  26. 20264Director: Controlling Video World Models with Rigid 3D Geometrycited by 0