mlsanityData to 7 Oct 2026

CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation

arXiv 2406.02509 ↗First posted 4 Jun 2024cs.CVcited by 163

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recently video diffusion models have emerged as expressive generative tools for high-quality video content creation readily available to general users. However, these models often do not offer precise control over camera poses for video generation, limiting the expression of cinematic language and user control. To address this issue, we introduce CamCo, which allows fine-grained Camera pose Control for image-to-video generation. We equip a pre-trained image-to-video generator with accurately parameterized camera pose input using Pl"ucker coordinates. To enhance 3D consistency in the videos produced, we integrate an epipolar attention module in each attention block that enforces epipolar constraints to the feature maps. Additionally, we fine-tune CamCo on real-world videos with camera poses estimated through structure-from-motion algorithms to better synthesize object motion. Our experiments show that CamCo significantly improves 3D consistency and camera control capabilities compared to previous models while effectively generating plausible object motion. Project page: https://ir1d.github.io/CamCo/

Key facts. Cited by 163 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 50 of its 63 references that are in the map. First posted on arXiv 4 Jun 2024.

Builds on

50 of 63 references.

Closest ancestors · 11

Same direction, newest first

  1. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation2 Apr
  2. 2024Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition21 Mar
  3. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  4. 2024VASE: Object-Centric Appearance and Shape Manipulation of Real Videos4 Jan
  5. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models28 Nov
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  7. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
  10. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
  11. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec

Other references · 39

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
27 more
  1. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  3. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  4. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  5. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  6. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  7. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  8. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  9. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  10. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  11. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  12. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  13. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  14. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  15. 2022MAGVIT: Masked Generative Video Transformercited by 341
  16. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  17. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
  18. 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
  19. 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
  20. 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 96
  21. 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
  22. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  23. 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
  24. 2023SceneWiz3D: Towards Text-guided 3D Scene Compositioncited by 54
  25. 2024Comp4D: LLM-Guided Compositional 4D Scene Generationcited by 50
  26. 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
  27. 2023Taming Mode Collapse in Score Distillation for Text-to-3D Generationcited by 35

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 34; 2025: 74; 2026: 55.

163 papers.

Sort:

By area:

  1. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  2. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  3. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  4. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  5. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  6. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 139
  7. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
  8. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  9. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 115
  10. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 114
  11. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 100
  12. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
38 more
  1. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
  2. 2025Controllable Video Generation: A Surveycited by 93
  3. 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 92
  4. 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
  5. 2024ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuningcited by 68
  6. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  7. 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
  8. 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 62
  9. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 61
  10. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 54
  11. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generationcited by 50
  12. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
  13. 2024GenXD: Generating Any 3D and 4D Scenescited by 49
  14. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  15. 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 44
  16. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 43
  17. 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 42
  18. 2024I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strengthcited by 38
  19. 2024EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generationcited by 38
  20. 2025FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesiscited by 37
  21. 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
  22. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
  23. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 36
  24. 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translationcited by 35
  25. 2024AnimateAnything: Consistent and Controllable Animation for Video Generationcited by 34
  26. 2025OmniNWM: Omniscient Driving Navigation World Modelscited by 32
  27. 2024Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamicscited by 28
  28. 20244Real-Video: Learning Generalizable Photo-Realistic 4D Video Diffusioncited by 27
  29. 2024Generative Photography: Scene-Consistent Camera Control for Realistic Text-to-Image Synthesiscited by 26
  30. 2025Dynamic Camera Poses and Where to Find Themcited by 26
  31. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 26
  32. 2025VidCRAFT3: Camera, Object, and Lighting Control for Image-to-Video Generationcited by 25
  33. 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attentioncited by 24
  34. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  35. 2026MosaicMem: Hybrid Spatial Memory for Controllable Video World Modelscited by 23
  36. 2025Perception-as-Control: Fine-grained Controllable Image Animation with 3D-aware Motion Representationcited by 22
  37. 2024Boosting Camera Motion Control for Video Diffusion Transformerscited by 20
  38. 2025EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidancecited by 20

50 most cited of 163 All 163 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025CETCAM: Camera-Controllable Video Generation via Consistent and Extensible Tokenization
  2. 2026CamLit: Unified Video Diffusion with Explicit Camera and Lighting Control
  3. 2024Training-free Camera Control for Video Generation
  4. 2025CamCtrl3D: Single-Image Scene Exploration with Precise 3D Camera Control
  5. 2026PartiCam: Camera Controlled Video Generation with Reward Guidance
  6. 2025DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generation
  7. 2026DeltaCam: Differential Intrinsic Camera Modeling for Video Generation
  8. 2024CPA: Camera-pose-awareness Diffusion Transformer for Video Generation