mlsanityData to 14 Oct 2026

DeltaCam: Differential Intrinsic Camera Modeling for Video Generation

arXiv 2605.25266 ↗First posted 24 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Incorporating camera intrinsics into video generation models offers a principled way to control not only scene dynamics but also the imaging process that governs visual appearance. Prior work has primarily focused on extrinsic control, such as camera pose and motion, while treating intrinsic camera parameters as implicit or fixed. A key bottleneck is the lack of large-scale video datasets with accurate and diverse temporally varying camera metadata, which makes learning absolute camera parameterizations difficult. As a result, current models struggle to incorporate photographic camera behavior, including depth-of-field transitions, exposure variations, lens distortions, and color processing, in a controllable and temporally consistent manner. We introduce DeltaCam, a video diffusion framework that models camera behavior through Delta-parameterized neural camera adaptors, operating on relative changes in camera motion and intrinsics instead of absolute states. By learning this differential formulation from synthetic video data, we mitigate reliance on precise real-world camera labels and enable smooth, consistent control over imaging factors such as focal length, aperture, ISO, color temperature, and lens distortion. We extend this framework to real-world footage through two mechanisms: finetuning the controls on real image-metadata pairs for precise shot matching, and extracting disentangled embeddings for implicit video-to-video style transfer without requiring explicit camera parameters. By effectively separating scene content from intrinsic imaging behavior, DeltaCam enables camera-consistent video generation and editing operations that are difficult to achieve with existing models. Ultimately, our results establish a practical and scalable approach for bridging synthetic control and real-world photographic emulation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 39 references that are in the map. First posted on arXiv 24 May 2026.

Builds on

32 of 39 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  9. 2025VACE: All-in-One Video Creation and Editingcited by 479
  10. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
  11. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  12. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
20 more
  1. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
  2. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  3. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
  4. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 178
  5. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  6. 2024Training-free Camera Control for Video Generationcited by 122
  7. 2023Motion-Conditioned Diffusion Model for Controllable Video Synthesiscited by 99
  8. 2025CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generationcited by 74
  9. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
  10. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 57
  11. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generationcited by 50
  12. 2025Captain Cinema: Towards Short Movie Generationcited by 48
  13. 2025Depth Any Camera: Zero-Shot Metric Depth Estimation from Any Cameracited by 40
  14. 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
  15. 2024AKiRa: Augmentation Kit on Rays for optical video generationcited by 18
  16. 2024Latent-Reframe: Enabling Camera Control for Video Diffusion Model without Trainingcited by 13
  17. 2025Bokehlicious: Photorealistic Bokeh Rendering with Controllable Aperturescited by 11
  18. 2021Neural Camera Simulatorscited by 10
  19. 2025DisMo: Disentangled Motion Representations for Open-World Motion Transfercited by 10
  20. 2025CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color Constancycited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Probing into Camera Control of Video Models
  2. 2026PartiCam: Camera Controlled Video Generation with Reward Guidance
  3. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Control
  4. 2025CtrlVDiff: Controllable Video Generation via Unified Multimodal Video Diffusion
  5. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control
  6. 2025BulletTime: Decoupled Control of Time and Camera Pose for Video Generation
  7. 2024Boosting Camera Motion Control for Video Diffusion Transformers
  8. 2026CamLit: Unified Video Diffusion with Explicit Camera and Lighting Control