mlsanityData to 7 Oct 2026

Light-X: Generative 4D Video Rendering with Camera and Illumination Control

arXiv 2512.05115 ↗First posted 4 Dec 2025cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Recent advances in illumination control extend image-based methods to video, yet still facing a trade-off between lighting fidelity and temporal consistency. Moving beyond relighting, a key step toward generative modeling of real-world scenes is the joint control of camera trajectory and illumination, since visual dynamics are inherently shaped by both geometry and lighting. To this end, we present Light-X, a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control. 1) We propose a disentangled design that decouples geometry and lighting signals: geometry and motion are captured via dynamic point clouds projected along user-defined camera trajectories, while illumination cues are provided by a relit frame consistently projected into the same geometry. These explicit, fine-grained cues enable effective disentanglement and guide high-quality illumination. 2) To address the lack of paired multi-view and multi-illumination videos, we introduce Light-Syn, a degradation-based pipeline with inverse-mapping that synthesizes training pairs from in-the-wild monocular footage. This strategy yields a dataset covering static, dynamic, and AI-generated scenes, ensuring robust training. Extensive experiments show that Light-X outperforms baseline methods in joint camera-illumination control and surpasses prior video relighting methods under both text- and background-conditioned settings.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 94 of its 111 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

94 of 111 references.

References · 94

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2022Generative Adversarial Networkscited by 5,603
  10. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
38 more
  1. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  2. 2022Video Diffusion Modelscited by 2,280
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  5. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  10. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  11. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  12. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  13. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  14. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  15. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  16. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  17. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
  18. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  19. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  20. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  21. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  22. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  23. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  24. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  25. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  26. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
  27. 2016Generating Videos with Scene Dynamicscited by 376
  28. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
  29. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  30. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  31. 2015Deep multi-scale video prediction beyond mean square errorcited by 297
  32. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  33. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  34. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  35. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
  36. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  37. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  38. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224

50 most cited of 94 All 94 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.