Light-X: Generative 4D Video Rendering with Camera and Illumination Control
Not on the map. Why?
Abstract (arXiv)
Recent advances in illumination control extend image-based methods to video, yet still facing a trade-off between lighting fidelity and temporal consistency. Moving beyond relighting, a key step toward generative modeling of real-world scenes is the joint control of camera trajectory and illumination, since visual dynamics are inherently shaped by both geometry and lighting. To this end, we present Light-X, a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control. 1) We propose a disentangled design that decouples geometry and lighting signals: geometry and motion are captured via dynamic point clouds projected along user-defined camera trajectories, while illumination cues are provided by a relit frame consistently projected into the same geometry. These explicit, fine-grained cues enable effective disentanglement and guide high-quality illumination. 2) To address the lack of paired multi-view and multi-illumination videos, we introduce Light-Syn, a degradation-based pipeline with inverse-mapping that synthesizes training pairs from in-the-wild monocular footage. This strategy yields a dataset covering static, dynamic, and AI-generated scenes, ensuring robust training. Extensive experiments show that Light-X outperforms baseline methods in joint camera-illumination control and surpasses prior video relighting methods under both text- and background-conditioned settings.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 94 of its 111 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
94 of 111 references.
References · 94
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Generative Adversarial Networkscited by 5,603
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
38 more
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
- 2016Generating Videos with Scene Dynamicscited by 376
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2015Deep multi-scale video prediction beyond mean square errorcited by 297
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
- 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
50 most cited of 94 All 94 (JSON)
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 39
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 7
- 2026FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstructioncited by 4
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effectscited by 4
- 2026Light4D: Training-Free Extreme Viewpoint 4D Video Relightingcited by 2
- 2026Relit-LiVE: Relight Video by Jointly Learning Environment Videocited by 1
- 2026CameraAnything: Refilming Videos with Arbitrary Camera Controlcited by 1
- 2026DEVIS-GRPO: Unleashing GRPO on Dynamic Extreme View Synthesiscited by 0
- 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Modelscited by 0
- 2026LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relightingcited by 0
- 2026ID-V2V: Identity-Preserving Video Restylizationcited by 0
- 2026CameraAnything: Refilming Videos with Arbitrary Camera Control27 Jul 2026
- 2026ID-V2V: Identity-Preserving Video Restylization24 Jul 2026
- 2026LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting9 Jul 2026
- 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Models17 Jun 2026
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformation26 May 2026
- 2026DEVIS-GRPO: Unleashing GRPO on Dynamic Extreme View Synthesis16 May 2026
- 2026Relit-LiVE: Relight Video by Jointly Learning Environment Video7 May 2026
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects17 Apr 2026
- 2026Light4D: Training-Free Extreme Viewpoint 4D Video Relighting12 Feb 2026
- 2026FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstruction26 Jan 2026
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videos1 Jan 2026