mlsanityData to 14 Oct 2026

RelightVid: Temporal-Consistent Diffusion Model for Video Relighting

arXiv 2501.16330 ↗First posted 27 Jan 2025cs.CV cs.AIcited by 29

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Diffusion models have demonstrated remarkable success in image generation and editing, with recent advancements enabling albedo-preserving image relighting. However, applying these models to video relighting remains challenging due to the lack of paired video relighting datasets and the high demands for output fidelity and temporal consistency, further complicated by the inherent randomness of diffusion models. To address these challenges, we introduce RelightVid, a flexible framework for video relighting that can accept background video, text prompts, or environment maps as relighting conditions. Trained on in-the-wild videos with carefully designed illumination augmentations and rendered videos under extreme dynamic lighting, RelightVid achieves arbitrary video relighting with high temporal consistency without intrinsic decomposition while preserving the illumination priors of its image backbone.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 16 of its 57 references that are in the map. First posted on arXiv 27 Jan 2025.

Builds on

16 of 57 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Neural Gaffer: Relighting Any Object via Diffusion11 Jun
  2. 2024Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Data31 May
  3. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 13

  1. 2020Denoising Diffusion Implicit Modelscited by 9,781
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2017Decoupled Weight Decay Regularizationcited by 1,831
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  7. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  8. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  9. 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
  10. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  11. 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
  12. 2024X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Modelscited by 15
1 more
  1. 2024ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Waycited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 13; 2026: 16.

29 papers.

Sort:

By area:

  1. 2025VidCRAFT3: Camera, Object, and Lighting Control for Image-to-Video Generationcited by 25
  2. 2025LightSwitch: Multi-view Relighting with Material-guided Diffusioncited by 15
  3. 2025Lumen: Consistent Video Relighting and Harmonious Background Replacement with Video Generative Modelscited by 13
  4. 2025UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedbackcited by 12
  5. 2025Light-X: Generative 4D Video Rendering with Camera and Illumination Controlcited by 12
  6. 2025TC-Light: Temporally Coherent Generative Rendering for Realistic World Transfercited by 11
  7. 2025RelightMaster: Precise Video Relighting with Multi-plane Light Imagescited by 8
  8. 2025IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generationcited by 7
  9. 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
  10. 2025FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacementcited by 6
  11. 2025ANYPORTAL: Zero-Shot Consistent Video Background Replacementcited by 5
  12. 2026GR3EN: Generative Relighting for 3D Environmentscited by 5
17 more
  1. 2025Taming generative video models for zero-shot optical flow extractioncited by 4
  2. 2026LightCtrl: Training-free Controllable Video Relightingcited by 3
  3. 2025Training-Free Multi-View Extension of IC-Light for Textual Position-Aware Scene Relightingcited by 2
  4. 2026Light4D: Training-Free Extreme Viewpoint 4D Video Relightingcited by 2
  5. 2025ReLumix: Extending Image Relighting to Video via Video Diffusion Modelscited by 1
  6. 2026TokenLight: Precise Lighting Control in Images using Attribute Tokenscited by 1
  7. 2026Relit-LiVE: Relight Video by Jointly Learning Environment Videocited by 1
  8. 2026ID-V2V: Identity-Preserving Video Restylizationcited by 1
  9. 2026SyncLight: Single-Edit Multi-View Relightingcited by 0
  10. 2026GO-Renderer: Generative Object Rendering with 3D-aware Controllable Video Diffusion Modelscited by 0
  11. 2026VibeFlow: Versatile Video Chroma-Lux Editing through Self-Supervised Learningcited by 0
  12. 2026FusionRelight: Relighting Portraits in Real Time via Hybrid Domain Knowledge Fusioncited by 0
  13. 2026BodyReLux: Temporally Consistent Full-Body Video Relightingcited by 0
  14. 2026HarmoVid: Relightful Video Portrait Harmonizationcited by 0
  15. 2026Pixel Cube: Diffusion-based Portrait Video Relighting Through Realistic Lighting Reproductioncited by 0
  16. 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Modelscited by 0
  17. 2026FreeCHROMA: Generative Chroma Keying from Unaligned Background Referencescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusion
  2. 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting
  3. 2026LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting
  4. 2026HorizonRelight: Relighting Long-horizon Videos Consistently via Diffusion Transformers
  5. 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset
  6. 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization
  7. 2025Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gap
  8. 2024GenLit: Reformulating Single-Image Relighting as Video Generation