HorizonRelight: Relighting Long-horizon Videos Consistently via Diffusion Transformers
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Diffusion-based video relighting enables controllable relighting from a single input video, but modern video diffusion backbones are trained on short clips and applied to long-horizon videos through chunked sliding-window inference, often causing temporal discontinuities at chunk boundaries. We address this by reframing long-horizon relighting as temporally conditioned latent domain translation. Our framework enforces cross-chunk continuity by propagating target-domain latents across boundaries and makes this behavior learnable using masked target-domain self-conditioning, training the model to continue from temporally masked propagated context. We further introduce warm-start prompting with a relit prompt anchor from a controllable generative model, which establishes the initial target-domain state and creates a general interface for prompt-based relighting. Experiments on in-the-wild long-horizon videos show markedly improved temporal consistency, with chunk-boundary artifacts largely reduced and unwanted appearance changes across chunks greatly suppressed.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 25 of its 31 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
25 of 31 references.
Closest ancestors · 6
Same direction, newest first
- 2025DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Models30 Jan
- 2024GenLit: Reformulating Single-Image Relighting as Video Generation15 Dec
- 2024Neural Gaffer: Relighting Any Object via Diffusion11 Jun
- 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion models1 May
- 2024LightIt: Illumination Modeling and Control for Diffusion Models15 Mar
- 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generation19 Feb
Other references · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
- 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
7 more
- 2025VSA: Faster Video Diffusion with Trainable Sparse Attentioncited by 104
- 2025Long-Context State-Space Video World Modelscited by 64
- 2016Deep Shading: Convolutional Neural Networks for Screen-Space Shadingcited by 46
- 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 40
- 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relightingcited by 40
- 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
- 2025DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelismcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Generative World Renderer at the Speed of Playcited by 4
- 2026Generative World Renderer at the Speed of Play21 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025RelightVid: Temporal-Consistent Diffusion Model for Video Relighting
- 2026LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting
- 2025ReLumix: Extending Image Relighting to Video via Video Diffusion Models
- 2025RelightMaster: Precise Video Relighting with Multi-plane Light Images
- 2026Relit-LiVE: Relight Video by Jointly Learning Environment Video
- 2025Light-A-Video: Training-free Video Relighting via Progressive Light Fusion
- 2026LightCtrl: Training-free Controllable Video Relighting
- 2025Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gap