TokenLight: Precise Lighting Control in Images using Attribute Tokens
Not on the map. Why?
Abstract (arXiv)
This paper presents a method for image relighting that enables precise and continuous control over multiple illumination attributes in a photograph. We formulate relighting as a conditional image generation task and introduce attribute tokens to encode distinct lighting factors such as intensity, color, ambient illumination, diffuse level, and 3D light positions. The model is trained on a large-scale synthetic dataset with ground-truth lighting annotations, supplemented by a small set of real captures to enhance realism and generalization. We validate our approach across a variety of relighting tasks, including controlling in-scene lighting fixtures and editing environment illumination using virtual light sources, on synthetic and real images. Our method achieves state-of-the-art quantitative and qualitative performance compared to prior work. Remarkably, without explicit inverse rendering supervision, the model exhibits an inherent understanding of how light interacts with scene geometry, occlusion, and materials, yielding convincing lighting effects even in traditionally challenging scenarios such as placing lights within objects or relighting transparent materials plausibly. Project page: vrroom.github.io/tokenlight/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 52 of its 75 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
52 of 75 references.
References · 52
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2023Consistency Modelscited by 1,778
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
38 more
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024Flow Matching Guide and Codecited by 291
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
- 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
- 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
- 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
- 2024SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relightingcited by 66
- 2022StyleLight: HDR Panorama Generation for Lighting Estimation and Editingcited by 59
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 56
- 2024LightIt: Illumination Modeling and Control for Diffusion Modelscited by 56
- 2021DIB-R++: Learning to Predict Lighting and Material with a Hybrid Differentiable Renderercited by 52
- 2022Face Relighting with Geometrically Consistent Shadowscited by 43
- 2020Portrait Shadow Manipulationcited by 42
- 2024LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relightingcited by 37
- 2025LightLab: Controlling Light Sources in Images with Diffusion Modelscited by 36
- 2022OutCast: Outdoor Single-image Relighting with Cast Shadowscited by 30
- 2025RelightVid: Temporal-Consistent Diffusion Model for Video Relightingcited by 28
- 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Datasetcited by 28
- 2025SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Facescited by 24
- 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
- 2024ScribbleLight: Single Image Indoor Relighting with Scribblescited by 22
- 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
- 2024Real-time 3D-aware Portrait Video Relightingcited by 21
- 2024GenLit: Reformulating Single-Image Relighting as Video Generationcited by 20
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic spacecited by 17
- 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusioncited by 16
- 2023Weakly-supervised Single-view Image Relightingcited by 14
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonizationcited by 12
- 2025UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedbackcited by 12
- 2023Controllable Light Diffusion for Portraitscited by 11
- 2024Generative Portrait Shadow Removalcited by 10
- 2024Text2Relight: Creative Portrait Relighting with Text Guidancecited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.