mlsanityData to 7 Oct 2026

TokenLight: Precise Lighting Control in Images using Attribute Tokens

arXiv 2604.15310 ↗First posted 16 Apr 2026cs.CV cs.GRcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper presents a method for image relighting that enables precise and continuous control over multiple illumination attributes in a photograph. We formulate relighting as a conditional image generation task and introduce attribute tokens to encode distinct lighting factors such as intensity, color, ambient illumination, diffuse level, and 3D light positions. The model is trained on a large-scale synthetic dataset with ground-truth lighting annotations, supplemented by a small set of real captures to enhance realism and generalization. We validate our approach across a variety of relighting tasks, including controlling in-scene lighting fixtures and editing environment illumination using virtual light sources, on synthetic and real images. Our method achieves state-of-the-art quantitative and qualitative performance compared to prior work. Remarkably, without explicit inverse rendering supervision, the model exhibits an inherent understanding of how light interacts with scene geometry, occlusion, and materials, yielding convincing lighting effects even in traditionally challenging scenarios such as placing lights within objects or relighting transparent materials plausibly. Project page: vrroom.github.io/tokenlight/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 52 of its 75 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

52 of 75 references.

References · 52

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  10. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  11. 2023Consistency Modelscited by 1,778
  12. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
38 more
  1. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  2. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  4. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
  5. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  6. 2024Flow Matching Guide and Codecited by 291
  7. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
  8. 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
  9. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  10. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
  11. 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
  12. 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
  13. 2024SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relightingcited by 66
  14. 2022StyleLight: HDR Panorama Generation for Lighting Estimation and Editingcited by 59
  15. 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 56
  16. 2024LightIt: Illumination Modeling and Control for Diffusion Modelscited by 56
  17. 2021DIB-R++: Learning to Predict Lighting and Material with a Hybrid Differentiable Renderercited by 52
  18. 2022Face Relighting with Geometrically Consistent Shadowscited by 43
  19. 2020Portrait Shadow Manipulationcited by 42
  20. 2024LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relightingcited by 37
  21. 2025LightLab: Controlling Light Sources in Images with Diffusion Modelscited by 36
  22. 2022OutCast: Outdoor Single-image Relighting with Cast Shadowscited by 30
  23. 2025RelightVid: Temporal-Consistent Diffusion Model for Video Relightingcited by 28
  24. 2025Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Datasetcited by 28
  25. 2025SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Facescited by 24
  26. 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
  27. 2024ScribbleLight: Single Image Indoor Relighting with Scribblescited by 22
  28. 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
  29. 2024Real-time 3D-aware Portrait Video Relightingcited by 21
  30. 2024GenLit: Reformulating Single-Image Relighting as Video Generationcited by 20
  31. 2025IntrinsicEdit: Precise generative image manipulation in intrinsic spacecited by 17
  32. 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusioncited by 16
  33. 2023Weakly-supervised Single-view Image Relightingcited by 14
  34. 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonizationcited by 12
  35. 2025UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedbackcited by 12
  36. 2023Controllable Light Diffusion for Portraitscited by 11
  37. 2024Generative Portrait Shadow Removalcited by 10
  38. 2024Text2Relight: Creative Portrait Relighting with Text Guidancecited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.