Dior: Drawing the Light of Image via Material-Decoupled Illumination Representation
Not on the map. Why?
Abstract (arXiv)
Controllable image relighting is an important problem in image editing, and hand-drawn scribbles provide an intuitive interface for specifying the desired illumination. However, existing methods do not establish a consistent and effective mapping between scribble inputs and relighting results, limiting their ability to control illumination intensity, chromaticity, and complex spatial distributions. We address this limitation by introducing a material-decoupled illumination representation, termed the Lumi Map, which establishes an explicit mapping between user scribbles and the resulting illumination, thereby improving both relighting accuracy and controllability. Specifically, we use a renderer to synthesize source image-Lumi Map-relit image triplets and train the model to predict the target relighting result conditioned on the Lumi Map. To mitigate the domain gap introduced by synthetic data, we further perform reconstruction training on real relighting pairs, improving the model's generalization to real-world images. Finally, we present Dior-Light, an image relighting method controlled by hand-drawn strokes. Extensive experiments demonstrate that our method outperforms existing approaches in relighting accuracy and enables effective control over illumination intensity and chromaticity on in-the-wild images.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
13 of 24 references.
References · 13
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Qwen-Image Technical Reportcited by 1,044
- 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 161
- 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
- 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
- 2019A Dataset of Multi-Illumination Images in the Wildcited by 45
- 2024Colorful Diffuse Intrinsic Image Decomposition in the Wildcited by 44
- 2023ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objectscited by 42
- 2024ScribbleLight: Single Image Indoor Relighting with Scribblescited by 24
- 2026TokenLight: Precise Lighting Control in Images using Attribute Tokenscited by 1
Built on by
Not cited yet.