Improving the color accuracy of lighting estimation models
Not on the map. Why?
Abstract (arXiv)
Advances in high dynamic range (HDR) lighting estimation from a single image have opened new possibilities for augmented reality (AR) applications. Predicting complex lighting environments from a single input image allows for the realistic rendering and compositing of virtual objects. In this work, we investigate the color robustness of such methods -- an often overlooked yet critical factor for achieving visual realism. While most evaluations conflate color with other lighting attributes (e.g., intensity, direction), we isolate color as the primary variable of interest. Rather than introducing a new lighting estimation algorithm, we explore whether simple adaptation techniques can enhance the color accuracy of existing models. Using a novel HDR dataset featuring diverse lighting colors, we systematically evaluate several adaptation strategies. Our results show that preprocessing the input image with a pre-trained white balance network improves color robustness, outperforming other strategies across all tested scenarios. Notably, this approach requires no retraining of the lighting estimation model. We further validate the generality of this finding by applying the technique to three state-of-the-art lighting estimation methods from recent literature.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
21 of 31 references.
References · 21
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2017Are GANs Created Equal? A Large-Scale Studycited by 267
- 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 203
- 2017Learning to Predict Indoor Illumination from a Single Imagecited by 161
- 2019Deep Parametric Indoor Lighting Estimationcited by 83
- 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 83
- 2019Fast Spatially-Varying Indoor Lighting Estimationcited by 73
- 2023DiffusionLight: Light Probes for Free by Painting a Chrome Ballcited by 64
- 2019DeepLight: Learning Illumination for Unconstrained Mobile Mixed Realitycited by 63
- 2020Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illuminationcited by 63
- 2022IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenescited by 62
9 more
- 2022StyleLight: HDR Panorama Generation for Lighting Estimation and Editingcited by 59
- 2019Neural Illumination: Lighting Prediction for Indoor Environmentscited by 58
- 2020Deep White-Balance Editingcited by 54
- 2020EMLight: Lighting Estimation via Spherical Distribution Approximationcited by 48
- 2020HDR Environment Map Estimation for Real-Time Augmented Realitycited by 47
- 2019A Dataset of Multi-Illumination Images in the Wildcited by 45
- 2023EverLight: Indoor-Outdoor Editable HDR Lighting Estimationcited by 32
- 2021GMLight: Lighting Estimation via Geometric Distribution Approximationcited by 28
- 2022Editable Indoor Lighting Estimationcited by 12
Built on by
Not cited yet.