RoomLight: A 2.5D Illumination Prior for Indoor Environments
Not on the map. Why?
Abstract (arXiv)
Ill-posed inverse problems require priors to constrain the solution space toward plausible outcomes. In inverse rendering, learned priors modeling the distribution of natural illumination improve the recovery of scene properties. However, existing models rely on the distant-illumination assumption, representing lighting as a far-field environment map. This limits their applicability to indoor scenes, where illumination is highly spatially varying due to finite-distance emitters, visibility changes, and parallax, all of which are poorly approximated by a single environment map. To address this, we introduce a spatially-aware illumination prior trained on real-world indoor panoramas and their estimated depth. Our variational autoencoder model learns a compact, optimizable latent space that decodes into HDR radiance and depth, parameterizing an area light emitter for direct integration into standard differentiable rendering pipelines. This design bridges the plausibility guarantees of a learned prior with the gradient flow required for downstream optimization. Crucially, by jointly modeling radiance and depth, our prior captures the spatial structure of indoor illumination, instead of treating the light sources as infinitely distant. We demonstrate that this formulation enables spatially-varying illumination modeling and achieves higher-fidelity recovery of indoor lighting compared to existing approaches. Project page: https://andreead-a.github.io/RoomLight
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 65 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
40 of 65 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2018Group Normalizationcited by 1,524
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 307
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
28 more
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 205
- 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 203
- 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
- 2017Learning to Predict Indoor Illumination from a Single Imagecited by 161
- 2018OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramascited by 99
- 2019Deep Parametric Indoor Lighting Estimationcited by 83
- 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 83
- 2019Fast Spatially-Varying Indoor Lighting Estimationcited by 73
- 2023DiffusionLight: Light Probes for Free by Painting a Chrome Ballcited by 64
- 2019DeepLight: Learning Illumination for Unconstrained Mobile Mixed Realitycited by 63
- 2022IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenescited by 62
- 2022StyleLight: HDR Panorama Generation for Lighting Estimation and Editingcited by 59
- 2019Neural Illumination: Lighting Prediction for Indoor Environmentscited by 58
- 2023EverLight: Indoor-Outdoor Editable HDR Lighting Estimationcited by 32
- 2021Neural BRDF Representation and Importance Samplingcited by 28
- 2023Factorized Inverse Path Tracing for Efficient and Accurate Material-Lighting Estimationcited by 23
- 2024IRIS: Inverse Rendering of Indoor Scenes from Low Dynamic Range Imagescited by 20
- 2021Outdoor inverse rendering from a single image using multiview self-supervisioncited by 18
- 2025Physically Controllable Relighting of Photographscited by 14
- 2022Rotation-Equivariant Conditional Spherical Neural Fields for Learning a Natural Illumination Priorcited by 12
- 2023Spatiotemporally Consistent HDR Indoor Lighting Estimationcited by 12
- 20263D-Fixer: Coarse-to-Fine In-place Completion for 3D Scenes from a Single Imagecited by 11
- 2025Materialist: Physically Based Editing Using Single-Image Inverse Renderingcited by 10
- 2023RENI++ A Rotation-Equivariant, Scale-Invariant, Natural Illumination Priorcited by 6
- 2025Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priorscited by 6
- 2025Lighting in Motion: Spatiotemporal HDR Lighting Estimationcited by 2
- 2026VENI: Variational Encoder for Natural Illuminationcited by 1
Built on by
Not cited yet.