Editable Indoor Lighting Estimation
Not on the map. Why?
Abstract (arXiv)
We present a method for estimating lighting from a single perspective image of an indoor scene. Previous methods for predicting indoor illumination usually focus on either simple, parametric lighting that lack realism, or on richer representations that are difficult or even impossible to understand or modify after prediction. We propose a pipeline that estimates a parametric light that is easy to edit and allows renderings with strong shadows, alongside with a non-parametric texture with high-frequency information necessary for realistic rendering of specular objects. Once estimated, the predictions obtained with our model are interpretable and can easily be modified by an artist/user with a few mouse clicks. Quantitative and qualitative results show that our approach makes indoor lighting estimation easier to handle by a casual user, while still producing competitive results.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 8 Nov 2022.
Builds on
27 of 35 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 203
- 2017Learning to Predict Indoor Illumination from a Single Imagecited by 161
- 2019Neural Inverse Rendering of an Indoor Scene from a Single Imagecited by 101
- 2018LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Imagecited by 95
- 2019Deep Parametric Indoor Lighting Estimationcited by 83
15 more
- 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 83
- 2019Fast Spatially-Varying Indoor Lighting Estimationcited by 73
- 2019DeepLight: Learning Illumination for Unconstrained Mobile Mixed Realitycited by 63
- 2020Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illuminationcited by 63
- 2019Neural Illumination: Lighting Prediction for Indoor Environmentscited by 58
- 2019Corners for Layout: End-to-End Layout Recovery from 360 Imagescited by 55
- 2020EMLight: Lighting Estimation via Spherical Distribution Approximationcited by 48
- 2020HDR Environment Map Estimation for Real-Time Augmented Realitycited by 47
- 2017RoomNet: End-to-End Room Layout Estimationcited by 38
- 2021GMLight: Lighting Estimation via Geometric Distribution Approximationcited by 28
- 2020PointAR: Efficient Lighting Estimation for Mobile Augmented Realitycited by 19
- 2021Sparse Needlets for Lighting Estimation with Spherical Transport Losscited by 18
- 2018Learning to Estimate Indoor Lighting from 3D Objectscited by 17
- 2021Learning to Reconstruct 3D Non-Cuboid Room Layout from a Single RGB Imagecited by 7
- 2022Deep Graph Learning for Spatially-Varying Indoor Lighting Predictioncited by 6
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 4.
12 papers.
- 2023DiffusionLight: Light Probes for Free by Painting a Chrome Ballcited by 64
- 2023EverLight: Indoor-Outdoor Editable HDR Lighting Estimationcited by 32
- 2024Latent Intrinsics Emerge from Training to Relightcited by 17
- 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusioncited by 16
- 2025LuxDiT: Lighting Estimation with Video Diffusion Transformercited by 15
- 2025DiffusionLight-Turbo: Accelerated Light Probes for Free via Single-Pass Chrome Ball Inpaintingcited by 12
- 2023Towards a Perceptual Evaluation Framework for Lighting Estimationcited by 5
- 2024MAIR++: Improving Multi-view Attention Inverse Rendering with Implicit Lighting Representationcited by 3
- 2024360U-Former: HDR Illumination Estimation with Panoramic Adapted Vision Transformerscited by 3
- 2024ESR-NeRF: Emissive Source Reconstruction Using LDR Multi-view Imagescited by 2
- 2025HDR Environment Map Estimation with Latent Diffusion Modelscited by 0
- 2025Improving the color accuracy of lighting estimation modelscited by 0
- 2025Improving the color accuracy of lighting estimation models22 Sep 2025
- 2025LuxDiT: Lighting Estimation with Video Diffusion Transformer3 Sep 2025
- 2025HDR Environment Map Estimation with Latent Diffusion Models28 Jul 2025
- 2025DiffusionLight-Turbo: Accelerated Light Probes for Free via Single-Pass Chrome Ball Inpainting2 Jul 2025
- 2024360U-Former: HDR Illumination Estimation with Panoramic Adapted Vision Transformers17 Oct 2024
- 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusion10 Oct 2024
- 2024MAIR++: Improving Multi-view Attention Inverse Rendering with Implicit Lighting Representation13 Aug 2024
- 2024Latent Intrinsics Emerge from Training to Relight31 May 2024
- 2024ESR-NeRF: Emissive Source Reconstruction Using LDR Multi-view Images24 Apr 2024
- 2023DiffusionLight: Light Probes for Free by Painting a Chrome Ball14 Dec 2023
- 2023Towards a Perceptual Evaluation Framework for Lighting Estimation7 Dec 2023
- 2023EverLight: Indoor-Outdoor Editable HDR Lighting Estimation26 Apr 2023