mlsanityData to 7 Oct 2026

IRIS: Inverse Rendering of Indoor Scenes from Low Dynamic Range Images

arXiv 2401.12977 ↗First posted 23 Jan 2024cs.CV cs.GRcited by 19

Not on the map. Why?

Abstract (arXiv)

Inverse rendering seeks to recover 3D geometry, surface material, and lighting from captured images, enabling advanced applications such as novel-view synthesis, relighting, and virtual object insertion. However, most existing techniques rely on high dynamic range (HDR) images as input, limiting accessibility for general users. In response, we introduce IRIS, an inverse rendering framework that recovers the physically based material, spatially-varying HDR lighting, and camera response functions from multi-view, low-dynamic-range (LDR) images. By eliminating the dependence on HDR input, we make inverse rendering technology more accessible. We evaluate our approach on real-world and synthetic scenes and compare it with state-of-the-art methods. Our results show that IRIS effectively recovers HDR lighting, accurate material, and plausible camera response functions, supporting photorealistic relighting and object insertion.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 45 of its 62 references that are in the map. First posted on arXiv 23 Jan 2024.

Builds on

45 of 62 references.

References · 45

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  2. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  3. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  4. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  5. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
  6. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  7. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  8. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  9. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  10. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
  11. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  12. 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 202
33 more
  1. 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
  2. 2023TensoIR: Tensorial Inverse Renderingcited by 166
  3. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  4. 2017Learning to Predict Indoor Illumination from a Single Imagecited by 160
  5. 2020Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipelinecited by 131
  6. 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
  7. 2021HDR-NeRF: High Dynamic Range Neural Radiance Fieldscited by 113
  8. 2022NeILF: Neural Incident Light Field for Physically-based Material Estimationcited by 105
  9. 2018ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Contentcited by 89
  10. 2023Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenescited by 89
  11. 2018CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Renderingcited by 85
  12. 2019Deep Parametric Indoor Lighting Estimationcited by 82
  13. 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 82
  14. 2018Learning Intrinsic Image Decomposition from Watching the Worldcited by 74
  15. 2020OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasetscited by 73
  16. 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 73
  17. 2018Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Imagecited by 66
  18. 2019Deep Sky Modeling for Single Image Outdoor Lighting Estimationcited by 66
  19. 2019Inverse Path Tracing for Joint Material and Lighting Estimationcited by 62
  20. 2020Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illuminationcited by 62
  21. 2022Physically-Based Editing of Indoor Scene Lighting from a Single Imagecited by 62
  22. 2022IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenescited by 62
  23. 2016Deep Outdoor Illumination Estimationcited by 53
  24. 2018Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networkscited by 51
  25. 2021Free-viewpoint Indoor Neural Relighting from Multi-view Stereocited by 50
  26. 2023Neural-PBIR Reconstruction of Shape, Material, and Illuminationcited by 45
  27. 2023I2-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFscited by 42
  28. 2019All-Weather Deep Outdoor Lighting Estimationcited by 41
  29. 2023NeFII: Inverse Rendering for Reflectance Decomposition with Near-Field Indirect Illuminationcited by 38
  30. 2017Learning High Dynamic Range from Outdoor Panoramascited by 34
  31. 2018Image Correction via Deep Reciprocating HDR Transformationcited by 30
  32. 2023Factorized Inverse Path Tracing for Efficient and Accurate Material-Lighting Estimationcited by 22
  33. 2023UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Videocited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 11.

19 papers.

Sort:

By area:

  1. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  2. 2025RealX3D: A Physically-Degraded 3D Benchmark for Multi-view Visual Restoration and Reconstructioncited by 19
  3. 2024Generative Multiview Relighting for 3D Reconstruction under Extreme Illumination Variationcited by 13
  4. 2025HoloScene: Simulation-Ready Interactive 3D Worlds from a Single Videocited by 13
  5. 2025Intrinsic Image Fusion for Multi-View 3D Material Reconstructioncited by 7
  6. 2026LuxRemix: Lighting Decomposition and Remixing for Indoor Scenescited by 7
  7. 2025MVInverse: Feed-forward Multi-view Inverse Rendering in Secondscited by 5
  8. 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularizationcited by 2
  9. 2026InvSplat: Inverse Feed-Forward Scene Splattingcited by 1
  10. 2026Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relightingcited by 1
  11. 2025Multi-scale Attention-Guided Intrinsic Decomposition and Rendering Pass Prediction for Facial Imagescited by 0
  12. 2026LightHarmony3D: Harmonizing Illumination and Shadows for Object Insertion in 3D Gaussian Splattingcited by 0
7 more
  1. 2026PhysEditBench: A Protocol-Conditioned Benchmark for Dense Physical-Map Prediction with Image Editorscited by 0
  2. 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructionscited by 0
  3. 2026Extracting Neural Materials from Imagescited by 0
  4. 2026AEGIR: Modeling Area Emitters for Indoor Inverse Rendering using Gaussian Splattingcited by 0
  5. 2026RoomLight: A 2.5D Illumination Prior for Indoor Environmentscited by 0
  6. 2026Texture Space Material Diffusioncited by 0
  7. 2026EvenSplat: Coupled 2D-3D Decomposition for Gaussian Splatting under Exposure and Illumination Variationcited by 0