mlsanityData to 14 Oct 2026

SIRe-IR: Inverse Rendering for BRDF Reconstruction with Shadow and Illumination Removal in High-Illuminance Scenes

arXiv 2310.13030 ↗First posted 19 Oct 2023cs.CVcited by 19

Not on the map. Why?

Abstract (arXiv)

Implicit neural representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and indirect illumination. The existence of shadows and reflections can lead to an inaccurate understanding of scene geometry, making precise factorization difficult. To this end, we present SIRe-IR, an implicit neural inverse rendering approach that uses non-linear mapping and regularized visibility estimation to decompose the scene into environment map, albedo, and roughness. By accurately modeling the indirect radiance field, normal, visibility, and direct light simultaneously, we are able to remove both shadows and indirect illumination in materials without imposing strict constraints on the scene. Even in the presence of intense illumination, our method recovers high-quality albedo and roughness with no shadow interference. SIRe-IR outperforms existing methods in both quantitative and qualitative evaluations.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 42 of its 60 references that are in the map. First posted on arXiv 19 Oct 2023.

Builds on

42 of 60 references.

References · 42

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  2. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  3. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  4. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  5. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  6. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  7. 2020Neural Sparse Voxel Fieldscited by 959
  8. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  9. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
  10. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  11. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  12. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
30 more
  1. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  2. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
  3. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
  4. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
  5. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  6. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
  7. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
  8. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 205
  9. 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 203
  10. 2022Modeling Indirect Illumination for Inverse Renderingcited by 168
  11. 2023TensoIR: Tensorial Inverse Renderingcited by 168
  12. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  13. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  14. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  15. 2021HDR-NeRF: High Dynamic Range Neural Radiance Fieldscited by 114
  16. 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 111
  17. 2022NeILF: Neural Incident Light Field for Physically-based Material Estimationcited by 105
  18. 2019Neural Inverse Rendering of an Indoor Scene from a Single Imagecited by 101
  19. 2018InverseRenderNet: Learning single image inverse renderingcited by 100
  20. 2020Deep Reflectance Volumes: Relightable Reconstructions from Multi-View Photometric Imagescited by 98
  21. 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
  22. 2022Neural 3D Reconstruction in the Wildcited by 79
  23. 2022PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereocited by 69
  24. 2022Improved Direct Voxel Grid Optimization for Radiance Fields Reconstructioncited by 61
  25. 2020Two-shot Spatially-varying BRDF and Shape Estimationcited by 59
  26. 2022NeROIC: Neural Rendering of Objects from Online Image Collectionscited by 36
  27. 2019Real-Time Global Illumination Decomposition of Videoscited by 18
  28. 2021Multi-view 3D Reconstruction of a Texture-less Smooth Surface of Unknown Generic Reflectancecited by 17
  29. 2021Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesiscited by 12
  30. 2022A Novel Intrinsic Image Decomposition Method to Recover Albedo for Aerial Images in Photogrammetry Processingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 11; 2025: 3; 2026: 4.

19 papers.

Sort:

  1. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  2. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
  3. 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
  4. 2025SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Renderingcited by 23
  5. 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Renderingcited by 22
  6. 2024Deformable Radial Kernel Splattingcited by 17
  7. 2024RNG: Relightable Neural Gaussianscited by 16
  8. 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fieldscited by 16
  9. 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videocited by 12
  10. 2024GS-ROR2: Bidirectional-guided 3DGS and SDF for Reflective Object Relighting and Reconstructioncited by 11
  11. 2025RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflectioncited by 10
  12. 2026PhaSR: Generalized Image Shadow Removal with Physically Aligned Priorscited by 4
7 more
  1. 2024Towards Realistic Example-based Modeling via 3D Gaussian Stitchingcited by 3
  2. 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularizationcited by 2
  3. 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windowscited by 2
  4. 2024MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fieldscited by 1
  5. 2024Learning Relighting and Intrinsic Decomposition in Neural Radiance Fieldscited by 0
  6. 2026Rotated Lights for Consistent and Efficient 2D Gaussians Inverse Renderingcited by 0
  7. 2026CFSR: Geometry-Conditioned Shadow Removal via Physical Disentanglementcited by 0