SIRe-IR: Inverse Rendering for BRDF Reconstruction with Shadow and Illumination Removal in High-Illuminance Scenes
Not on the map. Why?
Abstract (arXiv)
Implicit neural representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and indirect illumination. The existence of shadows and reflections can lead to an inaccurate understanding of scene geometry, making precise factorization difficult. To this end, we present SIRe-IR, an implicit neural inverse rendering approach that uses non-linear mapping and regularized visibility estimation to decompose the scene into environment map, albedo, and roughness. By accurately modeling the indirect radiance field, normal, visibility, and direct light simultaneously, we are able to remove both shadows and indirect illumination in materials without imposing strict constraints on the scene. Even in the presence of intense illumination, our method recovers high-quality albedo and roughness with no shadow interference. SIRe-IR outperforms existing methods in both quantitative and qualitative evaluations.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 42 of its 60 references that are in the map. First posted on arXiv 19 Oct 2023.
Builds on
42 of 60 references.
References · 42
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
30 more
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
- 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
- 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
- 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 205
- 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 203
- 2022Modeling Indirect Illumination for Inverse Renderingcited by 168
- 2023TensoIR: Tensorial Inverse Renderingcited by 168
- 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
- 2021HDR-NeRF: High Dynamic Range Neural Radiance Fieldscited by 114
- 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 111
- 2022NeILF: Neural Incident Light Field for Physically-based Material Estimationcited by 105
- 2019Neural Inverse Rendering of an Indoor Scene from a Single Imagecited by 101
- 2018InverseRenderNet: Learning single image inverse renderingcited by 100
- 2020Deep Reflectance Volumes: Relightable Reconstructions from Multi-View Photometric Imagescited by 98
- 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
- 2022Neural 3D Reconstruction in the Wildcited by 79
- 2022PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereocited by 69
- 2022Improved Direct Voxel Grid Optimization for Radiance Fields Reconstructioncited by 61
- 2020Two-shot Spatially-varying BRDF and Shape Estimationcited by 59
- 2022NeROIC: Neural Rendering of Objects from Online Image Collectionscited by 36
- 2019Real-Time Global Illumination Decomposition of Videoscited by 18
- 2021Multi-view 3D Reconstruction of a Texture-less Smooth Surface of Unknown Generic Reflectancecited by 17
- 2021Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesiscited by 12
- 2022A Novel Intrinsic Image Decomposition Method to Recover Albedo for Aerial Images in Photogrammetry Processingcited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 11; 2025: 3; 2026: 4.
19 papers.
Sort:
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
- 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
- 2025SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Renderingcited by 23
- 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Renderingcited by 22
- 2024Deformable Radial Kernel Splattingcited by 17
- 2024RNG: Relightable Neural Gaussianscited by 16
- 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fieldscited by 16
- 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videocited by 12
- 2024GS-ROR2: Bidirectional-guided 3DGS and SDF for Reflective Object Relighting and Reconstructioncited by 11
- 2025RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflectioncited by 10
- 2026PhaSR: Generalized Image Shadow Removal with Physically Aligned Priorscited by 4
7 more
- 2024Towards Realistic Example-based Modeling via 3D Gaussian Stitchingcited by 3
- 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularizationcited by 2
- 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windowscited by 2
- 2024MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fieldscited by 1
- 2024Learning Relighting and Intrinsic Decomposition in Neural Radiance Fieldscited by 0
- 2026Rotated Lights for Consistent and Efficient 2D Gaussians Inverse Renderingcited by 0
- 2026CFSR: Geometry-Conditioned Shadow Removal via Physical Disentanglementcited by 0
- 2026CFSR: Geometry-Conditioned Shadow Removal via Physical Disentanglement20 Apr 2026
- 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windows6 Apr 2026
- 2026Rotated Lights for Consistent and Efficient 2D Gaussians Inverse Rendering9 Feb 2026
- 2026PhaSR: Generalized Image Shadow Removal with Physically Aligned Priors24 Jan 2026
- 2025RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflection10 Jul 2025
- 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fields28 Apr 2025
- 2025SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Rendering9 Apr 2025
- 2024Deformable Radial Kernel Splatting16 Dec 2024
- 2024MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fields26 Nov 2024
- 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Rendering31 Oct 2024
- 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Models8 Oct 2024
- 2024RNG: Relightable Neural Gaussians29 Sep 2024
7 more
- 2024Towards Realistic Example-based Modeling via 3D Gaussian Stitching28 Aug 2024
- 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularization13 Aug 2024
- 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Video21 Jul 2024
- 2024Learning Relighting and Intrinsic Decomposition in Neural Radiance Fields16 Jun 2024
- 2024GS-ROR2: Bidirectional-guided 3DGS and SDF for Reflective Object Relighting and Reconstruction22 May 2024
- 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splatting24 Feb 2024
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes4 Dec 2023
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
- 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
- 2025SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Renderingcited by 23
- 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Renderingcited by 22
- 2024Deformable Radial Kernel Splattingcited by 17
- 2024RNG: Relightable Neural Gaussianscited by 16
- 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fieldscited by 16
- 2024Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Videocited by 12
- 2024GS-ROR2: Bidirectional-guided 3DGS and SDF for Reflective Object Relighting and Reconstructioncited by 11
- 2025RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflectioncited by 10
- 2026PhaSR: Generalized Image Shadow Removal with Physically Aligned Priorscited by 4
12 most cited of 19 All 19 (JSON)
- 2026CFSR: Geometry-Conditioned Shadow Removal via Physical Disentanglement20 Apr 2026
- 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windows6 Apr 2026
- 2026Rotated Lights for Consistent and Efficient 2D Gaussians Inverse Rendering9 Feb 2026
- 2026PhaSR: Generalized Image Shadow Removal with Physically Aligned Priors24 Jan 2026
- 2025RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflection10 Jul 2025
- 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fields28 Apr 2025
- 2025SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Rendering9 Apr 2025
- 2024Deformable Radial Kernel Splatting16 Dec 2024
- 2024MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fields26 Nov 2024
- 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Rendering31 Oct 2024
- 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Models8 Oct 2024
- 2024RNG: Relightable Neural Gaussians29 Sep 2024
12 newest of 19 All 19 (JSON)