MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fields
Not on the map. Why?
Abstract (arXiv)
Current methods for extracting intrinsic image components, such as reflectance and shading, primarily rely on statistical priors. These methods focus mainly on simple synthetic scenes and isolated objects and struggle to perform well on challenging real-world data. To address this issue, we propose MLI-NeRF, which integrates Multiple Light information in Intrinsic-aware Neural Radiance Fields. By leveraging scene information provided by different light source positions complementing the multi-view information, we generate pseudo-label images for reflectance and shading to guide intrinsic image decomposition without the need for ground truth data. Our method introduces straightforward supervision for intrinsic component separation and ensures robustness across diverse scene types. We validate our approach on both synthetic and real-world datasets, outperforming existing state-of-the-art methods. Additionally, we demonstrate its applicability to various image editing tasks. The code and data are publicly available.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 51 references that are in the map. First posted on arXiv 26 Nov 2024.
Builds on
36 of 51 references.
References · 36
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
- 2022Modeling Indirect Illumination for Inverse Renderingcited by 168
- 2023TensoIR: Tensorial Inverse Renderingcited by 168
- 2019Single Image Portrait Relightingcited by 152
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
- 2021NeRF for Outdoor Scene Relightingcited by 114
24 more
- 2019Learning Physics-guided Face Relighting under Directional Lightcited by 90
- 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
- 2018CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Renderingcited by 85
- 2018Learning Intrinsic Image Decomposition from Watching the Worldcited by 74
- 2024LightIt: Illumination Modeling and Control for Diffusion Modelscited by 57
- 2019Unsupervised Learning for Intrinsic Image Decomposition from a Single Imagecited by 55
- 2023Intrinsic Image Decomposition via Ordinal Shadingcited by 53
- 2022IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesiscited by 50
- 2019A Dataset of Multi-Illumination Images in the Wildcited by 45
- 2022Face Relighting with Geometrically Consistent Shadowscited by 43
- 2023ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objectscited by 42
- 2023Relighting Neural Radiance Fields with Shadow and Highlight Hintscited by 42
- 2021A Survey on Intrinsic Images: Delving Deep Into Lambert and Beyondcited by 37
- 2023OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objectscited by 31
- 2022PIE-Net: Photometric Invariant Edge Guided Network for Intrinsic Image Decompositioncited by 26
- 2021NTIRE 2021 Depth Guided Image Relighting Challengecited by 23
- 2018Unsupervised Deep Single-Image Intrinsic Decomposition using Illumination-Varying Image Sequencescited by 22
- 2023SIRe-IR: Inverse Rendering for BRDF Reconstruction with Shadow and Illumination Removal in High-Illuminance Scenescited by 19
- 2020AIM 2020: Scene Relighting and Illumination Estimation Challengecited by 18
- 2022ShadowNeuS: Neural SDF Reconstruction by Shadow Ray Supervisioncited by 17
- 2023Learning Unified Decompositional and Compositional NeRF for Editable Novel View Synthesiscited by 15
- 2020WDRN : A Wavelet Decomposed RelightNet for Image Relightingcited by 14
- 2020Deep Relighting Networks for Image Light Source Manipulationcited by 12
- 2023Fast Sun-aligned Outdoor Scene Relighting based on TensoRFcited by 7
Built on by
Citing papers per year: 2025: 1.
1 paper.