mlsanityData to 7 Oct 2026

NeRD: Neural Reflectance Decomposition from Image Collections

arXiv 2012.03918 ↗First posted 7 Dec 2020cs.CV cs.GR cs.LGcited by 446

Not on the map. Why?

Cited by 26 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under laboratory conditions but is instead an unconstrained environmental illumination. Though recent work has shown that implicit representations can be used to model the radiance field of an object, most of these techniques only enable view synthesis and not relighting. Additionally, evaluating these radiance fields is resource and time-intensive. We propose a neural reflectance decomposition (NeRD) technique that uses physically-based rendering to decompose the scene into spatially varying BRDF material properties. In contrast to existing techniques, our input images can be captured under different illumination conditions. In addition, we also propose techniques to convert the learned reflectance volume into a relightable textured mesh enabling fast real-time rendering with novel illuminations. We demonstrate the potential of the proposed approach with experiments on both synthetic and real datasets, where we are able to obtain high-quality relightable 3D assets from image collections. The datasets and code is available on the project page: https://markboss.me/publication/2021-nerd/

Key facts. Cited by 446 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 35; 2022: 101; 2023: 137; 2024: 87; 2025: 51; 2026: 35.

446 papers.

Sort:

By area:

  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  2. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  3. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  4. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  5. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  6. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  7. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  8. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  9. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  10. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  11. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  12. 2021Neural Fields in Visual Computing and Beyondcited by 539
38 more
  1. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  2. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  3. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  4. 2021Advances in Neural Renderingcited by 365
  5. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  6. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  7. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  8. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  9. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
  10. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  11. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  12. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 204
  13. 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
  14. 2022Modeling Indirect Illumination for Inverse Renderingcited by 167
  15. 2023TensoIR: Tensorial Inverse Renderingcited by 166
  16. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  17. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  18. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
  19. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
  20. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
  21. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  22. 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 138
  23. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
  24. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  25. 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
  26. 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 121
  27. 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
  28. 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
  29. 2021NeRF for Outdoor Scene Relightingcited by 114
  30. 2021HDR-NeRF: High Dynamic Range Neural Radiance Fieldscited by 113
  31. 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 110
  32. 2023NeRF-DS: Neural Radiance Fields for Dynamic Specular Objectscited by 110
  33. 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
  34. 2022NeILF: Neural Incident Light Field for Physically-based Material Estimationcited by 105
  35. 2022NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstructioncited by 99
  36. 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
  37. 2022Compressible-composable NeRF via Rank-residual Decompositioncited by 92
  38. 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92

50 most cited of 446 All 446 (JSON)