mlsanityData to 7 Oct 2026

NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis

arXiv 2012.03927 ↗First posted 7 Dec 2020cs.CV cs.GRcited by 493

Not on the map. Why?

Cited by 24 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present a method that takes as input a set of images of a scene illuminated by unconstrained known lighting, and produces as output a 3D representation that can be rendered from novel viewpoints under arbitrary lighting conditions. Our method represents the scene as a continuous volumetric function parameterized as MLPs whose inputs are a 3D location and whose outputs are the following scene properties at that input location: volume density, surface normal, material parameters, distance to the first surface intersection in any direction, and visibility of the external environment in any direction. Together, these allow us to render novel views of the object under arbitrary lighting, including indirect illumination effects. The predicted visibility and surface intersection fields are critical to our model's ability to simulate direct and indirect illumination during training, because the brute-force techniques used by prior work are intractable for lighting conditions outside of controlled setups with a single light. Our method outperforms alternative approaches for recovering relightable 3D scene representations, and performs well in complex lighting settings that have posed a significant challenge to prior work.

Key facts. Cited by 493 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Dec 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 64; 2022: 108; 2023: 151; 2024: 103; 2025: 45; 2026: 22.

493 papers.

Sort:

By area:

  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  2. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  3. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  5. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  6. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  7. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  8. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  9. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  10. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  11. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  12. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
38 more
  1. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  2. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  3. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  4. 2021Neural Fields in Visual Computing and Beyondcited by 539
  5. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  6. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  7. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  8. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  9. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
  10. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  11. 2021Advances in Neural Renderingcited by 365
  12. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  13. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
  14. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  15. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  16. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  17. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  18. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
  19. 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
  20. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  21. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  22. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 204
  23. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
  24. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  25. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
  26. 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
  27. 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 180
  28. 2022Modeling Indirect Illumination for Inverse Renderingcited by 167
  29. 2023TensoIR: Tensorial Inverse Renderingcited by 166
  30. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
  31. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
  32. 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 142
  33. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
  34. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
  35. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  36. 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
  37. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  38. 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 121

50 most cited of 493 All 493 (JSON)