mlsanityData to 7 Oct 2026

Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations

arXiv 1906.01618 ↗First posted 4 Jun 2019cs.CV cs.AIcited by 864

Not on the map. Why?

Cited by 43 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Unsupervised learning with generative models has the potential of discovering rich representations of 3D scenes. While geometric deep learning has explored 3D-structure-aware representations of scene geometry, these models typically require explicit 3D supervision. Emerging neural scene representations can be trained only with posed 2D images, but existing methods ignore the three-dimensional structure of scenes. We propose Scene Representation Networks (SRNs), a continuous, 3D-structure-aware scene representation that encodes both geometry and appearance. SRNs represent scenes as continuous functions that map world coordinates to a feature representation of local scene properties. By formulating the image formation as a differentiable ray-marching algorithm, SRNs can be trained end-to-end from only 2D images and their camera poses, without access to depth or shape. This formulation naturally generalizes across scenes, learning powerful geometry and appearance priors in the process. We demonstrate the potential of SRNs by evaluating them for novel view synthesis, few-shot reconstruction, joint shape and appearance interpolation, and unsupervised discovery of a non-rigid face model.

Key facts. Cited by 864 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jun 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 203; 2022: 217; 2023: 209; 2024: 134; 2025: 72; 2026: 29.

864 papers.

Sort:

By area:

  1. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  2. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  4. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  5. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  6. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  7. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  10. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  11. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  12. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
38 more
  1. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  2. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  3. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  4. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  6. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  7. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  8. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  9. 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
  10. 2021Neural Fields in Visual Computing and Beyondcited by 539
  11. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  12. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  13. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  14. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  15. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  16. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  17. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  18. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  19. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  20. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
  21. 2022Kubric: A scalable dataset generatorcited by 373
  22. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  23. 2021Advances in Neural Renderingcited by 365
  24. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  25. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  26. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  27. 2021AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesiscited by 339
  28. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
  29. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  30. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  31. 2021Neural RGB-D Surface Reconstructioncited by 312
  32. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
  33. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
  34. 2022Novel View Synthesis with Diffusion Modelscited by 299
  35. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  36. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  37. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  38. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277

50 most cited of 864 All 864 (JSON)