Neural Point-Based Graphics
Not on the map. Why?
Abstract (arXiv)
We present a new point-based approach for modeling the appearance of real scenes. The approach uses a raw point cloud as the geometric representation of a scene, and augments each point with a learnable neural descriptor that encodes local geometry and appearance. A deep rendering network is learned in parallel with the descriptors, so that new views of the scene can be obtained by passing the rasterizations of a point cloud from new viewpoints through this network. The input rasterizations use the learned descriptors as point pseudo-colors. We show that the proposed approach can be used for modeling complex scenes and obtaining their photorealistic views, while avoiding explicit surface estimation and meshing. In particular, compelling results are obtained for scene scanned using hand-held commodity RGB-D sensors as well as standard RGB cameras even in the presence of objects that are challenging for standard mesh-based modeling.
Key facts. Cited by 326 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 59; 2022: 58; 2023: 86; 2024: 68; 2025: 38; 2026: 17.
326 papers.
Sort:
By area:
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2021Advances in Neural Renderingcited by 365
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
38 more
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
- 2021A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and Posecited by 233
- 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
- 2022PointAvatar: Deformable Point-based Head Avatars from Videoscited by 183
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
- 2023TensoIR: Tensorial Inverse Renderingcited by 166
- 2024High-quality Surface Reconstruction using Gaussian Surfelscited by 159
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2021Editable Free-viewpoint Video Using a Layered Neural Representationcited by 148
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
- 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
- 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
- 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 138
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
- 2021Pixel Codec Avatarscited by 125
- 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 121
- 2022Generalizable Patch-Based Neural Renderingcited by 121
- 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
- 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
- 2021HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputscited by 112
- 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 111
50 most cited of 326 All 326 (JSON)
- 2026NRF-GS: Neural Residual Fields for Expressive and Compact Gaussian Splatting29 Sep 2026
- 2026Compact Neural Appearance Models for Efficient Gaussian Splatting4 Sep 2026
- 2026P-CORE: Self-Supervised Surface Consistency for Point-Based Neural Editing3 Sep 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026ViDS: Video Diffusion Shader using 3D Face Tracking27 Jul 2026
- 2026Feature-Guided Diffusion for Non-Differentiable Inverse Rendering19 Jul 2026
- 2026Online Neural Space Time Memory for Dynamic Novel View Synthesis16 Jul 2026
- 2026SERF: Spatiotemporal Environment and Robot Feature Map for Long-Horizon Mobile Manipulation11 Jun 2026
- 20263D Gaussian Splatting for Efficient Retrospective Dynamic Scene Novel View Synthesis with a Standardized Benchmark12 May 2026
- 2026GS^2: Graph-based Spatial Distribution Optimization for Compact 3D Gaussian Splatting2 Apr 2026
- 2026ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction2 Apr 2026
- 2026Neural Harmonic Textures for High-Quality Primitive Based Neural Reconstruction1 Apr 2026
38 more
- 2026TreeGaussian: Tree-Guided Cascaded Contrastive Learning for Hierarchical Consistent 3D Gaussian Scene Segmentation and Understanding31 Mar 2026
- 2026tttLRM: Test-Time Training for Long Context and Autoregressive 3D Reconstruction23 Feb 2026
- 2026Time-Archival Camera Virtualization for Sports and Visual Performances16 Feb 2026
- 2026Rotated Lights for Consistent and Efficient 2D Gaussians Inverse Rendering9 Feb 2026
- 2026SurfelSoup: Learned Point Cloud Geometry Compression With a Probablistic SurfelTree Representation30 Jan 2026
- 2025Long-LRM++: Preserving Fine Details in Feed-Forward Wide-Coverage Reconstruction11 Dec 2025
- 2025Radiance Meshes for Volumetric Reconstruction3 Dec 2025
- 2025SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splatting2 Dec 2025
- 2025Robust 3DGS-based SLAM via Adaptive Kernel Smoothing28 Nov 2025
- 2025SPORTS: Simultaneous Panoptic Odometry, Rendering, Tracking and Segmentation for Urban Scenes Understanding14 Oct 2025
- 2025LVT: Large-Scale Scene Reconstruction via Local View Transformers29 Sep 2025
- 2025HyRF: Hybrid Radiance Fields for Memory-efficient and High-quality Novel View Synthesis21 Sep 2025
- 2025RayGaussX: Accelerating Gaussian-Based Ray Marching for Real-Time and High-Quality Novel View Synthesis9 Sep 2025
- 2025Towards Integrating Multi-Spectral Imaging with Gaussian Splatting31 Aug 2025
- 2025A Bag of Tricks for Efficient Implicit Neural Point Clouds26 Aug 2025
- 2025TeSO: Representing and Compressing 3D Point Cloud Scenes with Textured Surfel Octree9 Aug 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025Real-Time Scene Reconstruction using Light Field Probes19 Jul 2025
- 2025GDGS: 3D Gaussian Splatting Via Geometry-Guided Initialization And Dynamic Density Control1 Jul 2025
- 2025STD-GS: Exploring Frame-Event Interaction for SpatioTemporal-Disentangled Gaussian Splatting to Reconstruct High-Dynamic Scene29 Jun 2025
- 2025Multi-Spectral Gaussian Splatting with Neural Color Representation3 Jun 2025
- 2025Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis27 May 2025
- 2025K-Buffers: A Plug-in Method for Enhancing Neural Fields with Multiple Buffers26 May 2025
- 2025Geometry-guided Online 3D Video Synthesis with Multi-View Temporal Consistency25 May 2025
- 2025Sparse Point Cloud Patches Rendering via Splitting 2D Gaussians14 May 2025
- 2025QuickSplat: Fast 3D Surface Reconstruction via Learned Gaussian Initialization8 May 2025
- 2025Steepest Descent Density Control for Compact 3D Gaussian Splatting8 May 2025
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagery4 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2025CE-NPBG: Connectivity Enhanced Neural Point-Based Graphics for Novel View Synthesis in Autonomous Driving Scenes28 Apr 2025
- 2025When Gaussian Meets Surfel: Ultra-fast High-fidelity Radiance Field Rendering24 Apr 2025
- 2025Metamon-GS: Enhancing Representability with Variance-Guided Densification and Light Encoding20 Apr 2025
- 2025CAGS: Open-Vocabulary 3D Scene Understanding with Context-Aware Gaussian Splatting16 Apr 2025
- 2025Uni-Render: A Unified Accelerator for Real-Time Rendering Across Diverse Neural Renderers31 Mar 2025
- 2025EVolSplat: Efficient Volume-based Gaussian Splatting for Urban View Synthesis26 Mar 2025
- 2025Learning Scene-Level Signed Directional Distance Function with Ellipsoidal Priors and Neural Residuals25 Mar 2025
- 2025DashGaussian: Optimizing 3D Gaussian Splatting in 200 Seconds24 Mar 2025
- 2025GaussianFocus: Constrained Attention Focus for 3D Gaussian Splatting22 Mar 2025
50 newest of 326 All 326 (JSON)
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
- 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
- 2024Challenges and Opportunities in 3D Content Generationcited by 1
- 2026ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstructioncited by 0
- 2026Feature-Guided Diffusion for Non-Differentiable Inverse Renderingcited by 0
- 2026ViDS: Video Diffusion Shader using 3D Face Trackingcited by 0
- 2026ViDS: Video Diffusion Shader using 3D Face Tracking27 Jul 2026
- 2026Feature-Guided Diffusion for Non-Differentiable Inverse Rendering19 Jul 2026
- 2026ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction2 Apr 2026
- 2024Challenges and Opportunities in 3D Content Generation24 May 2024
- 2023Consistent View Synthesis with Pose-Guided Diffusion Models30 Mar 2023
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar 2023
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2021Advances in Neural Renderingcited by 365
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
12 most cited of 315 All 315 (JSON)
- 2026NRF-GS: Neural Residual Fields for Expressive and Compact Gaussian Splatting29 Sep 2026
- 2026Compact Neural Appearance Models for Efficient Gaussian Splatting4 Sep 2026
- 2026P-CORE: Self-Supervised Surface Consistency for Point-Based Neural Editing3 Sep 2026
- 2026S-Avatar: Diffusion-Guided Gaussian Head Avatars from a Single Image30 Jul 2026
- 2026Online Neural Space Time Memory for Dynamic Novel View Synthesis16 Jul 2026
- 20263D Gaussian Splatting for Efficient Retrospective Dynamic Scene Novel View Synthesis with a Standardized Benchmark12 May 2026
- 2026GS^2: Graph-based Spatial Distribution Optimization for Compact 3D Gaussian Splatting2 Apr 2026
- 2026Neural Harmonic Textures for High-Quality Primitive Based Neural Reconstruction1 Apr 2026
- 2026TreeGaussian: Tree-Guided Cascaded Contrastive Learning for Hierarchical Consistent 3D Gaussian Scene Segmentation and Understanding31 Mar 2026
- 2026tttLRM: Test-Time Training for Long Context and Autoregressive 3D Reconstruction23 Feb 2026
- 2026Time-Archival Camera Virtualization for Sports and Visual Performances16 Feb 2026
- 2026Rotated Lights for Consistent and Efficient 2D Gaussians Inverse Rendering9 Feb 2026
12 newest of 315 All 315 (JSON)