Neural Mesh-Based Graphics
Not on the map. Why?
Abstract (arXiv)
We revisit NPBG, the popular approach to novel view synthesis that introduced the ubiquitous point feature neural rendering paradigm. We are interested in particular in data-efficient learning with fast view synthesis. We achieve this through a view-dependent mesh-based denser point descriptor rasterization, in addition to a foreground/background scene rendering split, and an improved loss. By training solely on a single scene, we outperform NPBG, which has been trained on ScanNet and then scene finetuned. We also perform competitively with respect to the state-of-the-art method SVS, which has been trained on the full dataset (DTU and Tanks and Temples) and then scene finetuned, in spite of their deeper neural renderer.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 44 of its 69 references that are in the map. First posted on arXiv 10 Aug 2022.
Builds on
44 of 69 references.
References · 44
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
32 more
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
- 2019Neural Point-Based Graphicscited by 327
- 2020Free View Synthesiscited by 231
- 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 216
- 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
- 2017Learning a Multi-View Stereo Machinecited by 194
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2020GRF: Learning a General Radiance Field for 3D Representation and Renderingcited by 183
- 2020Stable View Synthesiscited by 165
- 2016Learning-Based View Synthesis for Light Field Camerascited by 145
- 2019Neural Rerendering in the Wildcited by 121
- 2018Extreme View Synthesiscited by 94
- 2020SMPLpix: Neural Avatars from 3D Human Modelscited by 69
- 2019Revealing Scenes by Inverting Structure from Motion Reconstructionscited by 66
- 2020ANR: Articulated Neural Rendering for Virtual Avatarscited by 55
- 2021Point-Based Modeling of Human Clothingcited by 37
- 2022Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Spacecited by 22
- 2018IGNOR: Image-guided Neural Object Renderingcited by 12
- 2022Learning Generalizable Light Field Networks from Few Imagescited by 10
Built on by
Citing papers per year: 2023: 4; 2024: 5; 2025: 3.
12 papers.
- 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearizationcited by 19
- 2024Unsupervised Occupancy Learning from Sparse Point Cloudcited by 15
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagerycited by 8
- 2023FPO++: Efficient Encoding and Rendering of Dynamic Neural Radiance Fields by Analyzing and Enhancing Fourier PlenOctreescited by 7
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splattingcited by 7
- 2023Artist-Friendly Relightable and Animatable Neural Headscited by 6
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learningcited by 5
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversariescited by 5
- 2024Toward Robust Neural Reconstruction from Sparse Point Setscited by 5
- 2023Depth self-supervision for single image novel view synthesiscited by 0
- 2025UrbanCraft: Urban View Extrapolation via Hierarchical Sem-Geometric Priorscited by 0
- 2025UrbanCraft: Urban View Extrapolation via Hierarchical Sem-Geometric Priors29 May 2025
- 2025Sparfels: Fast Reconstruction from Sparse Unposed Imagery4 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2024Toward Robust Neural Reconstruction from Sparse Point Sets20 Dec 2024
- 2024Few-Shot Unsupervised Implicit Neural Shape Representation Learning with Spatial Adversaries27 Aug 2024
- 2024GeoTransfer : Generalizable Few-Shot Multi-View Reconstruction via Transfer Learning27 Aug 2024
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearization19 Jul 2024
- 2024Unsupervised Occupancy Learning from Sparse Point Cloud3 Apr 2024
- 2023Artist-Friendly Relightable and Animatable Neural Heads6 Dec 2023
- 2023FPO++: Efficient Encoding and Rendering of Dynamic Neural Radiance Fields by Analyzing and Enhancing Fourier PlenOctrees31 Oct 2023
- 20234K4D: Real-Time 4D View Synthesis at 4K Resolution17 Oct 2023
- 2023Depth self-supervision for single image novel view synthesis27 Aug 2023