mlsanityData to 7 Oct 2026

NPBG++: Accelerating Neural Point-Based Graphics

arXiv 2203.13318 ↗First posted 24 Mar 2022cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

We present a new system (NPBG++) for the novel view synthesis (NVS) task that achieves high rendering realism with low scene fitting time. Our method efficiently leverages the multiview observations and the point cloud of a static scene to predict a neural descriptor for each point, improving upon the pipeline of Neural Point-Based Graphics in several important ways. By predicting the descriptors with a single pass through the source images, we lift the requirement of per-scene optimization while also making the neural descriptors view-dependent and more suitable for scenes with strong non-Lambertian effects. In our comparisons, the proposed system outperforms previous NVS approaches in terms of fitting and rendering runtimes while producing images of similar quality.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 37 of its 60 references that are in the map. First posted on arXiv 24 Mar 2022.

Builds on

37 of 60 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  7. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  8. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  9. 2020Neural Sparse Voxel Fieldscited by 959
  10. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  11. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  12. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
25 more
  1. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  2. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  3. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  4. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  5. 2021Advances in Neural Renderingcited by 365
  6. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  7. 2019Neural Point-Based Graphicscited by 326
  8. 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 240
  9. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  10. 2020Free View Synthesiscited by 231
  11. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
  12. 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 204
  13. 2017Learning a Multi-View Stereo Machinecited by 194
  14. 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 193
  15. 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
  16. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
  17. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  18. 2020Stable View Synthesiscited by 165
  19. 2016Learning-Based View Synthesis for Light Field Camerascited by 145
  20. 2019Neural Rerendering in the Wildcited by 121
  21. 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
  22. 2019Revealing Scenes by Inverting Structure from Motion Reconstructionscited by 66
  23. 2019'Zhores' -- Petaflops supercomputer for data-driven modeling, machine learning and artificial intelligence installed in Skolkovo Institute of Science and Technologycited by 23
  24. 2020TRANSPR: Transparency Ray-Accumulating Neural 3D Scene Point Renderercited by 9
  25. 2020Relightable 3D Head Portraits from a Smartphone Videocited by 8

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 6.

8 papers.

  1. 2023Real-Time Neural Rasterization for Large Scenescited by 37
  2. 2023Learning Neural Duplex Radiance Fields for Real-Time View Synthesiscited by 28
  3. 2023Floaters No More: Radiance Field Gradient Scaling for Improved Near-Camera Trainingcited by 25
  4. 2023Pointersect: Neural Rendering with Cloud-Ray Intersectioncited by 23
  5. 2022View Synthesis with Sculpted Neural Pointscited by 20
  6. 2023TriVol: Point Cloud Rendering via Triple Volumescited by 16
  7. 2023SimNP: Learning Self-Similarity Priors Between Neural Pointscited by 11
  8. 2022Sphere-Guided Training of Neural Implicit Surfacescited by 6