mlsanityData to 7 Oct 2026

Baking Neural Radiance Fields for Real-Time View Synthesis

arXiv 2103.14645 ↗First posted 26 Mar 2021cs.CV cs.GRcited by 465

Not on the map. Why?

Abstract (arXiv)

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved viewpoints. However, NeRF's computational requirements are prohibitive for real-time applications: rendering views from a trained NeRF requires querying a multilayer perceptron (MLP) hundreds of times per ray. We present a method to train a NeRF, then precompute and store (i.e. "bake") it as a novel representation called a Sparse Neural Radiance Grid (SNeRG) that enables real-time rendering on commodity hardware. To achieve this, we introduce 1) a reformulation of NeRF's architecture, and 2) a sparse voxel grid representation with learned feature vectors. The resulting scene representation retains NeRF's ability to render fine geometric details and view-dependent appearance, is compact (averaging less than 90 MB per scene), and can be rendered in real-time (higher than 30 frames per second on a laptop GPU). Actual screen captures are shown in our video.

Key facts. Cited by 465 papers in the map (data through 7 Oct 2026). Builds on 23 of its 66 references that are in the map. First posted on arXiv 26 Mar 2021.

Builds on

23 of 66 references.

References · 23

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  4. 2020Neural Sparse Voxel Fieldscited by 959
  5. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  6. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  7. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  8. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  9. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  10. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  11. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  12. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
11 more
  1. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  2. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
  3. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  4. 2020Neural Scene Graphs for Dynamic Scenescited by 298
  5. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  6. 2017A General and Adaptive Robust Loss Functioncited by 236
  7. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  8. 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
  9. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  10. 2020DeRF: Decomposed Radiance Fieldscited by 163
  11. 2020Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illuminationcited by 62

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 36; 2022: 92; 2023: 159; 2024: 105; 2025: 52; 2026: 21.

465 papers.

Sort:

By area:

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  3. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  4. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  5. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  7. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  8. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  9. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  10. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  11. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  12. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
38 more
  1. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  2. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  3. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  4. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  5. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  6. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  7. 2021Neural Fields in Visual Computing and Beyondcited by 539
  8. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  9. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  10. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
  11. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
  12. 2021Advances in Neural Renderingcited by 365
  13. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  14. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  15. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  16. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
  17. 2023Text-to-3D using Gaussian Splattingcited by 299
  18. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  19. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  20. 2023Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesiscited by 232
  21. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  22. 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
  23. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  24. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
  25. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  26. 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 215
  27. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
  28. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  29. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 204
  30. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
  31. 2021Deblur-NeRF: Neural Radiance Fields from Blurry Imagescited by 179
  32. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
  33. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  34. 2023Segment Any 3D Gaussianscited by 158
  35. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  36. 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 156
  37. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  38. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151

50 most cited of 465 All 465 (JSON)