mlsanityData to 7 Oct 2026

Expansive Supervision for Neural Radiance Field

arXiv 2409.08056 ↗First posted 12 Sep 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Neural Radiance Field (NeRF) has achieved remarkable success in creating immersive media representations through its exceptional reconstruction capabilities. However, the computational demands of dense forward passes and volume rendering during training continue to challenge its real-world applications. In this paper, we introduce Expansive Supervision to reduce time and memory costs during NeRF training from the perspective of partial ray selection for supervision. Specifically, we observe that training errors exhibit a long-tail distribution correlated with image content. Based on this observation, our method selectively renders a small but crucial subset of pixels and expands their values to estimate errors across the entire area for each iteration. Compared to conventional supervision, our approach effectively bypasses redundant rendering processes, resulting in substantial reductions in both time and memory consumption. Experimental results demonstrate that integrating Expansive Supervision within existing state-of-the-art acceleration frameworks achieves 52% memory savings and 16% time savings while maintaining comparable visual quality.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 33 of its 53 references that are in the map. First posted on arXiv 12 Sep 2024.

Builds on

33 of 53 references.

References · 33

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  7. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  8. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  9. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  10. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  11. 2020Neural Sparse Voxel Fieldscited by 959
  12. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
21 more
  1. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  2. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  3. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  4. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  5. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  6. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  7. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
  8. 2021NeRV: Neural Representations for Videoscited by 255
  9. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  10. 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 215
  11. 2022Panoptic Lifting for 3D Scene Understanding with Neural Fieldscited by 171
  12. 2020DeRF: Decomposed Radiance Fieldscited by 163
  13. 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 134
  14. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  15. 2022Real-Time Neural Light Field on Mobile Devicescited by 48
  16. 2023Strivec: Sparse Tri-Vector Radiance Fieldscited by 28
  17. 2017Convergence Analysis of Distributed Stochastic Gradient Descent with Shufflingcited by 23
  18. 2023Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracingcited by 22
  19. 2023SANeRF-HQ: Segment Anything for NeRF in High Qualitycited by 20
  20. 2023Accelerating Neural Field Training via Soft Miningcited by 13
  21. 2023MM-NeRF: Multimodal-Guided 3D Multi-Style Transfer of Neural Radiance Fieldcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 3.

5 papers.