mlsanityData to 7 Oct 2026

Efficient Ray Sampling for Radiance Fields Reconstruction

arXiv 2308.15547 ↗First posted 29 Aug 2023cs.CV cs.GRcited by 8

Not on the map. Why?

Abstract (arXiv)

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training efficiency. We therefore propose a novel ray sampling approach for neural radiance fields that improves training efficiency while retaining photorealistic rendering results. First, we analyze the relationship between the pixel loss distribution of sampled rays and rendering quality. This reveals redundancy in the original NeRF's uniform ray sampling. Guided by this finding, we develop a sampling method leveraging pixel regions and depth boundaries. Our main idea is to sample fewer rays in training views, yet with each ray more informative for scene fitting. Sampling probability increases in pixel areas exhibiting significant color and depth variation, greatly reducing wasteful rays from other regions without sacrificing precision. Through this method, not only can the convergence of the network be accelerated, but the spatial geometry of a scene can also be perceived more accurately. Rendering outputs are enhanced, especially for texture-complex regions. Experiments demonstrate that our method significantly outperforms state-of-the-art techniques on public benchmark datasets.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 29 Aug 2023.

Builds on

42 of 51 references.

References · 42

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  4. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  5. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  6. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  7. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  8. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  9. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  10. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  11. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  12. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
30 more
  1. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  2. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  3. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  4. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  5. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  6. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  7. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  8. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
  9. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  10. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  11. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
  12. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  13. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  14. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  15. 2021Urban Radiance Fieldscited by 263
  16. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  17. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  18. 2021Editing Conditional Radiance Fieldscited by 222
  19. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  20. 2020AutoInt: Automatic Integration for Fast Neural Volume Renderingcited by 204
  21. 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
  22. 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
  23. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  24. 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
  25. 2021Neural Lumigraph Renderingcited by 105
  26. 2021TermiNeRF: Ray Termination Prediction for Efficient Neural Renderingcited by 70
  27. 2022Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fieldscited by 58
  28. 2022Real-Time Neural Light Field on Mobile Devicescited by 48
  29. 2021NeRF in detail: Learning to sample for view synthesiscited by 35
  30. 2023DyLiN: Making Light Field Networks Dynamiccited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 3; 2026: 1.

8 papers.