Efficient Ray Sampling for Radiance Fields Reconstruction
Not on the map. Why?
Abstract (arXiv)
Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training efficiency. We therefore propose a novel ray sampling approach for neural radiance fields that improves training efficiency while retaining photorealistic rendering results. First, we analyze the relationship between the pixel loss distribution of sampled rays and rendering quality. This reveals redundancy in the original NeRF's uniform ray sampling. Guided by this finding, we develop a sampling method leveraging pixel regions and depth boundaries. Our main idea is to sample fewer rays in training views, yet with each ray more informative for scene fitting. Sampling probability increases in pixel areas exhibiting significant color and depth variation, greatly reducing wasteful rays from other regions without sacrificing precision. Through this method, not only can the convergence of the network be accelerated, but the spatial geometry of a scene can also be perceived more accurately. Rendering outputs are enhanced, especially for texture-complex regions. Experiments demonstrate that our method significantly outperforms state-of-the-art techniques on public benchmark datasets.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 29 Aug 2023.
Builds on
42 of 51 references.
References · 42
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
30 more
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2021Urban Radiance Fieldscited by 263
- 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
- 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
- 2021Editing Conditional Radiance Fieldscited by 222
- 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
- 2020AutoInt: Automatic Integration for Fast Neural Volume Renderingcited by 204
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2021Neural Rays for Occlusion-aware Image-based Renderingcited by 192
- 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
- 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
- 2021Neural Lumigraph Renderingcited by 105
- 2021TermiNeRF: Ray Termination Prediction for Efficient Neural Renderingcited by 70
- 2022Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fieldscited by 58
- 2022Real-Time Neural Light Field on Mobile Devicescited by 48
- 2021NeRF in detail: Learning to sample for view synthesiscited by 35
- 2023DyLiN: Making Light Field Networks Dynamiccited by 20
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 3; 2026: 1.
8 papers.
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priorscited by 17
- 2023L0-Sampler: An L0 Model Guided Volume Sampling for NeRFcited by 4
- 2024Efficient NeRF Optimization -- Not All Samples Remain Equally Hardcited by 3
- 2025STDR: Spatio-Temporal Decoupling for Real-Time Dynamic Scene Renderingcited by 3
- 2024Diversity-Driven View Subset Selection for Indoor Novel View Synthesiscited by 2
- 2025A Probability-guided Sampler for Neural Implicit Surface Renderingcited by 2
- 2026NERFIFY: A Multi-Agent Framework for Turning NeRF Papers into Codecited by 1
- 2025MCBlock: Boosting Neural Radiance Field Training Speed by MCTS-based Dynamic-Resolution Ray Samplingcited by 0
- 2026NERFIFY: A Multi-Agent Framework for Turning NeRF Papers into Code28 Feb 2026
- 2025A Probability-guided Sampler for Neural Implicit Surface Rendering10 Jun 2025
- 2025STDR: Spatio-Temporal Decoupling for Real-Time Dynamic Scene Rendering28 May 2025
- 2025MCBlock: Boosting Neural Radiance Field Training Speed by MCTS-based Dynamic-Resolution Ray Sampling14 Apr 2025
- 2024Diversity-Driven View Subset Selection for Indoor Novel View Synthesis11 Sep 2024
- 2024Efficient NeRF Optimization -- Not All Samples Remain Equally Hard6 Aug 2024
- 2024VRP-UDF: Towards Unbiased Learning of Unsigned Distance Functions from Multi-view Images with Volume Rendering Priors23 Jul 2024
- 2023L0-Sampler: An L0 Model Guided Volume Sampling for NeRF13 Nov 2023