Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fields
Not on the map. Why?
Abstract (arXiv)
We show that ensembling effectively quantifies model uncertainty in Neural Radiance Fields (NeRFs) if a density-aware epistemic uncertainty term is considered. The naive ensembles investigated in prior work simply average rendered RGB images to quantify the model uncertainty caused by conflicting explanations of the observed scene. In contrast, we additionally consider the termination probabilities along individual rays to identify epistemic model uncertainty due to a lack of knowledge about the parts of a scene unobserved during training. We achieve new state-of-the-art performance across established uncertainty quantification benchmarks for NeRFs, outperforming methods that require complex changes to the NeRF architecture and training regime. We furthermore demonstrate that NeRF uncertainty can be utilised for next-best view selection and model refinement.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 25 of its 29 references that are in the map. First posted on arXiv 19 Sep 2022.
Builds on
25 of 29 references.
References · 25
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021Neural Fields in Visual Computing and Beyondcited by 539
13 more
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2021Vision-Only Robot Navigation in a Neural Radiance Worldcited by 153
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 20213D Neural Scene Representations for Visuomotor Controlcited by 110
- 2018The Limits and Potentials of Deep Learning for Roboticscited by 104
- 2022NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fieldscited by 86
- 2021Stochastic Neural Radiance Fields: Quantifying Uncertainty in Implicit 3D Representationscited by 80
- 2022Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantificationcited by 71
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2020Neural Volume Rendering: NeRF And Beyondcited by 44
- 2022Reinforcement Learning with Neural Radiance Fieldscited by 43
- 2021Advances in Inference and Representation for Simultaneous Localization and Mappingcited by 16
Built on by
Citing papers per year: 2022: 1; 2023: 8; 2024: 20; 2025: 15; 2026: 14.
58 papers.
Sort:
By area:
- 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 90
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 85
- 2023FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Informationcited by 63
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2023Active Neural Mappingcited by 30
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2024Neural Visibility Field for Uncertainty-Driven Active Mappingcited by 25
- 2024Modeling uncertainty for Gaussian Splattingcited by 17
- 2023Estimating 3D Uncertainty Field: Quantifying Uncertainty for Neural Radiance Fieldscited by 14
- 2024NeRF Director: Revisiting View Selection in Neural Volume Renderingcited by 14
- 2025Free360: Layered Gaussian Splatting for Unbounded 360-Degree View Synthesis from Extremely Sparse and Unposed Viewscited by 11
38 more
- 2024Bayesian NeRF: Quantifying Uncertainty with Volume Density for Neural Implicit Fieldscited by 9
- 2024Sources of Uncertainty in 3D Scene Reconstructioncited by 9
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Informationcited by 9
- 2024Regularized Multi-Decoder Ensemble for an Error-Aware Scene Representation Networkcited by 6
- 2025These Magic Moments: Differentiable Uncertainty Quantification of Radiance Field Modelscited by 6
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priorscited by 6
- 2025View-Dependent Uncertainty Estimation of 3D Gaussian Splattingcited by 5
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstructioncited by 5
- 2026Predictive Photometric Uncertainty in Gaussian Splatting for Novel View Synthesiscited by 5
- 2024Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planningcited by 4
- 2024Uncertainty-aware Active Learning of NeRF-based Object Models for Robot Manipulators using Visual and Re-orientation Actionscited by 4
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstructioncited by 4
- 2025PRIMU: Uncertainty Estimation for Novel Views in Gaussian Splatting from Primitive-Based Representations of Error and Coveragecited by 4
- 2025Auto3R: Automated 3D Reconstruction and Scanning via Data-driven Uncertainty Quantificationcited by 4
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Fieldcited by 4
- 2023Indoor Scene Reconstruction with Fine-Grained Details Using Hybrid Representation and Normal Prior Enhancementcited by 3
- 2023Instant Uncertainty Calibration of NeRFs Using a Meta-Calibratorcited by 3
- 2024ProvNeRF: Modeling per Point Provenance in NeRFs as a Stochastic Fieldcited by 3
- 2024Metric-Guided Conformal Bounds for Probabilistic Image Reconstructioncited by 3
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstructioncited by 3
- 2026Evidential Neural Radiance Fieldscited by 3
- 2025DNRSelect: Active Best View Selection for Deferred Neural Renderingcited by 2
- 2025WarpRF: Multi-View Consistency for Training-Free Uncertainty Quantification and Applications in Radiance Fieldscited by 2
- 2026SA-ResGS: Self-Augmented Residual 3D Gaussian Splatting for Next Best View Selectioncited by 2
- 2023Density Uncertainty Quantification with NeRF-Ensembles: Impact of Data and Scene Constraintscited by 1
- 2024STAIR: Semantic-Targeted Active Implicit Reconstructioncited by 1
- 2024VF-NeRF: Viewshed Fields for Rigid NeRF Registrationcited by 1
- 2025Hestia: Voxel-Face-Aware Hierarchical Next-Best-View Acquisition for Efficient 3D Reconstructioncited by 1
- 2026Active View Selection with Perturbed Gaussian Ensemble for Tomographic Reconstructioncited by 1
- 2026Predicting 3D structure by latent posterior samplingcited by 1
- 2026Uncertainty-Aware Gaussian Map for Vision-Language Navigationcited by 1
- 2026When Variance Is Not an Error Map: Calibrated Uncertainty for Radiative Gaussian Splatting in Sparse-View CTcited by 1
- 2026GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstructioncited by 1
- 2022A Review of Scene Representations for Robot Manipulatorscited by 0
- 2024Active Scout: Multi-Target Tracking Using Neural Radiance Fields in Dense Urban Environmentscited by 0
- 2024IOVS4NeRF:Incremental Optimal View Selection for Large-Scale NeRFscited by 0
- 2024PH-Dropout: Practical Epistemic Uncertainty Quantification for View Synthesiscited by 0
- 2025Data Augmentation for NeRFs in the Low Data Limitcited by 0
50 most cited of 58 All 58 (JSON)
- 2026Image Fidelity is Not Field Fidelity: Joint Thermodynamic Reconstruction and Error Localization in Neural Tomography24 Sep 2026
- 2026FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement31 Jul 2026
- 2026GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstruction31 Jul 2026
- 2026Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction30 Jul 2026
- 2026When Variance Is Not an Error Map: Calibrated Uncertainty for Radiative Gaussian Splatting in Sparse-View CT15 Jul 2026
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field28 May 2026
- 2026Uncertainty-Aware Gaussian Map for Vision-Language Navigation26 May 2026
- 2026Predicting 3D structure by latent posterior sampling11 May 2026
- 2026Confidence-Based Mesh Extraction from 3D Gaussians25 Mar 2026
- 2026Predictive Photometric Uncertainty in Gaussian Splatting for Novel View Synthesis24 Mar 2026
- 2026Active View Selection with Perturbed Gaussian Ensemble for Tomographic Reconstruction6 Mar 2026
- 2026Evidential Neural Radiance Fields27 Feb 2026
38 more
- 2026HERE: Hierarchical Active Exploration of Radiance Field with Epistemic Uncertainty Minimization12 Jan 2026
- 2026SA-ResGS: Self-Augmented Residual 3D Gaussian Splatting for Next Best View Selection6 Jan 2026
- 2025Auto3R: Automated 3D Reconstruction and Scanning via Data-driven Uncertainty Quantification4 Dec 2025
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstruction14 Oct 2025
- 2025UniFField: A Generalizable Unified Neural Feature Field for Visual, Semantic, and Spatial Uncertainties in Any Scene8 Oct 2025
- 2025Camera Splatting for Continuous View Optimization19 Sep 2025
- 2025IntelliCap: Intelligent Guidance for Consistent View Sampling18 Aug 2025
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priors8 Aug 2025
- 2025PRIMU: Uncertainty Estimation for Novel Views in Gaussian Splatting from Primitive-Based Representations of Error and Coverage4 Aug 2025
- 2025Hestia: Voxel-Face-Aware Hierarchical Next-Best-View Acquisition for Efficient 3D Reconstruction1 Aug 2025
- 2025WarpRF: Multi-View Consistency for Training-Free Uncertainty Quantification and Applications in Radiance Fields27 Jun 2025
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstruction17 Jun 2025
- 2025View-Dependent Uncertainty Estimation of 3D Gaussian Splatting10 Apr 2025
- 2025Free360: Layered Gaussian Splatting for Unbounded 360-Degree View Synthesis from Extremely Sparse and Unposed Views31 Mar 2025
- 2025These Magic Moments: Differentiable Uncertainty Quantification of Radiance Field Models18 Mar 2025
- 2025Data Augmentation for NeRFs in the Low Data Limit3 Mar 2025
- 2025DNRSelect: Active Best View Selection for Deferred Neural Rendering21 Jan 2025
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstruction29 Nov 2024
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularization13 Nov 2024
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Information22 Oct 2024
- 2024PH-Dropout: Practical Epistemic Uncertainty Quantification for View Synthesis7 Oct 2024
- 2024Sources of Uncertainty in 3D Scene Reconstruction10 Sep 2024
- 2024Regularized Multi-Decoder Ensemble for an Error-Aware Scene Representation Network26 Jul 2024
- 2024IOVS4NeRF:Incremental Optimal View Selection for Large-Scale NeRFs26 Jul 2024
- 2024CountGD: Multi-Modal Open-World Counting5 Jul 2024
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splatting14 Jun 2024
- 2024NeRF Director: Revisiting View Selection in Neural Volume Rendering13 Jun 2024
- 2024Active Scout: Multi-Target Tracking Using Neural Radiance Fields in Dense Urban Environments11 Jun 2024
- 2024Neural Visibility Field for Uncertainty-Driven Active Mapping11 Jun 2024
- 2024Metric-Guided Conformal Bounds for Probabilistic Image Reconstruction23 Apr 2024
- 2024Bayesian NeRF: Quantifying Uncertainty with Volume Density for Neural Implicit Fields10 Apr 2024
- 2024VF-NeRF: Viewshed Fields for Rigid NeRF Registration4 Apr 2024
- 2024Uncertainty-aware Active Learning of NeRF-based Object Models for Robot Manipulators using Visual and Re-orientation Actions2 Apr 2024
- 2024Modeling uncertainty for Gaussian Splatting27 Mar 2024
- 2024Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning25 Mar 2024
- 2024STAIR: Semantic-Targeted Active Implicit Reconstruction17 Mar 2024
- 2024ProvNeRF: Modeling per Point Provenance in NeRFs as a Stochastic Field16 Jan 2024
- 2023Density Uncertainty Quantification with NeRF-Ensembles: Impact of Data and Scene Constraints22 Dec 2023
50 newest of 58 All 58 (JSON)
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priorscited by 6
- 2024Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planningcited by 4
- 2026Predicting 3D structure by latent posterior samplingcited by 1
- 2026Predicting 3D structure by latent posterior sampling11 May 2026
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priors8 Aug 2025
- 2024Exploiting Priors from 3D Diffusion Models for RGB-Based One-Shot View Planning25 Mar 2024
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction24 May 2023
- 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 90
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 85
- 2023FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Informationcited by 63
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2023Active Neural Mappingcited by 30
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2024Neural Visibility Field for Uncertainty-Driven Active Mappingcited by 25
- 2024Modeling uncertainty for Gaussian Splattingcited by 17
- 2023Estimating 3D Uncertainty Field: Quantifying Uncertainty for Neural Radiance Fieldscited by 14
- 2024NeRF Director: Revisiting View Selection in Neural Volume Renderingcited by 14
- 2025Free360: Layered Gaussian Splatting for Unbounded 360-Degree View Synthesis from Extremely Sparse and Unposed Viewscited by 11
- 2024Bayesian NeRF: Quantifying Uncertainty with Volume Density for Neural Implicit Fieldscited by 9
12 most cited of 53 All 53 (JSON)
- 2026Image Fidelity is Not Field Fidelity: Joint Thermodynamic Reconstruction and Error Localization in Neural Tomography24 Sep 2026
- 2026FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement31 Jul 2026
- 2026GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstruction31 Jul 2026
- 2026Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction30 Jul 2026
- 2026When Variance Is Not an Error Map: Calibrated Uncertainty for Radiative Gaussian Splatting in Sparse-View CT15 Jul 2026
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field28 May 2026
- 2026Uncertainty-Aware Gaussian Map for Vision-Language Navigation26 May 2026
- 2026Confidence-Based Mesh Extraction from 3D Gaussians25 Mar 2026
- 2026Predictive Photometric Uncertainty in Gaussian Splatting for Novel View Synthesis24 Mar 2026
- 2026Active View Selection with Perturbed Gaussian Ensemble for Tomographic Reconstruction6 Mar 2026
- 2026Evidential Neural Radiance Fields27 Feb 2026
- 2026HERE: Hierarchical Active Exploration of Radiance Field with Epistemic Uncertainty Minimization12 Jan 2026
12 newest of 53 All 53 (JSON)