FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Information
Not on the map. Why?
Abstract (arXiv)
This study addresses the challenging problem of active view selection and uncertainty quantification within the domain of Radiance Fields. Neural Radiance Fields (NeRF) have greatly advanced image rendering and reconstruction, but the cost of acquiring images poses the need to select the most informative viewpoints efficiently. Existing approaches depend on modifying the model architecture or hypothetical perturbation field to indirectly approximate the model uncertainty. However, selecting views from indirect approximation does not guarantee optimal information gain for the model. By leveraging Fisher Information, we directly quantify observed information on the parameters of Radiance Fields and select candidate views by maximizing the Expected Information Gain(EIG). Our method achieves state-of-the-art results on multiple tasks, including view selection, active mapping, and uncertainty quantification, demonstrating its potential to advance the field of Radiance Fields.
Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). Builds on 26 of its 36 references that are in the map. First posted on arXiv 29 Nov 2023.
Builds on
26 of 36 references.
References · 26
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 610
- 2020A Survey of Deep Active Learningcited by 554
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 432
14 more
- 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 365
- 2017A Bayesian Perspective on Generalization and Stochastic Gradient Descentcited by 135
- 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
- 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 91
- 2021Gone Fishing: Neural Active Learning with Fisher Embeddingscited by 88
- 2021SIMILAR: Submodular Information Measures Based Active Learning In Realistic Scenarioscited by 84
- 2021Stochastic Neural Radiance Fields: Quantifying Uncertainty in Implicit 3D Representationscited by 82
- 2022Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantificationcited by 73
- 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fieldscited by 60
- 2022NeurAR: Neural Uncertainty for Autonomous 3D Reconstruction with Implicit Neural Representationscited by 55
- 2023Active Neural Mappingcited by 31
- 2022Unifying Approaches in Active Learning and Active Sampling via Fisher Information and Information-Theoretic Quantitiescited by 28
- 2023Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimizationcited by 28
- 2023Uncertainty-Driven Dense Two-View Structure from Motioncited by 3
Built on by
Citing papers per year: 2024: 19; 2025: 25; 2026: 20.
64 papers.
Sort:
By area:
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 95
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
- 2024Sort-free Gaussian Splatting via Weighted Sum Renderingcited by 29
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2025Eye, Robot: Learning to Look to Act with a BC-RL Perception-Action Loopcited by 25
- 2024GaussianMarker: Uncertainty-Aware Copyright Protection of 3D Gaussian Splattingcited by 21
- 2025POp-GS: Next Best View in 3D-Gaussian Splatting with P-Optimalitycited by 18
- 2024Touch-GS: Visual-Tactile Supervised 3D Gaussian Splattingcited by 16
- 2024HDGS: Textured 2D Gaussian Splatting for Enhanced Scene Renderingcited by 16
- 2024AONeuS: A Neural Rendering Framework for Acoustic-Optical Sensor Fusioncited by 13
- 2024Manifold Sampling for Differentiable Uncertainty in Radiance Fieldscited by 12
38 more
- 2024Modeling Uncertainty in 3D Gaussian Splatting through Continuous Semantic Splattingcited by 12
- 2025FrontierNet: Learning Visual Cues to Explorecited by 12
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenescited by 11
- 2024Sources of Uncertainty in 3D Scene Reconstructioncited by 10
- 2024Next Best Sense: Guiding Vision and Touch with FisherRF for 3D Gaussian Splattingcited by 10
- 2025MarkSplatter: Generalizable Watermarking for 3D Gaussian Splatting Model via Splatter Image Structurecited by 10
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Informationcited by 9
- 2025These Magic Moments: Differentiable Uncertainty Quantification of Radiance Field Modelscited by 6
- 2025PRIMU: Uncertainty Estimation for Novel Views in Gaussian Splatting from Primitive-Based Representations of Error and Coveragecited by 6
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priorscited by 6
- 2025Uncertainty-Aware Normal-Guided Gaussian Splatting for Surface Reconstruction from Sparse Image Sequencescited by 5
- 2025View-Dependent Uncertainty Estimation of 3D Gaussian Splattingcited by 5
- 2025SpeeDe3DGS: Speedy Deformable 3D Gaussian Splatting with Temporal Pruning and Motion Groupingcited by 5
- 2026GSMem: 3D Gaussian Splatting as Persistent Spatial Memory for Zero-Shot Embodied Exploration and Reasoningcited by 5
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Fieldcited by 5
- 2024Frequency-based View Selection in Gaussian Splatting Reconstructioncited by 4
- 2025Uncertainty-Aware Diffusion Guided Refinement of 3D Scenescited by 3
- 2026VarSplat: Uncertainty-aware 3D Gaussian Splatting for Robust RGB-D SLAMcited by 3
- 2026Confidence-Based Mesh Extraction from 3D Gaussianscited by 3
- 2025DM-OSVP++: One-Shot View Planning Using 3D Diffusion Models for Active RGB-Based Object Reconstructioncited by 2
- 2025VIN-NBV: A View Introspection Network for Next-Best-View Selectioncited by 2
- 2025Wideband RF Radiance Field Modeling Using Frequency-embedded 3D Gaussian Splattingcited by 2
- 2026SA-ResGS: Self-Augmented Residual 3D Gaussian Splatting for Next Best View Selectioncited by 2
- 2026B3-Seg: Camera-Free, Training-Free 3DGS Segmentation via Analytic EIG and Beta-Bernoulli Bayesian Updatescited by 2
- 2026Coverage Optimization for Camera View Selectioncited by 2
- 2024GURecon: Learning Detailed 3D Geometric Uncertainties for Neural Surface Reconstructioncited by 1
- 2025Hestia: Voxel-Face-Aware Hierarchical Next-Best-View Acquisition for Efficient 3D Reconstructioncited by 1
- 2025CoRe-GS: Coarse-to-Refined Gaussian Splatting with Semantic Object Focuscited by 1
- 2025Real-World Reinforcement Learning of Active Perception Behaviorscited by 1
- 2025Next Best View Selections for Semantic and Dynamic 3D Gaussian Splattingcited by 1
- 2026FreeScale: Scaling 3D Scenes via Certainty-Aware Free-View Generationcited by 1
- 2026A Bayesian Approach for Task-Specific Next-Best-View Selection with Uncertain Geometrycited by 1
- 2026GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mappingcited by 1
- 2026GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstructioncited by 1
- 2024Surface-Based Visibility-Guided Uncertainty for Continuous Active 3D Neural Reconstructioncited by 0
- 2024Active Scout: Multi-Target Tracking Using Neural Radiance Fields in Dense Urban Environmentscited by 0
- 2024RIGI: Rectifying Image-to-3D Generation Inconsistency via Uncertainty-aware Learningcited by 0
- 2025Data Augmentation for NeRFs in the Low Data Limitcited by 0
50 most cited of 64 All 64 (JSON)
- 2026Look Where You Can: Active View Selection for CAD Reconstruction under Occlusion8 Oct 2026
- 2026VCURF: Virtual Camera-based Uncertainty of Radiance Fields2 Oct 2026
- 2026UGOD: Uncertainty-Guided Opacity and Dropout for Sparse-View 3D Gaussian Splatting30 Sep 2026
- 2026AGILE-GS: Anchor-Guided Fast Next-Best-View Selection for Active 3D Gaussian Splatting28 Sep 2026
- 2026LiTe-GS: Oracle-Efficient Next Best View Selection for 3D Gaussian Splatting24 Sep 2026
- 2026GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstruction31 Jul 2026
- 2026GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mapping29 Jun 2026
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field28 May 2026
- 2026Remember to be Curious: Episodic Context and Persistent Worlds for 3D Exploration21 May 2026
- 2026Learning What Matters: Adaptive Information-Theoretic Objectives for Robot Exploration12 May 2026
- 2026A Bayesian Approach for Task-Specific Next-Best-View Selection with Uncertain Geometry6 May 2026
- 2026FreeScale: Scaling 3D Scenes via Certainty-Aware Free-View Generation12 Apr 2026
38 more
- 2026Coverage Optimization for Camera View Selection6 Apr 2026
- 2026Information-Regularized Constrained Inversion for Stable Avatar Editing from Sparse Supervision3 Apr 2026
- 2026Confidence-Based Mesh Extraction from 3D Gaussians25 Mar 2026
- 2026FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstruction22 Mar 2026
- 2026GSMem: 3D Gaussian Splatting as Persistent Spatial Memory for Zero-Shot Embodied Exploration and Reasoning19 Mar 2026
- 2026VarSplat: Uncertainty-aware 3D Gaussian Splatting for Robust RGB-D SLAM10 Mar 2026
- 2026B3-Seg: Camera-Free, Training-Free 3DGS Segmentation via Analytic EIG and Beta-Bernoulli Bayesian Updates19 Feb 2026
- 2026SA-ResGS: Self-Augmented Residual 3D Gaussian Splatting for Next Best View Selection6 Jan 2026
- 2025Next Best View Selections for Semantic and Dynamic 3D Gaussian Splatting28 Dec 2025
- 2025Real-World Reinforcement Learning of Active Perception Behaviors1 Dec 2025
- 2025OUGS: Active View Selection via Object-aware Uncertainty Estimation in 3DGS12 Nov 2025
- 2025Extreme Views: 3DGS Filter for Novel View Synthesis from Out-of-Distribution Camera Poses22 Oct 2025
- 2025Geometry-Aware Scene Configurations for Novel View Synthesis10 Oct 2025
- 2025Camera Splatting for Continuous View Optimization19 Sep 2025
- 2025CoRe-GS: Coarse-to-Refined Gaussian Splatting with Semantic Object Focus5 Sep 2025
- 2025MarkSplatter: Generalizable Watermarking for 3D Gaussian Splatting Model via Splatter Image Structure31 Aug 2025
- 2025Seeing the Many: Exploring Parameter Distributions Conditioned on Features in Surrogates18 Aug 2025
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priors8 Aug 2025
- 2025PRIMU: Uncertainty Estimation for Novel Views in Gaussian Splatting from Primitive-Based Representations of Error and Coverage4 Aug 2025
- 2025Hestia: Voxel-Face-Aware Hierarchical Next-Best-View Acquisition for Efficient 3D Reconstruction1 Aug 2025
- 2025Eye, Robot: Learning to Look to Act with a BC-RL Perception-Action Loop12 Jun 2025
- 2025SpeeDe3DGS: Speedy Deformable 3D Gaussian Splatting with Temporal Pruning and Motion Grouping9 Jun 2025
- 2025Wideband RF Radiance Field Modeling Using Frequency-embedded 3D Gaussian Splatting27 May 2025
- 2025GLEAM: Learning Generalizable Exploration Policy for Active Mapping in Complex 3D Indoor Scenes26 May 2025
- 2025VIN-NBV: A View Introspection Network for Next-Best-View Selection9 May 2025
- 2025DM-OSVP++: One-Shot View Planning Using 3D Diffusion Models for Active RGB-Based Object Reconstruction16 Apr 2025
- 2025View-Dependent Uncertainty Estimation of 3D Gaussian Splatting10 Apr 2025
- 2025Uncertainty-Aware Diffusion Guided Refinement of 3D Scenes19 Mar 2025
- 2025These Magic Moments: Differentiable Uncertainty Quantification of Radiance Field Models18 Mar 2025
- 2025Uncertainty-Aware Normal-Guided Gaussian Splatting for Surface Reconstruction from Sparse Image Sequences14 Mar 2025
- 2025POp-GS: Next Best View in 3D-Gaussian Splatting with P-Optimality10 Mar 2025
- 2025Data Augmentation for NeRFs in the Low Data Limit3 Mar 2025
- 2025FrontierNet: Learning Visual Cues to Explore8 Jan 2025
- 2024GURecon: Learning Detailed 3D Geometric Uncertainties for Neural Surface Reconstruction19 Dec 2024
- 2024HDGS: Textured 2D Gaussian Splatting for Enhanced Scene Rendering2 Dec 2024
- 2024RIGI: Rectifying Image-to-3D Generation Inconsistency via Uncertainty-aware Learning28 Nov 2024
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularization13 Nov 2024
- 2024Modeling Uncertainty in 3D Gaussian Splatting through Continuous Semantic Splatting4 Nov 2024
50 newest of 64 All 64 (JSON)
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 95
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
- 2024Sort-free Gaussian Splatting via Weighted Sum Renderingcited by 29
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2025Eye, Robot: Learning to Look to Act with a BC-RL Perception-Action Loopcited by 25
- 2024GaussianMarker: Uncertainty-Aware Copyright Protection of 3D Gaussian Splattingcited by 21
- 2025POp-GS: Next Best View in 3D-Gaussian Splatting with P-Optimalitycited by 18
- 2024Touch-GS: Visual-Tactile Supervised 3D Gaussian Splattingcited by 16
- 2024HDGS: Textured 2D Gaussian Splatting for Enhanced Scene Renderingcited by 16
- 2024AONeuS: A Neural Rendering Framework for Acoustic-Optical Sensor Fusioncited by 13
- 2024Manifold Sampling for Differentiable Uncertainty in Radiance Fieldscited by 12
12 most cited of 57 All 57 (JSON)
- 2026Look Where You Can: Active View Selection for CAD Reconstruction under Occlusion8 Oct 2026
- 2026VCURF: Virtual Camera-based Uncertainty of Radiance Fields2 Oct 2026
- 2026UGOD: Uncertainty-Guided Opacity and Dropout for Sparse-View 3D Gaussian Splatting30 Sep 2026
- 2026AGILE-GS: Anchor-Guided Fast Next-Best-View Selection for Active 3D Gaussian Splatting28 Sep 2026
- 2026LiTe-GS: Oracle-Efficient Next Best View Selection for 3D Gaussian Splatting24 Sep 2026
- 2026GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstruction31 Jul 2026
- 2026GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mapping29 Jun 2026
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field28 May 2026
- 2026Learning What Matters: Adaptive Information-Theoretic Objectives for Robot Exploration12 May 2026
- 2026A Bayesian Approach for Task-Specific Next-Best-View Selection with Uncertain Geometry6 May 2026
- 2026FreeScale: Scaling 3D Scenes via Certainty-Aware Free-View Generation12 Apr 2026
- 2026Coverage Optimization for Camera View Selection6 Apr 2026
12 newest of 57 All 57 (JSON)