Predictive Photometric Uncertainty in Gaussian Splatting for Novel View Synthesis
Not on the map. Why?
Abstract (arXiv)
Recent advances in 3D Gaussian Splatting have enabled impressive photorealistic novel view synthesis. However, to transition from a pure rendering engine to a reliable spatial map for autonomous agents and safety-critical applications, knowing where the representation is uncertain is as important as the rendering fidelity itself. We bridge this critical gap by introducing a lightweight, plug-and-play framework for pixel-wise, view-dependent predictive uncertainty estimation. Our post-hoc method formulates uncertainty as a Bayesian-regularized linear least-squares optimization over reconstruction residuals. This architecture-agnostic approach extracts a per-primitive uncertainty channel without modifying the underlying scene representation or degrading baseline visual fidelity. Crucially, we demonstrate that providing this actionable reliability signal successfully translates 3D Gaussian splatting into a trustworthy spatial map, further improving state-of-the-art performance across three critical downstream perception tasks: active view selection, pose-agnostic scene change detection, and pose-agnostic anomaly detection.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 48 of its 64 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
48 of 64 references.
References · 48
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
- 2023Gaussian Splatting SLAMcited by 410
- 2018Fully Convolutional Siamese Networks for Change Detectioncited by 305
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 214
- 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
- 2024Taming 3DGS: High-Quality Radiance Fields with Limited Resourcescited by 198
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
36 more
- 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
- 2024Revising Densification in Gaussian Splattingcited by 127
- 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 124
- 2018The Limits and Potentials of Deep Learning for Roboticscited by 104
- 20243D Gaussian as a New Era: A Surveycited by 102
- 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 90
- 2024Speedy-Splat: Fast 3D Gaussian Splatting with Sparse Pixels and Sparse Primitivescited by 90
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 85
- 2021Stochastic Neural Radiance Fields: Quantifying Uncertainty in Implicit 3D Representationscited by 80
- 2024AbsGS: Recovering Fine Details for 3D Gaussian Splattingcited by 80
- 2022Conditional-Flow NeRF: Accurate 3D Modelling with Reliable Uncertainty Quantificationcited by 71
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 59
- 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fieldscited by 58
- 2023PAD: A Dataset and Benchmark for Pose-agnostic Anomaly Detectioncited by 46
- 2021DR-TANet: Dynamic Receptive Temporal Attention Network for Street Scene Change Detectioncited by 32
- 2020Hierarchical Paired Channel Fusion Network for Street Scene Change Detectioncited by 31
- 2023FlipNeRF: Flipped Reflection Rays for Few-shot Novel View Synthesiscited by 29
- 2024SplatPose & Detect: Pose-Agnostic 3D Anomaly Detectioncited by 25
- 2023Improving NeRF Quality by Progressive Camera Placement for Unrestricted Navigation in Complex Environmentscited by 19
- 2025POp-GS: Next Best View in 3D-Gaussian Splatting with P-Optimalitycited by 18
- 2023The Change You Want to See (Now in 3D)cited by 17
- 2024Modeling uncertainty for Gaussian Splattingcited by 17
- 2024Towards Generalizable Scene Change Detectioncited by 17
- 20243DGS-CD: 3D Gaussian Splatting-based Change Detection for Physical Object Rearrangementcited by 15
- 2024Zero-Shot Scene Change Detectioncited by 13
- 2024ZeroSCD: Zero-Shot Street Scene Change Detectioncited by 12
- 2024Robust Scene Change Detection Using Visual Foundation Models and Cross-Attention Mechanismscited by 12
- 2024Modeling Uncertainty in 3D Gaussian Splatting through Continuous Semantic Splattingcited by 12
- 2024Multi-View Pose-Agnostic Change Localization with Zero Labelscited by 12
- 2024Manifold Sampling for Differentiable Uncertainty in Radiance Fieldscited by 11
- 2024SplatPose+: Real-time Image-Based Pose-Agnostic 3D Anomaly Detectioncited by 11
- 2025EMPLACE: Self-Supervised Urban Scene Change Detectioncited by 7
- 2025Gaussian Difference: Find Any Change Instance in 3D Scenescited by 5
- 2025PRIMU: Uncertainty Estimation for Novel Views in Gaussian Splatting from Primitive-Based Representations of Error and Coveragecited by 4
- 2024ProvNeRF: Modeling per Point Provenance in NeRFs as a Stochastic Fieldcited by 3
- 2025Changes in Real Time: Online Scene Change Detection with Multi-View Fusioncited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026From Pixels to Primitives: Scene Change Detection in 3D Gaussian Splattingcited by 2
- 2026λ-VAE: Variance Equalization for Posterior Collapsecited by 0
- 2026View-Structured Conformal Prediction for 3D Gaussian Splattingcited by 0
- 2026GAPS: Generative Active Pseudo-view Selection for Sparse-View 3D Gaussian Splattingcited by 0
- 2026PlenoCI: Plenoptic CharacterIstics for View Dependence Aware Change Classificationcited by 0
- 2026PlenoCI: Plenoptic CharacterIstics for View Dependence Aware Change Classification24 Sep 2026
- 2026GAPS: Generative Active Pseudo-view Selection for Sparse-View 3D Gaussian Splatting20 Sep 2026
- 2026View-Structured Conformal Prediction for 3D Gaussian Splatting9 Sep 2026
- 2026λ-VAE: Variance Equalization for Posterior Collapse6 Jul 2026
- 2026From Pixels to Primitives: Scene Change Detection in 3D Gaussian Splatting8 May 2026