# GauSS-MI: Gaussian Splatting Shannon Mutual Information for Active 3D Reconstruction

arXiv: https://arxiv.org/abs/2504.21067 · HTML: https://mlsanity.com/paper/2504.21067/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Builds on 23 of its 45 references that are in the map.
- First posted on arXiv 29 Apr 2025.

## Builds on (most cited first, 23 of 23)

- [3D Gaussian Splatting for Real-Time Radiance Field Rendering](https://mlsanity.com/paper/2308.04079/) (2023)
- [Gaussian Splatting SLAM](https://mlsanity.com/paper/2312.06741/) (2023)
- [Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flow](https://mlsanity.com/paper/1802.07095/) (2018)
- [ActiveNeRF: Learning where to See with Uncertainty Estimation](https://mlsanity.com/paper/2209.08546/) (2022)
- [Bayes' Rays: Uncertainty Quantification for Neural Radiance Fields](https://mlsanity.com/paper/2309.03185/) (2023)
- [Flightmare: A Flexible Quadrotor Simulator](https://mlsanity.com/paper/2009.00563/) (2020)
- [Stochastic Neural Radiance Fields: Quantifying Uncertainty in Implicit 3D Representations](https://mlsanity.com/paper/2109.02123/) (2021)
- [NeurAR: Neural Uncertainty for Autonomous 3D Reconstruction with Implicit Neural Representations](https://mlsanity.com/paper/2207.10985/) (2022)
- [ActiveGS: Active Scene Reconstruction Using Gaussian Splatting](https://mlsanity.com/paper/2412.17769/) (2024)
- [ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splatting](https://mlsanity.com/paper/2410.21955/) (2024)
- [GS-Planner: A Gaussian-Splatting-based Planning Framework for Active High-Fidelity Reconstruction](https://mlsanity.com/paper/2405.10142/) (2024)
- [Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization](https://mlsanity.com/paper/2303.16739/) (2023)
- [NARUTO: Neural Active Reconstruction from Uncertain Target Observations](https://mlsanity.com/paper/2402.18771/) (2024)
- [ActiveGAMER: Active GAussian Mapping through Efficient Rendering](https://mlsanity.com/paper/2501.06897/) (2025)
- [A Review on Viewpoints and Path-planning for UAV-based 3D Reconstruction](https://mlsanity.com/paper/2205.03716/) (2022)
- [FALCON: Fast Autonomous Aerial Exploration using Coverage Path Guidance](https://mlsanity.com/paper/2407.00577/) (2024)
- [HGS-Planner: Hierarchical Planning Framework for Active Scene Reconstruction Using 3D Gaussian Splatting](https://mlsanity.com/paper/2409.17624/) (2024)
- [FSMI: Fast computation of Shannon Mutual Information for information-theoretic mapping](https://mlsanity.com/paper/1905.02238/) (2019)
- [PredRecon: A Prediction-boosted Planning Framework for Fast and High-quality Autonomous Aerial Reconstruction](https://mlsanity.com/paper/2302.04488/) (2023)
- [Autonomous Cave Surveying with an Aerial Robot](https://mlsanity.com/paper/2003.13883/) (2020)
- [FC-Planner: A Skeleton-guided Planning Framework for Fast Aerial Coverage of Complex 3D Scenes](https://mlsanity.com/paper/2309.13882/) (2023)
- [SO-NeRF: Active View Planning for NeRF using Surrogate Objectives](https://mlsanity.com/paper/2312.03266/) (2023)
- [One Fling to Goal: Environment-aware Dynamics for Goal-conditioned Fabric Flinging](https://mlsanity.com/paper/2406.14136/) (2024)

## Built on by (most cited first, 17 of 17)

- [ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGS](https://mlsanity.com/paper/2505.23734/) (2025)
- [Auto3R: Automated 3D Reconstruction and Scanning via Data-driven Uncertainty Quantification](https://mlsanity.com/paper/2512.04528/) (2025)
- [ObjSplat: Geometry-Aware Gaussian Surfels for Active Object Reconstruction](https://mlsanity.com/paper/2601.06997/) (2026)
- [DAV-GSWT: Diffusion-Active-View Sampling for Data-Efficient Gaussian Splatting Wang Tiles](https://mlsanity.com/paper/2602.15355/) (2026)
- [Active View Selection with Perturbed Gaussian Ensemble for Tomographic Reconstruction](https://mlsanity.com/paper/2603.06852/) (2026)
- [Next Best View Selections for Semantic and Dynamic 3D Gaussian Splatting](https://mlsanity.com/paper/2512.22771/) (2025)
- [GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstruction](https://mlsanity.com/paper/2607.29037/) (2026)
- [OccamView: Object-Conditioned View Selection for Frame-Budgeted Active 3D Gaussian Reconstruction](https://mlsanity.com/paper/2608.16499/) (2026)
- [OUGS: Active View Selection via Object-aware Uncertainty Estimation in 3DGS](https://mlsanity.com/paper/2511.09397/) (2025)
- [SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splatting](https://mlsanity.com/paper/2511.17092/) (2025)
- [Learning What Matters: Adaptive Information-Theoretic Objectives for Robot Exploration](https://mlsanity.com/paper/2605.12084/) (2026)
- [DynActiveGS: Active Gaussian Splatting for Dynamic Scene Reconstruction](https://mlsanity.com/paper/2608.01178/) (2026)
- [TRACE: Ergodic Trajectory Optimization for Active Scene Reconstruction](https://mlsanity.com/paper/2608.02304/) (2026)
- [AURORA: Active Uncertainty-Driven Re-Orientation for In-Hand Reconstruction](https://mlsanity.com/paper/2609.08493/) (2026)
- [2D GauSS-MI: Efficient Active Scene Reconstruction with Balanced Visual and Geometric Quality](https://mlsanity.com/paper/2609.21516/) (2026)
- [Matisse: Evidence-Space Reasoning for Active 3D Reconstruction](https://mlsanity.com/paper/2609.38746/) (2026)
- [VCURF: Virtual Camera-based Uncertainty of Radiance Fields](https://mlsanity.com/paper/2610.04076/) (2026)

## Abstract (arXiv)

This research tackles the challenge of real-time active view selection and uncertainty quantification on visual quality for active 3D reconstruction. Visual quality is a critical aspect of 3D reconstruction. Recent advancements such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have notably enhanced the image rendering quality of reconstruction models. Nonetheless, the efficient and effective acquisition of input images for reconstruction-specifically, the selection of the most informative viewpoint-remains an open challenge, which is crucial for active reconstruction. Existing studies have primarily focused on evaluating geometric completeness and exploring unobserved or unknown regions, without direct evaluation of the visual uncertainty within the reconstruction model. To address this gap, this paper introduces a probabilistic model that quantifies visual uncertainty for each Gaussian. Leveraging Shannon Mutual Information, we formulate a criterion, Gaussian Splatting Shannon Mutual Information (GauSS-MI), for real-time assessment of visual mutual information from novel viewpoints, facilitating the selection of next best view. GauSS-MI is implemented within an active reconstruction system integrated with a view and motion planner. Extensive experiments across various simulated and real-world scenes showcase the superior visual quality and reconstruction efficiency performance of the proposed system.
