Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization
Not on the map. Why?
Abstract (arXiv)
Actively planning sensor views during object reconstruction is crucial for autonomous mobile robots. An effective method should be able to strike a balance between accuracy and efficiency. In this paper, we propose a seamless integration of the emerging implicit representation with the active reconstruction task. We build an implicit occupancy field as our geometry proxy. While training, the prior object bounding box is utilized as auxiliary information to generate clean and detailed reconstructions. To evaluate view uncertainty, we employ a sampling-based approach that directly extracts entropy from the reconstructed occupancy probability field as our measure of view information gain. This eliminates the need for additional uncertainty maps or learning. Unlike previous methods that compare view uncertainty within a finite set of candidates, we aim to find the next-best-view (NBV) on a continuous manifold. Leveraging the differentiability of the implicit representation, the NBV can be optimized directly by maximizing the view uncertainty using gradient descent. It significantly enhances the method's adaptability to different scenarios. Simulation and real-world experiments demonstrate that our approach effectively improves reconstruction accuracy and efficiency of view planning in active reconstruction tasks. The proposed system will open source at https://github.com/HITSZ-NRSL/ActiveImplicitRecon.git.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 29 Mar 2023.
Builds on
21 of 35 references.
References · 21
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
9 more
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 124
- 2022NeurAR: Neural Uncertainty for Autonomous 3D Reconstruction with Implicit Neural Representationscited by 54
- 2022Uncertainty Guided Policy for Active Robotic 3D Reconstruction using Neural Radiance Fieldscited by 53
- 2023NeU-NBV: Next Best View Planning Using Uncertainty Estimation in Image-Based Neural Renderingcited by 53
- 2021Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observationscited by 30
Built on by
Citing papers per year: 2023: 3; 2024: 6; 2025: 9; 2026: 9.
27 papers.
Sort:
By area:
- 2023FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Informationcited by 63
- 2024ActiveGS: Active Scene Reconstruction Using Gaussian Splattingcited by 34
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2024Neural Visibility Field for Uncertainty-Driven Active Mappingcited by 25
- 2025GauSS-MI: Gaussian Splatting Shannon Mutual Information for Active 3D Reconstructioncited by 15
- 2023Estimating 3D Uncertainty Field: Quantifying Uncertainty for Neural Radiance Fieldscited by 14
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Informationcited by 9
- 2024Learning with Unreliability: Fast Few-shot Voxel Radiance Fields with Relative Geometric Consistencycited by 6
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstructioncited by 5
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstructioncited by 4
- 2025Auto3R: Automated 3D Reconstruction and Scanning via Data-driven Uncertainty Quantificationcited by 4
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Fieldcited by 4
15 more
- 2025AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidancecited by 3
- 2023REF2-NeRF: Reflection and Refraction aware Neural Radiance Fieldcited by 2
- 2025WarpRF: Multi-View Consistency for Training-Free Uncertainty Quantification and Applications in Radiance Fieldscited by 2
- 2026ObjSplat: Geometry-Aware Gaussian Surfels for Active Object Reconstructioncited by 2
- 2026DAV-GSWT: Diffusion-Active-View Sampling for Data-Efficient Gaussian Splatting Wang Tilescited by 2
- 2026Coverage Optimization for Camera View Selectioncited by 2
- 2024STAIR: Semantic-Targeted Active Implicit Reconstructioncited by 1
- 2025Enhancing UAV Search under Occlusion using Next Best View Planningcited by 1
- 2026Rethinking Pose Refinement in 3D Gaussian Splatting under Pose Prior and Geometric Uncertaintycited by 1
- 2025Data Augmentation for NeRFs in the Low Data Limitcited by 0
- 2025Online 3D Gaussian Splatting Modeling with Novel View Selectioncited by 0
- 2026TRACE: Ergodic Trajectory Optimization for Active Scene Reconstructioncited by 0
- 2026DA-NBV: A Direction-Aware Next-Best-View Planner for Efficient 3D Reconstruction of Ships at Seacited by 0
- 20262D GauSS-MI: Efficient Active Scene Reconstruction with Balanced Visual and Geometric Qualitycited by 0
- 2026ActiveLang: Active Open-Vocabulary 3D Mapping with Semantic-Uncertainty-Guided Explorationcited by 0
- 2026ActiveLang: Active Open-Vocabulary 3D Mapping with Semantic-Uncertainty-Guided Exploration7 Oct 2026
- 20262D GauSS-MI: Efficient Active Scene Reconstruction with Balanced Visual and Geometric Quality18 Sep 2026
- 2026DA-NBV: A Direction-Aware Next-Best-View Planner for Efficient 3D Reconstruction of Ships at Sea8 Aug 2026
- 2026TRACE: Ergodic Trajectory Optimization for Active Scene Reconstruction3 Aug 2026
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field28 May 2026
- 2026Coverage Optimization for Camera View Selection6 Apr 2026
- 2026Rethinking Pose Refinement in 3D Gaussian Splatting under Pose Prior and Geometric Uncertainty17 Mar 2026
- 2026DAV-GSWT: Diffusion-Active-View Sampling for Data-Efficient Gaussian Splatting Wang Tiles17 Feb 2026
- 2026ObjSplat: Geometry-Aware Gaussian Surfels for Active Object Reconstruction11 Jan 2026
- 2025Auto3R: Automated 3D Reconstruction and Scanning via Data-driven Uncertainty Quantification4 Dec 2025
- 2025AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidance28 Nov 2025
- 2025Enhancing UAV Search under Occlusion using Next Best View Planning23 Nov 2025
15 more
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstruction14 Oct 2025
- 2025Online 3D Gaussian Splatting Modeling with Novel View Selection19 Aug 2025
- 2025WarpRF: Multi-View Consistency for Training-Free Uncertainty Quantification and Applications in Radiance Fields27 Jun 2025
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstruction17 Jun 2025
- 2025GauSS-MI: Gaussian Splatting Shannon Mutual Information for Active 3D Reconstruction29 Apr 2025
- 2025Data Augmentation for NeRFs in the Low Data Limit3 Mar 2025
- 2024ActiveGS: Active Scene Reconstruction Using Gaussian Splatting23 Dec 2024
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularization13 Nov 2024
- 2024Multimodal LLM Guided Exploration and Active Mapping using Fisher Information22 Oct 2024
- 2024Neural Visibility Field for Uncertainty-Driven Active Mapping11 Jun 2024
- 2024Learning with Unreliability: Fast Few-shot Voxel Radiance Fields with Relative Geometric Consistency26 Mar 2024
- 2024STAIR: Semantic-Targeted Active Implicit Reconstruction17 Mar 2024
- 2023FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Information29 Nov 2023
- 2023REF2-NeRF: Reflection and Refraction aware Neural Radiance Field28 Nov 2023
- 2023Estimating 3D Uncertainty Field: Quantifying Uncertainty for Neural Radiance Fields3 Nov 2023
- 2023FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Informationcited by 63
- 2024ActiveGS: Active Scene Reconstruction Using Gaussian Splattingcited by 34
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2024Neural Visibility Field for Uncertainty-Driven Active Mappingcited by 25
- 2025GauSS-MI: Gaussian Splatting Shannon Mutual Information for Active 3D Reconstructioncited by 15
- 2023Estimating 3D Uncertainty Field: Quantifying Uncertainty for Neural Radiance Fieldscited by 14
- 2024Learning with Unreliability: Fast Few-shot Voxel Radiance Fields with Relative Geometric Consistencycited by 6
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstructioncited by 5
- 2025Peering into the Unknown: Active View Selection with Neural Uncertainty Maps for 3D Reconstructioncited by 4
- 2025Auto3R: Automated 3D Reconstruction and Scanning via Data-driven Uncertainty Quantificationcited by 4
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Fieldcited by 4
- 2025AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidancecited by 3
12 most cited of 25 All 25 (JSON)
- 2026ActiveLang: Active Open-Vocabulary 3D Mapping with Semantic-Uncertainty-Guided Exploration7 Oct 2026
- 20262D GauSS-MI: Efficient Active Scene Reconstruction with Balanced Visual and Geometric Quality18 Sep 2026
- 2026DA-NBV: A Direction-Aware Next-Best-View Planner for Efficient 3D Reconstruction of Ships at Sea8 Aug 2026
- 2026TRACE: Ergodic Trajectory Optimization for Active Scene Reconstruction3 Aug 2026
- 2026Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field28 May 2026
- 2026Coverage Optimization for Camera View Selection6 Apr 2026
- 2026Rethinking Pose Refinement in 3D Gaussian Splatting under Pose Prior and Geometric Uncertainty17 Mar 2026
- 2026ObjSplat: Geometry-Aware Gaussian Surfels for Active Object Reconstruction11 Jan 2026
- 2025Auto3R: Automated 3D Reconstruction and Scanning via Data-driven Uncertainty Quantification4 Dec 2025
- 2025AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidance28 Nov 2025
- 2025Enhancing UAV Search under Occlusion using Next Best View Planning23 Nov 2025
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstruction14 Oct 2025
12 newest of 25 All 25 (JSON)