Belief Consistency Between Foundation-Model Evidence and Geometric Perception in Persistent Robotic Maps
Not on the map. Why?
Abstract (arXiv)
Persistent maps used by autonomous robots increasingly fuse a geometric perception stack whose assertions are well-characterized with a foundation-model channel that produces semantic claims without calibrated reliability about the same scene. Contemporary mapping systems integrate the two channels by treating the foundation-model channel as an additional voter into a per-element posterior, uncalibrated for its own per-class reliability and without machinery to flag when the two channels contradict each other at a given moment. We propose an update operator with two cooperating mechanisms: a per-class calibrated commit gate, and a per-event conflict-drop window that refuses to commit foundation-model claims contradicted by the geometric channel at the moment of the claim. We evaluate on KITTI-360 and ScanNet, with an oracle geometric channel (panoptic ground truth) and an off-the-shelf online semantic segmenter (Mask2Former) to demonstrate real-world performance. The operator produces substantially more accurate committed maps (KITTI is car commit precision 99.7% vs. 43.9% for the calibration-only operator; mean per-class IoU 0.522 vs. 0.180), retains more compositional true positives at higher precision than a monolithic compositional VLM prompt. The framework operates at deployment quality across both oracle and off-the-shelf-segmenter geometric channels, and is invariant under foundation-model substitution.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 38 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
29 of 38 references.
References · 29
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2023LERF: Language Embedded Radiance Fieldscited by 538
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 360
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 2023ConceptFusion: Open-set Multimodal 3D Mappingcited by 302
- 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 298
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 181
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 175
17 more
- 2023Conformal Language Modelingcited by 163
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
- 2021SuMa++: Efficient LiDAR-based Semantic SLAMcited by 100
- 2019PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Thingscited by 97
- 2024Clio: Real-time Task-Driven Open-Set 3D Scene Graphscited by 81
- 2019Volumetric Instance-Aware Semantic Mapping and 3D Object Discoverycited by 79
- 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
- 2024Khronos: A Unified Approach for Spatio-Temporal Metric-Semantic SLAM in Dynamic Environmentscited by 36
- 2019Bayesian Spatial Kernel Smoothing for Scalable Dense Semantic Mappingcited by 34
- 2016Meaningful Maps With Object-Oriented Semantic Mappingcited by 31
- 2024Hier-SLAM: Scaling-up Semantics in SLAM with a Hierarchically Categorical Gaussian Splattingcited by 15
- 2021Semantic OcTree Mapping and Shannon Mutual Information Computation for Robot Explorationcited by 14
- 2023ConvBKI: Real-Time Probabilistic Semantic Mapping Network with Quantifiable Uncertaintycited by 10
- 2021Active Bayesian Multi-class Mapping from Range and Semantic Segmentation Observationcited by 7
- 2025S-Graphs 2.0 -- A Hierarchical-Semantic Optimization and Loop Closure for SLAMcited by 5
- 2025Bayesian Fields: Task-driven Open-Set Semantic Gaussian Splattingcited by 5
Built on by
Not cited yet.