Estimating Semantic Ambiguity via Gaussian Context Distributions for VLM-Driven Traversability Analysis
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Autonomous navigation in unstructured environments requires robust scene understanding, yet Vision-Language Models (VLMs) often suffer from semantic ambiguity, where conflicting predictions can lead to dangerous failures. To address this, we present a novel pipeline for vision-based traversability estimation that explicitly models contextual uncertainty. Our approach utilizes Conceptual Anchoring to ground open-vocabulary VLM predictions onto a continuous physical traversability scale. By formulating the model's responses as a Gaussian Context Distribution (GCD), we derive both a dense traversability map and a dense uncertainty map based on the statistical properties of the distribution. Experimental validation on the real-world GOOSE dataset demonstrates that our proposed uncertainty metric effectively correlates with sources of ambiguity, such as visual artifacts and mixed terrain overlap. The method exhibits competitive performance while offering the distinct advantage of providing statistical uncertainty estimates to address semantic ambiguity, enabling safer and more reliable autonomous behavior in complex outdoor settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 8 Sep 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Robot Navigation Using Physically Grounded Vision-Language Models in Outdoor Environments
- 2026Reasoning About Traversability: Language-Guided Off-Road 3D Trajectory Planning
- 2026PIVOT: Physically Informed Vision-Language Off-Road Traversability for Field Robot Navigation ↗
- 2025Towards Zero-Shot Terrain Traversability Estimation: Challenges and Opportunities ↗
- 2025Uncertainty-Informed Active Perception for Open Vocabulary Object Goal Navigation
- 2024Navigation with VLM framework: Towards Going to Any Language
- 2026Which Terrain Is Better? Preference Learning with VLM Prototypes for Off-Road Traversability Ranking
- 2025ZeST: an VLM-based Zero-Shot Traversability Navigation for Unknown Environments