mlsanityData to 14 Oct 2026

SafeVantage: Vantage-Aware Memory for Reliable Embodied Decisions

arXiv 2609.36906 ↗First posted 29 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable embodied decisions under partial observability require informative observations and sufficient supporting evidence. However, semantic scores alone do not reveal which viewpoints justify a claim or where additional evidence should be acquired. We introduce SafeVantage, a vantage-aware semantic memory and active acquisition framework that retains each claim's supporting views, camera poses, and estimated target location, keeping positive support distinct from search coverage. A learned candidate-observability model uses claim-grounded geometry to predict target visibility at reachable viewpoints. These predictions guide view selection through expected reduction in terminal decision loss, accounting for travel cost and geometrically distinct corroboration. A calibrated head then combines support, spatial consistency, and coverage to produce Yes, No, or Abstain decisions. We evaluate SafeVantage on a category-presence benchmark spanning 232 unseen ProcTHOR houses and 7,424 paired episodes per method and action budget. Compared with validation-selected equal-budget baselines, SafeVantage achieves macro-F1 gains of 24.7% and 12.0% at eight and twelve actions, respectively, with lower risk and higher answer rates at both budgets and 31.7% less travel at eight actions. Equal-input HM3D experiments show lower selective risk under fixed observations, while controlled ScanNet interventions show that restoring supporting views improves downstream VLM answers. Ablations further support the contribution of candidate observability to decision quality and acquisition efficiency. Results demonstrate the value of claim-level viewpoint evidence for connecting semantic memory, active acquisition, and reliable decision-making. Code is available at https://safevantage.github.io

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 32 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

30 of 32 references.

References · 30

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  3. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  4. 2023LERF: Language Embedded Radiance Fieldscited by 543
  5. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
  6. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  7. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  8. 2022Visual Language Maps for Robot Navigationcited by 365
  9. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  10. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
  11. 2017Embodied Question Answeringcited by 336
  12. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 308
18 more
  1. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
  2. 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
  3. 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 150
  4. 2022Habitat-Matterport 3D Semantics Datasetcited by 110
  5. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 109
  6. 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 75
  7. 2024Explore until Confident: Efficient Exploration for Embodied Question Answeringcited by 74
  8. 2024GraphEQA: Using 3D Semantic Scene Graphs for Real-time Embodied Question Answeringcited by 37
  9. 2025Beyond the Destination: A Novel Benchmark for Exploration-Aware Embodied Question Answeringcited by 30
  10. 2025Describe Anything Anywhere At Any Momentcited by 19
  11. 2024EfficientEQA: An Efficient Approach to Open-Vocabulary Embodied Question Answeringcited by 15
  12. 2025Enter the Mind Palace: Reasoning and Planning for Long-term Active Embodied Question Answeringcited by 14
  13. 2025Memory-Centric Embodied Question Answeringcited by 12
  14. 2025When Robots Should Say "I Don't Know": Benchmarking Abstention in Embodied Question Answeringcited by 10
  15. 2026OpenVoxel: Training-Free Grouping and Captioning Voxels for Open-Vocabulary 3D Scene Understandingcited by 5
  16. 2026Remember with Confidence: Uncertainty Quantification for Spatio-temporal Memory with Probabilistic Guaranteescited by 3
  17. 2026FARM: Find Anything using Relational Spatial Memorycited by 3
  18. 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous drivingcited by 3

Built on by

Not cited yet.