mlsanityData to 14 Oct 2026

Reliable Semantic Understanding for Real World Zero-shot Object Goal Navigation

arXiv 2410.21926 ↗First posted 29 Oct 2024cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce an innovative approach to advancing semantic understanding in zero-shot object goal navigation (ZS-OGN), enhancing the autonomy of robots in unfamiliar environments. Traditional reliance on labeled data has been a limitation for robotic adaptability, which we address by employing a dual-component framework that integrates a GLIP Vision Language Model for initial detection and an InstructionBLIP model for validation. This combination not only refines object and environmental recognition but also fortifies the semantic interpretation, pivotal for navigational decision-making. Our method, rigorously tested in both simulated and real-world settings, exhibits marked improvements in navigation precision and reliability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 29 Oct 2024.

Builds on

23 of 32 references.

References · 23

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2021Grounded Language-Image Pre-trainingcited by 1,156
  3. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
  4. 2022Visual Language Maps for Robot Navigationcited by 365
  5. 2020Learning to Explore using Active Neural SLAMcited by 316
  6. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
  7. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  8. 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 193
  9. 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
  10. 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
  11. 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 150
  12. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
11 more
  1. 2020MinkLoc3D: Point Cloud Based Large-Scale Place Recognitioncited by 115
  2. 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 89
  3. 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
  4. 2017Self-supervised Deep Reinforcement Learning with Generalized Computation Graphs for Robot Navigationcited by 77
  5. 2020The Marathon 2: A Navigation Systemcited by 70
  6. 2022Zero Experience Required: Plug & Play Modular Transfer Learning for Semantic Visual Navigationcited by 67
  7. 2023Text2Loc: 3D Point Cloud Localization from Natural Languagecited by 35
  8. 2021VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigationcited by 31
  9. 2022Zero-shot object goal visual navigationcited by 31
  10. 2022JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agentscited by 30
  11. 2021Hierarchies of Planning and Reinforcement Learning for Robot Navigationcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Zero-shot Object Navigation with Vision-Language Models Reasoning
  2. 2026GoalVLM: VLM-driven Object Goal Navigation for Multi-Agent System
  3. 2025RANGER: A Monocular Zero-Shot Semantic Navigation Framework through Visual Contextual Adaptation
  4. 2025UniGoal: Towards Universal Zero-shot Goal-oriented Navigation
  5. 2024Prioritized Semantic Learning for Zero-shot Instance Navigation
  6. 2025History-Augmented Vision-Language Models for Frontier-Based Zero-Shot Object Navigation
  7. 2026ViTL: Temporal Logic-Guided Zero-Shot Natural Language Navigation via Vision-Language Models
  8. 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models