R2F: Repurposing Ray Frontiers for LLM-free Object Navigation
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Zero-shot open-vocabulary object navigation has progressed rapidly with the emergence of large Vision-Language Models (VLMs) and Large Language Models (LLMs), now widely used as high-level decision-makers instead of end-to-end policies. Although effective, such systems often rely on iterative large-model queries at inference time, introducing latency and computational overhead that limit real-time deployment. To address this problem, we repurpose ray frontiers (R2F), a recently proposed frontier-based exploration paradigm, to develop an LLM-free framework for indoor open-vocabulary object navigation. While ray frontiers were originally used to bias exploration using semantic cues carried along rays, we reinterpret frontier regions as explicit, direction-conditioned semantic hypotheses that serve as navigation goals. Language-aligned features accumulated along out-of-range rays are stored sparsely at frontiers, where each region maintains multiple directional embeddings encoding plausible unseen content. In this way, navigation then reduces to embedding-based frontier scoring and goal tracking within a classical mapping and planning pipeline, eliminating iterative large-model reasoning. We further introduce R2F-VLN, a lightweight extension for free-form language instructions using syntactic parsing and relational verification without additional VLM or LLM components. Experiments in Habitat-sim and on a real robotic platform demonstrate competitive state-of-the-art zero-shot performance with real-time execution, achieving up to 6 times faster runtime than VLM-based alternatives.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 43 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
35 of 43 references.
Closest ancestors · 3
Same direction, newest first
- 2024VLN-Game: Vision-Language Equilibrium Search for Zero-Shot Semantic Navigation18 Nov
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigation6 Dec
- 2022Visual Language Maps for Robot Navigation11 Oct
Other references · 32
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 429
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 178
- 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 135
20 more
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 94
- 2023GOAT: GO to Any Thingcited by 89
- 2024RADIOv2.5: Improved Baselines for Agglomerative Vision Foundation Modelscited by 89
- 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 77
- 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 75
- 2023Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigationcited by 74
- 2023How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontierscited by 54
- 2020Fast Frontier-based Information-driven Autonomous Exploration with an MAVcited by 24
- 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interactioncited by 23
- 2025RayFronts: Open-Set Semantic Ray Frontiers for Online Scene Understanding and Explorationcited by 23
- 2025BeliefMapNav: 3D Voxel-Based Belief Map for Zero-Shot Object Navigationcited by 19
- 2025FrontierNet: Learning Visual Cues to Explorecited by 12
- 2022SEER: Safe Efficient Exploration for Aerial Robots using Learning to Predict Information Gaincited by 11
- 2023Finding Things in the Unknown: Semantic Object-Centric Exploration with an MAVcited by 9
- 2022SC-Explorer: Incremental 3D Scene Completion for Safe and Efficient Exploration Mapping and Planningcited by 7
- 2023Efficient volumetric mapping of multi-scale environments using wavelet-based compressioncited by 6
- 2024IPPON: Common Sense Guided Informative Path Planning for Object Goal Navigationcited by 6
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontierscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025osmAG-LLM: Zero-Shot Open-Vocabulary Object Navigation via Semantic Maps and Large Language Models Reasoning
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models
- 2025LGR: LLM-Guided Ranking of Frontiers for Object Goal Navigation
- 2024Open-Vocabulary Object-Goal Navigation by Generalizing Semantic Mapping with Dense CLIP
- 2025Where Did I Leave My Glasses? Open-Vocabulary Semantic Exploration in Real-World Semi-Static Environments
- 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMs
- 2026HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Models
- 2024DivScene: Towards Open-Vocabulary Object Navigation with Large Vision Language Models in Diverse Scenes