OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
Not on the map. Why?
Abstract (arXiv)
Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Conventional navigation approaches often rely on dense 3D reconstruction and hand-crafted goal metrics, which limits their generalization across tasks and environments. Recent advances in vision-language navigation (VLN) and vision-language-action (VLA) models enable end-to-end policies conditioned on natural language, but typically require interactive training, large-scale data collection, or task-specific fine-tuning with a mobile agent. We formulate navigation as a sparse subgoal identification and reaching problem and observe that providing visual anchoring targets for high-level semantic priors enables highly efficient goal-conditioned navigation. Based on this insight, we select visual frontiers as semantic anchors and propose OpenFrontier, a navigation framework that requires no task-specific training or fine-tuning and seamlessly integrates diverse vision-language prior models. OpenFrontier enables efficient navigation with a lightweight system design, without dense 3D semantic mapping, task-specific policy training, or model fine-tuning. We evaluate OpenFrontier across multiple navigation benchmarks and demonstrate strong zero-shot performance, as well as effective real-world deployment on a mobile robot.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 47 of its 56 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
47 of 56 references.
References · 47
- 2023Visual Instruction Tuningcited by 7,792
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
35 more
- 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
- 2022Navigating to Objects in the Real Worldcited by 104
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
- 2024Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Modelscited by 79
- 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
- 2022A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontierscited by 62
- 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
- 2025UniGoal: Towards Universal Zero-shot Goal-oriented Navigationcited by 56
- 2024PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigatorscited by 55
- 2021SEAL: Self-supervised Embodied Active Learning using Exploration and 3D Consistencycited by 47
- 20223D-Aware Object Goal Navigation via Simultaneous Exploration and Identificationcited by 46
- 2020FUEL: Fast UAV Exploration using Incremental Frontier Structure and Hierarchical Planningcited by 42
- 2024End-to-End Navigation with Vision Language Models: Transforming Spatial Reasoning into Question-Answeringcited by 37
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 34
- 2023iPlanner: Imperative Path Planningcited by 32
- 2024BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulationcited by 31
- 2020Fast Frontier-based Information-driven Autonomous Exploration with an MAVcited by 23
- 2025Seeing Across Views: Benchmarking Spatial Reasoning of Vision-Language Models in Robotic Scenescited by 19
- 2025BeliefMapNav: 3D Voxel-Based Belief Map for Zero-Shot Object Navigationcited by 18
- 2024NavRL: Learning Safe Flight in Dynamic Environmentscited by 16
- 2022SEER: Safe Efficient Exploration for Aerial Robots using Learning to Predict Information Gaincited by 11
- 2025FrontierNet: Learning Visual Cues to Explorecited by 11
- 2023Frontier Semantic Exploration for Visual Target Navigationcited by 9
- 2024MapEx: Indoor Structure Exploration with Probabilistic Information Gain from Global Map Predictionscited by 9
- 2025ForesightNav: Learning Scene Imagination for Efficient Explorationcited by 9
- 2025Spatially-Enhanced Recurrent Memory for Long-Range Mapless Navigation via End-to-End Reinforcement Learningcited by 7
- 2023Efficient volumetric mapping of multi-scale environments using wavelet-based compressioncited by 6
- 2024IPPON: Common Sense Guided Informative Path Planning for Object Goal Navigationcited by 6
- 2020Go Fetch: Mobile Manipulation in Unstructured Environmentscited by 5
- 2024Cognitive Planning for Object Goal Navigation using Generative AI Modelscited by 4
- 2025History-Augmented Vision-Language Models for Frontier-Based Zero-Shot Object Navigationcited by 4
- 2025What Matters in RL-Based Methods for Object-Goal Navigation? An Empirical Study and A Unified Frameworkcited by 2
- 2025Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspectioncited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024VLN-Game: Vision-Language Equilibrium Search for Zero-Shot Semantic Navigation
- 2024Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMs
- 2024Navigation with VLM framework: Towards Going to Any Language
- 2025FiLM-Nav: Efficient and Generalizable Navigation via VLM Fine-tuning
- 2025OpenNav: Open-World Navigation with Multimodal Large Language Models
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation
- 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigation
- 2026SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation