RANGER: A Monocular Zero-Shot Semantic Navigation Framework through Visual Contextual Adaptation
Not on the map. Why?
Abstract (arXiv)
Efficient target localization and autonomous navigation in complex environments are fundamental to real-world embodied applications. While recent advances in multimodal foundation models have enabled zero-shot object goal navigation, allowing robots to search for arbitrary objects without fine-tuning, existing methods face two key limitations: (1) heavy reliance on ground-truth depth and pose information, which restricts applicability in real-world scenarios; and (2) lack of visual in-context learning (VICL) capability to extract geometric and semantic priors from environmental context, as in a short traversal video. To address these challenges, we propose RANGER, a novel zero-shot, open-vocabulary semantic navigation framework that operates using only a monocular camera. Leveraging powerful 3D foundation models, RANGER eliminates the dependency on depth and pose while exhibiting strong VICL capability. By simply observing a short video of the target environment, the system can also significantly improve task efficiency without requiring architectural modifications or task-specific retraining. The framework integrates several key components: keyframe-based 3D reconstruction, semantic point cloud generation, vision-language model (VLM)-driven exploration value estimation, high-level adaptive waypoint selection, and low-level action execution. Experiments on the HM3D benchmark and real-world environments demonstrate that RANGER achieves competitive performance in terms of navigation success rate and exploration efficiency, while showing superior VICL adaptability, with no previous 3D mapping of the environment required.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 30 Dec 2025.
Builds on
36 of 41 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Segment Anythingcited by 8,234
- 2023Visual Instruction Tuningcited by 7,869
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
24 more
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2023An Embodied Generalist Agent in 3D Worldcited by 365
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 205
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 136
- 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 127
- 2023L3MVN: Leveraging Large Language Models for Visual Target Navigationcited by 120
- 2022Habitat-Matterport 3D Semantics Datasetcited by 110
- 2023PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNavcited by 93
- 2023OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNavcited by 70
- 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 67
- 2024PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigatorscited by 58
- 2024VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Modelcited by 57
- 2025UniGoal: Towards Universal Zero-shot Goal-oriented Navigationcited by 57
- 2023SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real Worldcited by 48
- 2025Being-0: A Humanoid Robotic Agent with Vision-Language Models and Modular Skillscited by 22
- 2024Recoverable Compression: A Multimodal Vision Token Recovery Mechanism Guided by Text Informationcited by 18
- 2023Object Goal Navigation with Recursive Implicit Mapscited by 16
- 2024VLN-Game: Vision-Language Equilibrium Search for Zero-Shot Semantic Navigationcited by 11
- 2025C-NAV: Towards Self-Evolving Continual Object Navigation in Open Worldcited by 9
- 2024NOLO: Navigate Only Look Oncecited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Reliable Semantic Understanding for Real World Zero-shot Object Goal Navigation
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
- 2026SpatialAnt: Autonomous Zero-Shot Robot Navigation via Active Scene Reconstruction and Visual Anticipation
- 2026AgenticNav: Zero-Shot Vision-and-Language Navigation as a Tool-Calling Harness
- 2023Co-NavGPT: Multi-Robot Cooperative Visual Semantic Navigation Using Vision Language Models
- 2025FiLM-Nav: Efficient and Generalizable Navigation via VLM Fine-tuning
- 2025VL-Explore: Zero-shot Vision-Language Exploration and Target Discovery by Mobile Robots
- 2026TADreamer: Zero-Shot Language-Guided 3D Navigation for Terrestrial-Aerial Bimodal Robots via Video Imagination