ABot-N1: Toward a General Visual Language Navigation Foundation Model
Not on the map. Why?
Abstract (arXiv)
Visual Language Navigation foundation models aim to unify deep reasoning for grounded spatial decisions with broad versatility for diverse embodied tasks. Current approaches typically achieve this integration via monolithic policies that map observations directly to actions, yet they often suffer from coordinate drift and poor handling of long-tail semantics. Furthermore, these black-box mappings lack interpretability, hindering the simultaneous achievement of generality, robustness, and transparency. We present ABot-N1, a step toward a general Visual Language Navigation foundation model, that addresses these challenges by decoupling cognition from control via a slow-fast architecture guided by dual visual-language signals. More specifically, a slow vision-language reasoner performs explicit Chain-of-Thought reasoning while producing a pixel goal. This compact set of image-space anchor points serves as a universal interface for diverse tasks, including point-goal, object-goal, poi-goal, instruction-following, and person-following. Subsequently, a fast action expert leverages both the textual cues and the pixel guidance to generate continuous waypoints at the native control frequency. By bridging high-level intents and low-level control through pixel-grounded anchors paired with explicit linguistic traces, our approach ensures robust, generalizable, and interpretable navigation across simulation and real-world benchmarks. ABot-N1 establishes new state-of-the-art records, delivering massive gains specifically in urban-scale navigation: boosting POI arrival by 35.0% (to 77.3%) and achieving 95.4%/92.9% SR in complex indoor and outdoor scenes. It also maintains superior robustness across object-reaching, person-following, and instruction-following tasks. New Point-Goal/POI-Goal benchmarks are released as open source to advance the field of urban-scale navigation.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 65 of its 73 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
65 of 73 references.
References · 65
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 441
- 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 414
38 more
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 311
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 248
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2023ViNT: A Foundation Model for Visual Navigationcited by 222
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 211
- 2024PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMscited by 190
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 171
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 157
- 2022Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigationcited by 132
- 2021Waypoint Models for Instruction-guided Navigation in Continuous Environmentscited by 129
- 2023GridMM: Grid Memory Map for Vision-and-Language Navigationcited by 124
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 118
- 2022Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directionscited by 117
- 2020Topological Planning with Transformers for Vision-and-Language Navigationcited by 116
- 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 98
- 2022Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environmentscited by 86
- 2022Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigationcited by 86
- 2023DREAMWALKER: Mental Planning for Continuous Vision-Language Navigationcited by 85
- 2024NavCoT: Boosting LLM-Based Vision-and-Language Navigation via Learning Disentangled Reasoningcited by 79
- 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphscited by 73
- 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
- 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 65
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
- 2025Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-and-Language Navigationcited by 62
- 2024PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigatorscited by 58
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoningcited by 47
- 2025TrackVLA: Embodied Visual Tracking in the Wildcited by 47
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 44
- 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 41
- 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 39
- 2025OmniNav: A Unified Framework for Prospective Exploration and Visual-Language Navigationcited by 36
- 20221st Place Solutions for RxR-Habitat Vision-and-Language Navigation Competition (CVPR 2022)cited by 34
- 2025Fast-in-Slow: A Dual-System Foundation Model Unifying Fast Manipulation within Slow Reasoningcited by 31
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Scaffolding Foundation Models into Physical-World Agents Pushes the Frontier of Long-Horizon Navigationcited by 1
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigationcited by 1
- 2026Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Mapscited by 1
- 2026Visual Cue Guided Video Planning for Generalizable Robot Navigationcited by 0
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigationcited by 0
- 2026ABot-ER: Unified Embodied Reasoning through Agentic Data-Model Co-Evolutioncited by 0
- 2026ABot-ER: Unified Embodied Reasoning through Agentic Data-Model Co-Evolution13 Oct 2026
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigation30 Sep 2026
- 2026Visual Cue Guided Video Planning for Generalizable Robot Navigation15 Sep 2026
- 2026Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Maps3 Sep 2026
- 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation31 Aug 2026
- 2026Scaffolding Foundation Models into Physical-World Agents Pushes the Frontier of Long-Horizon Navigation31 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2025Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
- 2026VISOR: VIsual Spatial Object Reasoning for Language-driven Object Navigation
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussions
- 2025UNeMo: Collaborative Visual-Language Reasoning and Navigation via a Multimodal World Model
- 2024MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chains
- 2026GroundingVLN: Reasoning and Acting with Grounding for Vision-Language Navigation
- 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents