mlsanityData to 7 Oct 2026

Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System

arXiv 2606.18112 ↗First posted 16 Jun 2026cs.RO cs.CVcited by 10

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Agentic navigation systems require a base navigation model whose observation strategy can be externally reconfigured at inference time, because instruction following, object search, target tracking, and autonomous driving share the same perception-planning backbone yet demand fundamentally different strategies for consuming the visual stream. We present Qwen-RobotNav, a scalable navigation model built on Qwen-RobotNav that addresses it through a parameterised interface with two complementary dimensions: multiple task modes that select the navigation behaviour, and controllable observation parameters (e.g., token budget, per-camera weights) that govern how visual history is encoded. With training-time randomization over all parameters, Qwen-RobotNav is robust to any inference-time configuration requiring zero architectural modification to the Qwen-RobotNav backbone. We train Qwen-RobotNav on 15.6M samples; co-training with vision-language data prevents the collapse into reactive action-sequence mappers observed in trajectory-only training. The parameterised interface also makes Qwen-RobotNav a natural building block for agentic systems: for long-horizon scenarios, an upper-level planner decomposes goals into sub-tasks and dynamically switches Qwen-RobotNav's task mode and context strategy mid-episode, composing complex behaviours from repeated calls to the same model. Extensive experiments show that Qwen-RobotNav sets new state-of-the-art results across major navigation benchmarks. The model exhibits favourable scaling from 2B to 8B parameters, with joint multi-task training developing a shared spatial-planning substrate that transfers across task families, and demonstrates strong zero-shot generalisation to real-world robots across diverse environments.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 82 of its 93 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

82 of 93 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025VLN-MME: Diagnosing MLLMs as Language-guided Visual Navigation agents31 Dec

Other references · 81

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  5. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  6. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  7. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  8. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  9. 2022Planning-oriented Autonomous Drivingcited by 1,068
  10. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  11. 2025Qwen-Image Technical Reportcited by 973
  12. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
38 more
  1. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  2. 2020Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environmentscited by 429
  3. 2020Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Groundingcited by 401
  4. 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 352
  5. 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 338
  6. 2017Embodied Question Answeringcited by 335
  7. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
  8. 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 314
  9. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  10. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 274
  11. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
  12. 2019Vision-and-Dialog Navigationcited by 246
  13. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
  14. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
  15. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
  16. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
  17. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  18. 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 165
  19. 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 161
  20. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
  21. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
  22. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 145
  23. 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 118
  24. 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
  25. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
  26. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 106
  27. 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 96
  28. 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformerscited by 96
  29. 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 93
  30. 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
  31. 2024Explore until Confident: Efficient Exploration for Embodied Question Answeringcited by 74
  32. 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 73
  33. 2024DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMscited by 72
  34. 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
  35. 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 66
  36. 2025Embodied Navigation Foundation Modelcited by 65
  37. 2024Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigationcited by 63
  38. 2025UniGoal: Towards Universal Zero-shot Goal-oriented Navigationcited by 56

50 most cited of 81 All 81 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Method
  2. 2026AgentVLN: Towards Agentic Vision-and-Language Navigation
  3. 2025General-Purpose Robotic Navigation via LVLM-Orchestrated Perception, Reasoning, and Acting
  4. 2026HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigation
  5. 2026Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation
  6. 2026ASENA: Self-evolving Agents for Embodied Navigation
  7. 2025A Navigation Framework Utilizing Vision-Language Models
  8. 2026AgenticNav: Zero-Shot Vision-and-Language Navigation as a Tool-Calling Harness