mlsanityData to 7 Oct 2026

IntentionNav: A Benchmark for Intent-Driven Object Navigation from Implicit Human Instruction

arXiv 2605.23187 ↗First posted 22 May 2026cs.CV cs.ROcited by 1

Not on the map. Why?

Abstract (arXiv)

Existing object navigation benchmarks usually tell an embodied agent which object category to find, such as microwave or chair. Human-facing embodied AI is often asked something less direct: "I need something to warm this food" or "the room feels stuffy." The agent must infer the object that can satisfy the need, find a scene-grounded instance, and decide whether the goal has been reached. We study this setting as intent-driven object navigation and introduce IntentionNav, a diagnostic benchmark for active object search from implicit human instructions. Each episode provides a free-text intent, RGB-D observations, and pose, but withholds the target object name. IntentionNav contains 500 intents over 176 Isaac Sim scenes and 64 target categories. Each intent is rewritten in four controlled instruction styles and annotated with one of four intent modes, separating surface phrasing from semantic cue type under matched geometry. This paired design supports analysis of target inference, language robustness, neighborhood reachability, and terminal success rather than only aggregate success. We evaluated three VLMs using a fixed active-navigation agent. Models identify the intended target in 48.3 percent of episodes and enter its 2 m neighborhood in 68.7 percent, but terminate successfully in only 24.9 percent and achieve grounded 1 m success in 5.5 percent. Success is highest for event-script intents (28.7 percent) and lower for physical-state and affordance intents (19.2 percent and 18.5 percent), showing that indirect human intent remains a bottleneck for target selection, visual verification, and terminal localization in active embodied search.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 44 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

44 of 44 references.

References · 44

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  2. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  3. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  4. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  5. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
  6. 2018On Evaluation of Embodied Navigation Agentscited by 526
  7. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  8. 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
  9. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  10. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
  11. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 274
  12. 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
32 more
  1. 2023VLFM: Vision-Language Frontier Maps for Zero-Shot Semantic Navigationcited by 201
  2. 2022CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigationcited by 194
  3. 2022Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigationcited by 187
  4. 2022ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddingscited by 177
  5. 2024InstructNav: Zero-shot System for Generic Instruction Navigation in Unexplored Environmentcited by 150
  6. 2022PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learningcited by 149
  7. 2023Towards Learning a Generalist Model for Embodied Navigationcited by 135
  8. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
  9. 2021SOON: Scenario Oriented Object Navigation with Graph-based Explorationcited by 118
  10. 2022Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scalecited by 116
  11. 2023Scaling Data Generation in Vision-and-Language Navigationcited by 115
  12. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 106
  13. 2024NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Modelscited by 96
  14. 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
  15. 2024MapGPT: Map-Guided Prompting with Adaptive Path Planning for Vision-and-Language Navigationcited by 85
  16. 2024HM3D-OVON: A Dataset and Benchmark for Open-Vocabulary Object Goal Navigationcited by 71
  17. 2024OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Modelscited by 66
  18. 2025EmbodiedEval: Evaluate Multimodal LLMs as Embodied Agentscited by 55
  19. 2021Diagnosing Vision-and-Language Navigation: What Really Matterscited by 36
  20. 2023Find What You Want: Learning Demand-conditioned Object Attribute Space for Demand-driven Navigationcited by 18
  21. 2025VLNVerse: A Benchmark for Vision-Language Navigation with Versatile, Embodied, Realistic Simulation and Evaluationcited by 17
  22. 2021Adversarial Reinforced Instruction Attacker for Robust Vision-Language Navigationcited by 15
  23. 2024Personalized Instance-based Navigation Toward User-Specific Objects in Realistic Environmentscited by 11
  24. 2023Behavioral Analysis of Vision-and-Language Navigation Agentscited by 8
  25. 2024Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with Human Intentionscited by 8
  26. 2025CogDDN: A Cognitive Demand-Driven Navigation with Decision Optimization and Dual-Process Thinkingcited by 7
  27. 2026CapNav: Benchmarking Vision Language Models on Capability-conditioned Indoor Navigationcited by 6
  28. 2022ULN: Towards Underspecified Vision-and-Language Navigationcited by 5
  29. 2024MO-DDN: A Coarse-to-Fine Attribute-based Exploration Agent for Multi-object Demand-driven Navigationcited by 4
  30. 2025PersONAL: Towards a Comprehensive Benchmark for Personalized Embodied Agentscited by 4
  31. 2025Vision-and-Language Navigation with Analogical Textual Descriptions in LLMscited by 3
  32. 2026User-Centric Object Navigation: A Benchmark with Integrated User Habits for Personalized Embodied Object Searchcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026IntentNav: Learning Spatial-Visual Object Navigation from Human Demonstrations ↗
  2. 2025NavA3: Understanding Any Instruction, Navigating Anywhere, Finding Anything
  3. 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness
  4. 2026LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation
  5. 2024Embodied Instruction Following in Unknown Environments
  6. 2026RoboFollow: Unveiling the Instruction Following Mirage in Embodied Agents
  7. 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigation
  8. 2026Finder: Agentic Closed-Loop Object Finding for Embodied Grounding