Mine Odyssey: Benchmarking Spatial Agentic Intelligence in the Wild
Not on the map. Why?
Abstract (arXiv)
Advances in foundation models are driving efforts to introduce agents to assist people in the physical world. Such agents require agentic spatial intelligence: exploring unfamiliar environments, updating spatial understanding through interaction, and adapting actions based on feedback to sustain progress toward a sequence of goals. Existing benchmarks cover only a limited range of spatial layouts, scales, and traversal requirements. We introduce Mine Odyssey, a benchmark for evaluating agentic spatial intelligence using Minecraft reconstructions of real-world locations. It comprises 180 tasks covering 30 such locations across 20 countries and regions on five continents, including 20 outdoor and 10 indoor settings. These settings span diverse spatial scales, layouts, terrains, and connectivity patterns, from Midtown Manhattan and rural Entrup to Santa Luc'ia Hill and Buckingham Palace. We select meaningful waypoints, such as landmarks, buildings, and rooms, and manually verify their accessibility. Each task provides a natural-language instruction specifying which waypoints to visit and in what order. Completing these tasks requires agents to find accessible routes and entrances, open doors, and move between levels using stairs and ladders, while monitoring their progress and recovering from navigation errors. Across eight evaluated state-of-the-art models, GPT-6 Astra achieves the highest success rate of 85.6%. However, the second-best model, Claude Opus 5.5, completes 73.9% of tasks, while the strongest evaluated open-weight model, DeepSeek-V4.1-Flash, reaches 23.9%, highlighting substantial room for improvement in the agentic spatial intelligence of current models. Comprehensive analyses and ablation studies on Mine Odyssey reveal current models' limitations and provide insights for advancing agentic spatial intelligence.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 60 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
16 of 60 references.
References · 16
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 240
- 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraftcited by 93
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 77
- 2019The StreetLearn Environment and Datasetcited by 42
- 2025VideoGameBench: Can Vision-Language Models complete popular video games?cited by 29
- 2026OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Taskscited by 29
- 2026GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agentscited by 22
- 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 19
- 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Taskscited by 6
- 2025Blueprint-Bench: Comparing spatial intelligence of LLMs, agents and image modelscited by 5
- 2026MineExplorer: Evaluating Open-World Exploration of MLLM Agents in Minecraftcited by 3
- 2026SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoningcited by 3
4 more
- 2026Communicating about Space: Language-Mediated Spatial Integration Across Partial Viewscited by 2
- 2026SAP-Nav: Spatial Semantic Representation Meets Active Perception for Hierarchical Open-Vocabulary Object Navigationcited by 2
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenescited by 1
- 2026UrbanGround: From Local Perception to Spatial Agency in a Real-Scale Citycited by 1
Built on by
Not cited yet.