mlsanityData to 7 Oct 2026

AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Models

arXiv 2606.08952 ↗First posted 8 Jun 2026cs.AIcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Multimodal Foundation Models (MFMs) have made substantial progress, yet remain fragile in spatial reasoning over the physical world. A key bottleneck lies in their inability to transform local egocentric observations into a global allocentric spatial representation. To address this, we propose AlloSpatial, an agentic framework for allocentric spatial cognition in foundation models. AlloSpatial introduces World2Mind, a plug-and-play cognitive mapping sandbox that converts egocentric observations into structured allocentric priors, including Allocentric-Spatial Trees and route maps that support querying object topology, geometric relations, passability, and trajectories. To utilize these priors reliably under noisy reconstruction and ambiguous visual evidence, AlloSpatial introduces a Spatial Reasoning Harness for tool-use judgment, modality-decoupled cue collection, and geometry-semantic arbitration. We further internalize this process in Qwen3-VL through cold-start reinforcement learning with a harness-gated trajectory-level reward. Experiments on VSI-Bench and MindCube show that AlloSpatial improves proprietary models by 5%-18% in a training-free setting, while ASTs alone support strong spatial reasoning even when visual inputs are removed. The trained AlloSpatial agents further outperform larger general-purpose models and competitive spatial baselines, suggesting that structured allocentric representations, active tool use, and verifiable reasoning offer a promising route toward spatially capable foundation models.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 48 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

27 of 48 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026pySpatial: Generating 3D Visual Programs for Zero-Shot Spatial Reasoning1 Mar
  2. 2026Think3D: Thinking with Space for Spatial Reasoning19 Jan
  3. 2025From Indoor to Open World: Revealing the Spatial Reasoning Gap in MLLMs22 Dec
  4. 2025N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Models18 Dec
  5. 2025SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery8 Dec
  6. 2025SpaceTools: Tool-Augmented Spatial Reasoning via Double Interactive RL3 Dec
  7. 2025SURPRISE3D: A Dataset for Spatial Understanding and Reasoning in Complex 3D Scenes10 Jul
  8. 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models23 Jun
  9. 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning28 Apr
  10. 2025The Point, the Vision and the Text: Does Point Cloud Boost Spatial Reasoning of Large Language Models? A Bias-Controlled Study6 Apr
  11. 2025Beyond Semantics: Rediscovering Spatial Awareness in Vision-Language Models21 Mar

Other references · 16

  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  3. 2025OpenAI GPT-5 System Cardcited by 910
  4. 2025SAM 3: Segment Anything with Conceptscited by 835
  5. 2025Group Sequence Policy Optimizationcited by 788
  6. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  7. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  8. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
  9. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
  10. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  11. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  12. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
4 more
  1. 2024Does Spatial Cognition Emerge in Frontier Models?cited by 65
  2. 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 34
  3. 2025SD-VLM: Spatial Measuring and Understanding with Depth-Encoded Vision-Language Modelscited by 24
  4. 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversationscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026World2Mind: Cognition Toolkit for Allocentric Spatial Reasoning in Foundation Models
  2. 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective
  3. 2026Allocentric Perceiver: Disentangling Allocentric Reasoning from Egocentric Visual Priors via Frame Instantiation
  4. 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models
  5. 2025From reactive to cognitive: brain-inspired spatial intelligence for embodied agents
  6. 2026MindTopo: Can Foundation Models Reason in Topological Space?
  7. 2026Ego to World: Collaborative Spatial Reasoning in Embodied Systems via Reinforcement Learning
  8. 2026SpatialWorld: Benchmarking Interactive Spatial Reasoning of Multimodal Agents in Real-World Tasks