RieMind: Geometry-Grounded Spatial Agent for Scene Understanding
On the map: LLM reasoning → Spatial and embodied reasoning
also in 2 more
Abstract (arXiv)
Visual Language Models (VLMs) have increasingly become the main paradigm for understanding indoor scenes, but they still struggle with metric and spatial reasoning. Current approaches rely on end-to-end video understanding or large-scale spatial question answering fine-tuning, inherently coupling perception and reasoning. In this paper, we investigate whether decoupling perception and reasoning leads to improved spatial reasoning. We propose an agentic framework for static 3D indoor scene reasoning that grounds an LLM in an explicit 3D scene graph (3DSG). Rather than ingesting videos directly, each scene is represented as a persistent 3DSG constructed by a dedicated perception module. To isolate reasoning performance, we instantiate the 3DSG from ground-truth annotations. The agent interacts with the scene exclusively through structured geometric tools that expose fundamental properties such as object dimensions, distances, poses, and spatial relationships. The results we obtain on the static split of VSI-Bench provide an upper bound under ideal perceptual conditions on the spatial reasoning performance, and we find that it is significantly higher than previous works, by up to 16%, without task specific fine-tuning. Compared to base VLMs, our agentic variant achieves significantly better performance, with average improvements between 33% to 50%. These findings indicate that explicit geometric grounding substantially improves spatial reasoning performance, and suggest that structured representations offer a compelling alternative to purely end-to-end visual reasoning.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 28 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
24 of 28 references.
Closest ancestors · 6
Same direction, newest first
- 2025Video Spatial Reasoning with Object-Centric 3D Rollout17 Nov
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
- 2025TIGeR: Tool-Integrated Geometric Reasoning in Vision-Language Models for Robotics8 Oct
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
Other references · 18
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 178
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2024VideoHallucer: Evaluating Intrinsic and Extrinsic Hallucinations in Large Video-Language Modelscited by 90
- 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 73
6 more
- 2024Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulationcited by 70
- 2024GraphEQA: Using 3D Semantic Scene Graphs for Real-time Embodied Question Answeringcited by 37
- 2024CogNav: Cognitive Process Modeling for Object Goal Navigation with LLMscited by 33
- 2024Search3D: Hierarchical Open-Vocabulary 3D Segmentationcited by 31
- 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligencecited by 24
- 2025EGOILLUSION: Benchmarking Hallucinations in Egocentric Video Understandingcited by 10
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoningcited by 17
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoningcited by 1
- 2026R3D: Quantitative 3D Spatial Reasoning for Egocentric Wearablescited by 0
- 2026From Reasoning Failures to Composable Video Spatial Intelligencecited by 0
- 2026From Reasoning Failures to Composable Video Spatial Intelligence1 Oct 2026
- 2026R3D: Quantitative 3D Spatial Reasoning for Egocentric Wearables3 Jul 2026
- 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning11 Jun 2026
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning5 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025Pursuing Minimal Sufficiency in Spatial Reasoning
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning
- 2025Visual Agentic AI for Spatial Reasoning with a Dynamic API
- 2026MAG-3D: Multi-Agent Grounded Reasoning for 3D Understanding
- 2026Flame3D: Zero-shot Compositional Reasoning of 3D Scenes with Agentic Language Models
- 2025SpatialReasoner: Active Perception for Large-Scale 3D Scene Understanding
- 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Data
- 2025SURPRISE3D: A Dataset for Spatial Understanding and Reasoning in Complex 3D Scenes