SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Despite advancements in Multi-modal Large Language Models (MLLMs) for scene understanding, their performance on complex spatial reasoning tasks requiring mental simulation remains significantly limited. Current methods often rely on passive observation of spatial data, failing to internalize an active mental imagery process. To bridge this gap, we propose SpatialDreamer, a reinforcement learning framework that enables spatial reasoning through a closedloop process of active exploration, visual imagination via a world model, and evidence-grounded reasoning. To address the lack of fine-grained reward supervision in longhorizontal reasoning tasks, we propose Geometric Policy Optimization (GeoPO), which introduces tree-structured sampling and step-level reward estimation with geometric consistency constraints. Extensive experiments demonstrate that SpatialDreamer delivers highly competitive results across multiple challenging benchmarks, signifying a critical advancement in human-like active spatial mental simulation for MLLMs.
Key facts. Cited by 10 papers in the map (data through 13 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 54 of its 85 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
54 of 85 references.
Closest ancestors · 12
Same direction, newest first
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
- 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes8 Sep
- 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning16 Jul
- 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding2 Jun
- 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May
- 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation24 Apr
- 2025How to Enable LLM with 3D Capacity? A Survey of Spatial Reasoning in LLM8 Apr
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
- 2025Open3D-VQA: A Benchmark for Comprehensive Spatial Reasoning with Multimodal Large Language Model in Open Space14 Mar
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning18 Mar
Other references · 42
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,247
- 2025Qwen2.5-VL Technical Reportcited by 5,499
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,197
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,729
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,692
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,003
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,954
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,798
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,586
- 2024OpenAI o1 System Cardcited by 1,233
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,041
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 859
30 more
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 726
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 567
- 2024Long Context Transfer from Language to Visioncited by 507
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 466
- 2025VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Taskscited by 283
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 243
- 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 214
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 209
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 180
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 157
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 148
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 129
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 122
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 113
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
- 2024Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuningcited by 85
- 2025TreeRL: LLM Reinforcement Learning with On-Policy Tree Searchcited by 76
- 2025TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modelingcited by 60
- 2024Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguitiescited by 58
- 2025A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Futurecited by 53
- 2025TreeRPO: Tree Relative Policy Optimizationcited by 46
- 2024SPHERE: Unveiling Spatial Blind Spots in Vision-Language Models Through Hierarchical Evaluationcited by 31
- 2025Holistic Evaluation of Multimodal LLMs on Spatial Intelligencecited by 28
- 2025SD-VLM: Spatial Measuring and Understanding with Depth-Encoded Vision-Language Modelscited by 24
- 2025Defining and Evaluating Visual Language Models' Basic Spatial Abilities: A Perspective from Psychometricscited by 23
- 2025Robix: A Unified Model for Robot Interaction, Reasoning and Planningcited by 23
- 2025VLRMBench: A Comprehensive and Challenging Benchmark for Vision-Language Reward Modelscited by 19
- 2025ETS: Efficient Tree Search for Inference-Time Scalingcited by 16
- 2025VLM-3D:End-to-End Vision-Language Models for Open-World 3D Perceptioncited by 3
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoningcited by 13
- 2026World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoningcited by 3
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Modelscited by 2
- 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMscited by 2
- 2026Predicting Camera Pose from Perspective Descriptions for Spatial Reasoningcited by 1
- 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoningcited by 1
- 2026AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Modelscited by 1
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoningcited by 1
- 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Modelscited by 0
- 2026SciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understandingcited by 0
- 2026SciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understanding4 Sep 2026
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning10 Jun 2026
- 2026AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Models8 Jun 2026
- 2026STORM: Internalized Modeling for Spatial-Temporal Reasoning in Video-Language Models25 May 2026
- 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMs25 May 2026
- 2026World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning29 Apr 2026
- 2026WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models9 Apr 2026
- 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning8 Apr 2026
- 2026When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoning9 Feb 2026
- 2026Predicting Camera Pose from Perspective Descriptions for Spatial Reasoning5 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
- 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models
- 2025Probing the effectiveness of World Models for Spatial Reasoning through Test-time Scaling
- 2025Enhancing Spatial Reasoning in Vision-Language Models via Chain-of-Thought Prompting and Reinforcement Learning
- 2026The Art of Interrogation: Consistency Amplifies Factuality in Spatial Reasoning
- 2026Reinforcing Dual-Path Reasoning in Spatial Vision Language Models