mlsanityData to 14 Oct 2026

Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning

arXiv 2604.06725 ↗First posted 8 Apr 2026cs.CVcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Although Multimodal Large Language Models have achieved remarkable progress, they still struggle with complex 3D spatial reasoning due to the reliance on 2D visual priors. Existing approaches typically mitigate this limitation either through computationally expensive post-training procedures on limited 3D datasets or through rigid tool-calling mechanisms that lack explicit geometric understanding and viewpoint flexibility. To address these challenges, we propose a textittraining-free framework that introduces a Visual Chain-of-Thought mechanism grounded in explicit 3D reconstruction. The proposed pipeline first reconstructs a high-fidelity 3D mesh from a single image using MLLM-guided keyword extraction and mask generation at multiple granularities. Subsequently, the framework leverages an external knowledge base to iteratively compute optimal camera extrinsic parameters and synthesize novel views, thereby emulating human perspective-taking. Extensive experiments demonstrate that the proposed approach significantly enhances spatial comprehension. Specifically, the framework outperforms specialized spatial models and general-purpose MLLMs, including textitGPT-5.2 and textitGemini-2.5-Flash, on major benchmarks such as 3DSRBench and Rel3D.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 55 of its 65 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

55 of 65 references.

Closest ancestors · 21

Same direction, newest first

  1. 2025N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Models18 Dec
  2. 2025Scaling Spatial Reasoning in MLLMs through Programmatic Data Synthesis18 Dec
  3. 2025CVP: Central-Peripheral Vision-Inspired Multimodal Model for Spatial Reasoning9 Dec
  4. 2025SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery8 Dec
  5. 2025Geometrically-Constrained Agent for Spatial Reasoning27 Nov
  6. 2025G2VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning26 Nov
  7. 2025Beyond Flatlands: Unlocking Spatial Intelligence by Decoupling 3D Reasoning from Numerical Regression14 Nov
  8. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  9. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
  10. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  11. 2025Seeing is Not Reasoning: MVPBench for Graph-based Evaluation of Multi-path Visual Physical CoT30 May
  12. 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Models1 May
9 more
  1. 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation24 Apr
  2. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
  3. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  4. 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
  5. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
  6. 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasoners4 Jun
  7. 2024Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning23 May
  8. 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors18 Mar
  9. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 34

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2025Qwen3-VL Technical Reportcited by 2,793
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  10. 2025SAM 3: Segment Anything with Conceptscited by 906
  11. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  12. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
22 more
  1. 2023Active Retrieval Augmented Generationcited by 516
  2. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
  3. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
  4. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
  5. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 268
  6. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  7. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
  8. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
  9. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  10. 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 176
  11. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  12. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
  13. 2019Point-Based Multi-View Stereo Networkcited by 147
  14. 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 128
  15. 2020Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinementcited by 105
  16. 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 77
  17. 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Modelscited by 65
  18. 2025VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuningcited by 63
  19. 2021MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutionscited by 43
  20. 2024From Multimodal LLMs to Generalist Embodied Agents: Methods and Lessonscited by 42
  21. 2020Rel3D: A Minimally Contrastive Benchmark for Grounding Spatial Relations in 3Dcited by 30
  22. 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Imagescited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering
  2. 2026Boosting MLLM Spatial Reasoning with Geometrically Referenced 3D Scene Representations
  3. 2026SpatialSV: Internalizing Interpretable 3D Spatial Awareness in MLLMs via Task-Oriented Visual Supervision
  4. 2025Actial: Activate Spatial Reasoning Ability of Multimodal Large Language Models
  5. 2025S2-MLLM: Boosting Spatial Reasoning Capability of MLLMs for 3D Visual Grounding with Structural Guidance
  6. 2026GraFT: A Training-Free Framework for Spatial Reasoning in Multimodal Large Language Models via 3D Scene Graphs
  7. 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding
  8. 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding