mlsanityData to 14 Oct 2026

S2-MLLM: Boosting Spatial Reasoning Capability of MLLMs for 3D Visual Grounding with Structural Guidance

arXiv 2512.01223 ↗First posted 1 Dec 2025cs.CV cs.AIcited by 5

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

3D Visual Grounding (3DVG) focuses on locating objects in 3D scenes based on natural language descriptions, serving as a fundamental task for embodied AI and robotics. Recent advances in Multi-modal Large Language Models (MLLMs) have motivated research into extending them to 3DVG. However, MLLMs primarily process 2D visual inputs and struggle with understanding 3D spatial structure of scenes solely from these limited perspectives. Existing methods mainly utilize viewpoint-dependent rendering of reconstructed point clouds to provide explicit structural guidance for MLLMs in 3DVG tasks, leading to inefficiency and limited spatial reasoning. To address this issue, we propose S2-MLLM, an efficient framework that enhances spatial reasoning in MLLMs through implicit spatial reasoning. We introduce a spatial guidance strategy that leverages the structure awareness of feed-forward 3D reconstruction. By acquiring 3D structural understanding during training, our model can implicitly reason about 3D scenes without relying on inefficient point cloud reconstruction. Moreover, we propose a structure-enhanced module (SE), which first employs intra-view and inter-view attention mechanisms to capture dependencies within views and correspondences across views. The module further integrates multi-level position encoding to associate visual representations with spatial positions and viewpoint information, enabling more accurate structural understanding. Extensive experiments demonstrate that S2-MLLM unifies superior performance, generalization, and efficiency, achieving significant performance over existing methods across the ScanRefer, Nr3D, and Sr3D datasets. Code will be available upon acceptance.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 34 of its 100 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

34 of 100 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Actial: Activate Spatial Reasoning Ability of Multimodal Large Language Models3 Nov
  2. 2025SPAZER: Spatial-Semantic Progressive Reasoning Agent for Zero-shot 3D Visual Grounding27 Jun
  3. 2025SORT3D: Spatial Object-centric Reasoning Toolbox for Zero-Shot 3D Grounding Using Large Language Models25 Apr
  4. 2025How to Enable LLM with 3D Capacity? A Survey of Spatial Reasoning in LLM8 Apr
  5. 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning18 Mar

Other references · 29

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  5. 2020Neural Sparse Voxel Fieldscited by 959
  6. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  7. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  8. 2023An Embodied Generalist Agent in 3D Worldcited by 365
  9. 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
  10. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  11. 2023Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Followingcited by 194
  12. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
17 more
  1. 2023Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenescited by 129
  2. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
  3. 2024Grounded 3D-LLM with Referent Tokenscited by 115
  4. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
  5. 2018Layer-structured 3D Scene Inference via View Synthesiscited by 82
  6. 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 63
  7. 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
  8. 20243D Gaussian Splatting in Robotics: A Surveycited by 45
  9. 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 43
  10. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 27
  11. 20233DRP-Net: 3D Relative Position-aware Network for 3D Visual Groundingcited by 25
  12. 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 25
  13. 2025TSP3D: Text-guided Sparse Voxel Pruning for Efficient 3D Visual Groundingcited by 17
  14. 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMscited by 16
  15. 2025Unifying 2D and 3D Vision-Language Understandingcited by 15
  16. 2024SceneGPT: A Language Model for 3D Scene Understandingcited by 12
  17. 2025Faithful-First Reasoning, Planning, and Acting for Multimodal LLMscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning
  2. 2025Struct2D: A Perception-Guided Framework for Spatial Reasoning in MLLMs
  3. 2026GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Grounding
  4. 2025A Neural Representation Framework with LLM-Driven Spatial Reasoning for Open-Vocabulary 3D Visual Grounding
  5. 2026Boosting MLLM Spatial Reasoning with Geometrically Referenced 3D Scene Representations
  6. 2025ReasonGrounder: LVLM-Guided Hierarchical Feature Splatting for Open-Vocabulary 3D Visual Grounding and Reasoning
  7. 2026SSR: Pushing the Limit of Spatial Intelligence with Structured Scene Reasoning
  8. 2026Reasoning Matters for 3D Visual Grounding