mlsanityData to 14 Oct 2026

SpatialSV: Internalizing Interpretable 3D Spatial Awareness in MLLMs via Task-Oriented Visual Supervision

arXiv 2606.19915 ↗First posted 18 Jun 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Unlocking the spatial intelligence of multimodal large language model (MLLMs) is crucial for understanding and interacting with the 3D world. Prevailing approaches typically inject spatial priors via external tools, which impose significant inference overhead, or rely on latent feature distillation, which remains uninterpretable and lacks fine-grained geometric constraints. To address these issues, we propose SpatialSV, a framework designed to internalize robust 3D spatial awareness within MLLMs while simultaneously offering inherent interpretability. Deviating from passive feature imitation, SpatialSV employs task-oriented visual supervision, compelling the model to actively lift its 2D visual features into explicit 3D representations, including depth maps, camera poses, and point clouds. Crucially, this 2D-to-3D lifting process provides a transparent window into the model's representations: the resulting 3D reconstructions serve as an intuitive proxy for visualizing and diagnosing the quality of the model's intrinsic spatial knowledge. Extensive experiments across multiple models and benchmarks demonstrate the effectiveness of SpatialSV in enhancing and interpreting MLLMs' spatial intelligence. Furthermore, the framework exhibits strong generalization in semi-supervised settings, validating its potential to leverage unlabeled visual data for scalable, interpretable spatial representation learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 50 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

39 of 50 references.

Closest ancestors · 18

Same direction, newest first

  1. 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Models14 Nov
  2. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  3. 2025See&Trek: Training-Free Spatial Prompting for Multimodal Large Language Model19 Sep
  4. 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes8 Sep
  5. 2025Spatial 3D-LLM: Exploring Spatial Awareness in 3D Vision-Language Models22 Jul
  6. 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding2 Jun
  7. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  8. 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May
  9. 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awareness2 Apr
  10. 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
  11. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  12. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understanding30 Nov
6 more
  1. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics25 Nov
  2. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awareness26 Sep
  3. 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasoners4 Jun
  4. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  5. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  6. 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning30 Nov

Other references · 21

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  4. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  5. 2021Vision Transformers for Dense Predictioncited by 1,803
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  7. 2018World Modelscited by 1,513
  8. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  9. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 333
  10. 2024Probing the 3D Awareness of Visual Foundation Modelscited by 177
  11. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
  12. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 134
9 more
  1. 20243D-Mem: 3D Scene Memory for Embodied Exploration and Reasoningcited by 75
  2. 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoningcited by 50
  3. 2024RoboTron-Drive: All-in-One Large Multimodal Model for Autonomous Drivingcited by 30
  4. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
  5. 2024Feat2GS: Probing Visual Foundation Models with Gaussian Splattingcited by 27
  6. 20253DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Modelcited by 25
  7. 2025CVBench: Benchmarking Cross-Video Synergies for Complex Multimodal Reasoningcited by 16
  8. 2025Where, What, Why: Towards Explainable Driver Attention Predictioncited by 10
  9. 2025Logic Unseen: Revealing the Logical Blindspots of Vision-Language Modelscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence
  2. 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models
  3. 2026What Makes a Good Visual Representation for Spatial Understanding in MLLMs?
  4. 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning
  5. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D
  6. 2026Boosting MLLM Spatial Reasoning with Geometrically Referenced 3D Scene Representations
  7. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMs
  8. 2026GAP-MLLM: Geometry-Aligned Pre-training for Activating 3D Spatial Perception in Multimodal Large Language Models