mlsanityData to 7 Oct 2026

Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation

arXiv 2609.37055 ↗First posted 29 Sep 2026cs.CVcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

also in 2 more
Abstract (arXiv)

Vision-language models (VLMs) increasingly operate in embodied and spatially grounded settings, where accurate understanding of depth, viewpoint, and three-dimensional relations is essential. However, improving spatial reasoning typically relies on ground-truth answers, answer-derived rewards, or other forms of task-specific supervision. We introduce Spatial-OPSD, a label-free self-improvement framework that instead exploits spatial structure naturally available from perception and reconstruction tools. During training, a privileged teacher receives automatically obtainable spatial priors, such as depth, reconstructed 3D relations, and camera geometry, while the student observes only the original visual-language input. On trajectories sampled by the student itself, the teacher provides dense token-level supervision, allowing the student to internalize spatial knowledge without ground-truth answer labels or privileged information at inference time. To extend this supervision beyond a single round, we adopt a round-wise recursive training scheme: the teacher remains frozen within each round to provide a stable learning target, and the improved student initializes both teacher and student in the next round, where privileged spatial priors re-establish an informative teacher--student asymmetry. This enables repeated self-improvement while avoiding a rapidly moving teacher during optimization. Across four VLM families, a single round of Spatial-OPSD consistently improves the five-benchmark average, while three rounds further push a strong spatially specialized model to the open-source frontier, achieving the highest average among the open models and the best results on three of five spatial reasoning benchmarks. Our code is available at https://github.com/vermouth599/Spatial-OPSD.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 35 of its 37 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

35 of 37 references.

Closest ancestors · 9

Same direction, newest first

  1. 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding7 May
  2. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  3. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  4. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  5. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  6. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  7. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
  8. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  9. 2022Visual Spatial Reasoning30 Apr

Other references · 26

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  5. 2025Gemma 3 Technical Reportcited by 1,686
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  7. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  8. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  9. 2024Depth Anything V2cited by 1,385
  10. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  12. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
14 more
  1. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  2. 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
  3. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  4. 2026Reinforcement Learning via Self-Distillationcited by 285
  5. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  6. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 128
  7. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
  8. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
  9. 2025Visual Spatial Tuningcited by 85
  10. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
  11. 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillationcited by 32
  12. 2025SIFThinker: Spatially-Aware Image Focus for Visual Reasoningcited by 25
  13. 2026Visual-Advantage On-Policy Distillation for Vision-Language Modelscited by 22
  14. 2026Self-Boosting Vision-Language Models with Noisy Student On-Policy Self-Distillationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Models
  2. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models
  3. 2026Spatial-Interactor: Learning Spatial Reasoning through Interaction with the Observable Physical World
  4. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models
  5. 2026Multi-View Relational Distillation for Spatial Reasoning with Vision-Language Models
  6. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
  7. 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
  8. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models