mlsanityData to 13 Oct 2026

Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learning

arXiv 2510.27606 ↗First posted 31 Oct 2025cs.CV cs.AIcited by 39

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized tools, or constrained environments that limit scale. We introduce Spatial-SSRL, a self-supervised RL paradigm that derives verifiable signals directly from ordinary RGB or RGB-D images. Spatial-SSRL automatically formulates five pretext tasks that capture 2D and 3D spatial structure: shuffled patch reordering, flipped patch recognition, cropped patch inpainting, regional depth ordering, and relative 3D position prediction. These tasks provide ground-truth answers that are easy to verify and require no human or LVLM annotation. Training on our tasks substantially improves spatial reasoning while preserving general visual capabilities. On seven spatial understanding benchmarks in both image and video settings, Spatial-SSRL delivers average accuracy gains of 4.63% (3B) and 3.89% (7B) over the Qwen2.5-VL baselines. Our results show that simple, intrinsic supervision enables RLVR at scale and provides a practical route to stronger spatial intelligence in LVLMs.

Key facts. Cited by 39 papers in the map (data through 13 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 72 of its 76 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

72 of 76 references.

Closest ancestors · 23

Same direction, newest first

  1. 2025SSL4RL: Revisiting Self-supervised Learning as Intrinsic Reward for Visual-Language Reasoning18 Oct
  2. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  3. 2025Visual Jigsaw Post-Training Improves MLLMs29 Sep
  4. 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
  5. 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models23 Jun
  6. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  7. 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzles29 May
  8. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  9. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  10. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  11. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
  12. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?31 Mar
11 more
  1. 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
  2. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Models2 Jan
  3. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  4. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics25 Nov
  5. 2024End-to-End Navigation with Vision Language Models: Transforming Spatial Reasoning into Question-Answering8 Nov
  6. 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
  7. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models21 Jun
  8. 2024SpatialBot: Precise Spatial Understanding with Vision Language Models19 Jun
  9. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  10. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoning30 Oct
  11. 2023PaLM-E: An Embodied Multimodal Language Model6 Mar

Other references · 49

  1. 2017Attention Is All You Needcited by 60,106
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
  3. 2020Language Models are Few-Shot Learnerscited by 32,320
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,550
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,009
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
  7. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,492
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,364
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,247
  10. 2025Qwen2.5-VL Technical Reportcited by 5,499
  11. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,096
  12. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
37 more
  1. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,118
  2. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,595
  3. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,590
  4. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,461
  5. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,381
  6. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,020
  7. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 899
  8. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 732
  9. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 663
  10. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 577
  11. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 534
  12. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 506
  13. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 470
  14. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 446
  15. 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 291
  16. 2025Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMscited by 286
  17. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 239
  18. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 205
  19. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 205
  20. 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehensioncited by 144
  21. 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoningcited by 143
  22. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 135
  23. 2025Right Question is Already Half the Answer: Fully Unsupervised LLM Reasoning Incentivizationcited by 125
  24. 2023CapsFusion: Rethinking Image-Text Data at Scalecited by 90
  25. 2024On Designing Effective RL Reward at Training Time for LLM Reasoningcited by 87
  26. 20233D Concept Learning and Reasoning from Multi-View Imagescited by 60
  27. 2025How to Enable LLM with 3D Capacity? A Survey of Spatial Reasoning in LLMcited by 41
  28. 2025CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learningcited by 37
  29. 2025NuScenes-SpatialQA: A Spatial Understanding and Reasoning Benchmark for Vision-Language Models in Autonomous Drivingcited by 35
  30. 2017DeepPermNet: Visual Permutation Learningcited by 32
  31. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
  32. 2025Advancing Complex Video Object Segmentation via Progressive Concept Constructioncited by 25
  33. 2025BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoningcited by 20
  34. 2015Kinect Range Sensing: Structured-Light versus Time-of-Flight Kinectcited by 16
  35. 2025Vision-Language Model for Object Detection and Segmentation: A Review and Evaluationcited by 10
  36. 2025STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligencecited by 10
  37. 2025How Well Do Vision--Language Models Understand Cities? A Comparative Study on Spatial Reasoning from Street-View Imagescited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 1; 2026: 38.

39 papers.

Sort:

By area:

  1. 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoningcited by 12
  2. 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D Worldcited by 11
  3. 2026CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environmentscited by 8
  4. 2026Allocentric Perceiver: Disentangling Allocentric Reasoning from Egocentric Visual Priors via Frame Instantiationcited by 5
  5. 2026Visual Self-Refine: A Pixel-Guided Paradigm for Accurate Chart Parsingcited by 5
  6. 2025Video2Layout: Recall and Reconstruct Metric-Grounded Cognitive Map for Spatial Reasoningcited by 4
  7. 2026SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environmentscited by 4
  8. 2026EVE: Verifiable Self-Evolution of MLLMs via Executable Visual Transformationscited by 4
  9. 2026ReMoT: Reinforcement Learning with Motion Contrast Tripletscited by 3
  10. 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understandingcited by 3
  11. 2026Cambrian-P: Pose-Grounded Video Understandingcited by 3
  12. 2026Smooth Operator: Smooth Verifiable Reward Activates Spatial Reasoning Ability of Vision-Language Modelcited by 2
27 more
  1. 2026ETCHR: Editing To Clarify and Harness Reasoningcited by 2
  2. 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Modelscited by 1
  3. 2026Boosting Visual Instruction Tuning with Self-Supervised Guidancecited by 1
  4. 2026SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Modelscited by 1
  5. 2026OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mappingcited by 1
  6. 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMscited by 1
  7. 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understandingcited by 1
  8. 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1
  9. 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?cited by 1
  10. 2026JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzlescited by 1
  11. 2026GeoSense: Internalizing Geometric Necessity Perception for Multimodal Reasoningcited by 0
  12. 2026MAG-3D: Multi-Agent Grounded Reasoning for 3D Understandingcited by 0
  13. 2026GeoWeaver: Grounding Visual Tokens with Geometric Evidence before Scene Reasoningcited by 0
  14. 2026Rethinking VLM Representation for VLA Initializationcited by 0
  15. 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Gamescited by 0
  16. 2026Decodable Is Not Grounded: A Vision-Ablation Arbiter for VLM Spatial Reasoningcited by 0
  17. 2026MentalThink: Shaping Thoughts in Mental SVG Worldcited by 0
  18. 2026CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Modelscited by 0
  19. 2026Geo3R: Mitigating Spatial Reasoning Hallucination in Multimodal Large Language Modelscited by 0
  20. 2026SpatialQuery: Benchmarking Geometry-Grounded Multi-Instance Spatial Reasoning in Vision-Language Modelscited by 0
  21. 2026SCOUT: Unlocking Enhanced Spatial Reasoning via Structured Chain-of-Thought and Multi-Objective Process Rewardcited by 0
  22. 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoningcited by 0
  23. 2026SciDocBench: A Workflow-Centered Benchmark and Data Pipeline for Scientific Document Understandingcited by 0
  24. 2026SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problemcited by 0
  25. 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoningcited by 0
  26. 2026MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoningcited by 0
  27. 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memorycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
  2. 2026Reinforcing Dual-Path Reasoning in Spatial Vision Language Models
  3. 2025SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization
  4. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models
  5. 2026Spatial-OPSD: Self-Improving Spatial Reasoning via Label-Free Self-Distillation
  6. 2026The Art of Interrogation: Consistency Amplifies Factuality in Spatial Reasoning
  7. 2025Visual Spatial Tuning
  8. 2025STAR-R1: Spatial TrAnsformation Reasoning by Reinforcing Multimodal LLMs