mlsanityData to 14 Oct 2026

Video Spatial Reasoning with Object-Centric 3D Rollout

arXiv 2511.13190 ↗First posted 17 Nov 2025cs.CVcited by 6

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Recent advances in Multi-modal Large Language Models (MLLMs) have showcased remarkable capabilities in vision-language understanding. However, enabling robust video spatial reasoning-the ability to comprehend object locations, orientations, and inter-object relationships in dynamic 3D scenes-remains a key unsolved challenge. Existing approaches primarily rely on spatially grounded supervised fine-tuning or reinforcement learning, yet we observe that such models often exhibit query-locked reasoning, focusing narrowly on objects explicitly mentioned in the prompt while ignoring critical contextual cues. To address this limitation, we propose Object-Centric 3D Rollout (OCR), a novel strategy that introduces structured perturbations to the 3D geometry of selected objects during training. By degrading object-specific visual cues and projecting the altered geometry into 2D space, OCR compels the model to reason holistically across the entire scene. We further design a rollout-based training pipeline that jointly leverages vanilla and region-noisy videos to optimize spatial reasoning trajectories. Experiments demonstrate state-of-the-art performance: our 3B-parameter model achieves 47.5% accuracy on VSI-Bench, outperforming several 7B baselines. Ablations confirm OCR's superiority over prior rollout strategies (e.g., T-GRPO, NoisyRollout).

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 41 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

30 of 41 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  2. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr

Other references · 28

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  9. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  10. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  11. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  12. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
16 more
  1. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
  2. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  3. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  4. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
  5. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
  6. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
  7. 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMscited by 96
  8. 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentationcited by 86
  9. 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 63
  10. 2021On Pursuit of Designing Multi-modal Transformer for Video Groundingcited by 54
  11. 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learningcited by 49
  12. 2024Continual LLaVA: Continual Instruction Tuning in Large Vision-Language Modelscited by 22
  13. 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videoscited by 22
  14. 2024PPLLaVA: Varied Video Sequence Understanding With Prompt Guidancecited by 20
  15. 2024RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adaptercited by 16
  16. 2025Video SimpleQA: Towards Factuality Evaluation in Large Video Language Modelscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Make Geometry Matter for Spatial Reasoning
  2. 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models
  3. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Data
  4. 2026Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided Reasoning
  5. 2026SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video
  6. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models
  7. 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning
  8. 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence