Video Spatial Reasoning with Object-Centric 3D Rollout
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Recent advances in Multi-modal Large Language Models (MLLMs) have showcased remarkable capabilities in vision-language understanding. However, enabling robust video spatial reasoning-the ability to comprehend object locations, orientations, and inter-object relationships in dynamic 3D scenes-remains a key unsolved challenge. Existing approaches primarily rely on spatially grounded supervised fine-tuning or reinforcement learning, yet we observe that such models often exhibit query-locked reasoning, focusing narrowly on objects explicitly mentioned in the prompt while ignoring critical contextual cues. To address this limitation, we propose Object-Centric 3D Rollout (OCR), a novel strategy that introduces structured perturbations to the 3D geometry of selected objects during training. By degrading object-specific visual cues and projecting the altered geometry into 2D space, OCR compels the model to reason holistically across the entire scene. We further design a rollout-based training pipeline that jointly leverages vanilla and region-noisy videos to optimize spatial reasoning trajectories. Experiments demonstrate state-of-the-art performance: our 3B-parameter model achieves 47.5% accuracy on VSI-Bench, outperforming several 7B baselines. Ablations confirm OCR's superiority over prior rollout strategies (e.g., T-GRPO, NoisyRollout).
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 41 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
30 of 41 references.
Closest ancestors · 2
Same direction, newest first
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
Other references · 28
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
16 more
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMscited by 96
- 2025NoisyRollout: Reinforcing Visual Reasoning with Data Augmentationcited by 86
- 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 63
- 2021On Pursuit of Designing Multi-modal Transformer for Video Groundingcited by 54
- 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learningcited by 49
- 2024Continual LLaVA: Continual Instruction Tuning in Large Vision-Language Modelscited by 22
- 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videoscited by 22
- 2024PPLLaVA: Varied Video Sequence Understanding With Prompt Guidancecited by 20
- 2024RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adaptercited by 16
- 2025Video SimpleQA: Towards Factuality Evaluation in Large Video Language Modelscited by 11
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Think3D: Thinking with Space for Spatial Reasoningcited by 24
- 2026ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoningcited by 15
- 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understandingcited by 4
- 2026ZeroSplat: Generalized Referring Segmentation in 3D Gaussian Splattingcited by 3
- 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understandingcited by 2
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoningcited by 1
- 2026ZeroSplat: Generalized Referring Segmentation in 3D Gaussian Splatting21 Jul 2026
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning5 Jun 2026
- 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding3 Jun 2026
- 2026ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning27 Apr 2026
- 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understanding16 Mar 2026
- 2026Think3D: Thinking with Space for Spatial Reasoning19 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Make Geometry Matter for Spatial Reasoning
- 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models
- 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Data
- 2026Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided Reasoning
- 2026SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models
- 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning
- 2025Open-o3-Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence