From Diagnosis to Improvement: Probing Spatio-Physical Reasoning in Vision Language Models
On the map: World models → World models for language agents
also in 2 more
Abstract (arXiv)
Spatio-physical reasoning, a foundation capability for understanding the real physics world, is a critical step towards building robust world models. While recent vision language models (VLMs) have shown remarkable progress in specialized domains like multimodal mathematics and pure spatial understanding, their capability for spatio-physical reasoning remains largely unexplored. This paper provides a comprehensive diagnostic analysis of mainstream VLMs, revealing that current models perform inadequately on this crucial task. Further detailed analysis shows that this underperformance is largely attributable to biases caused by human-like prior and a lack of deep reasoning. To address these challenges, we apply supervised fine-tuning followed by rule-based reinforcement learning to Qwen2.5-VL-7B, resulting in significant improvements in spatio-physical reasoning capabilities and surpassing leading proprietary models. Nevertheless, despite this success, the model's generalization to new physics scenarios remains limited -- underscoring the pressing need for new approaches in spatio-physical reasoning.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 9 of its 11 references that are in the map. First posted on arXiv 14 Aug 2025.
Builds on
9 of 11 references.
References · 9
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 159
- 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 73
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 59
- 2018ShapeStacks: Learning Vision-Based Physical Intuition for Generalised Object Stackingcited by 55
- 2025PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensionscited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Interpretable Physics Reasoning and Performance Taxonomy in Vision-Language Models
- 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
- 2026Spatial-Interactor: Learning Spatial Reasoning through Interaction with the Observable Physical World
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
- 2026SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models
- 2024Physics Context Builders: A Modular Framework for Physical Reasoning in Vision-Language Models
- 2024Sparkle: Mastering Basic Spatial Capabilities in Vision Language Models Elicits Generalization to Spatial Reasoning