PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models
On the map: World models → Latent predictive world models
also in 2 more
Abstract (arXiv)
Modern foundational Multimodal Large Language Models (MLLMs) and video world models have advanced significantly in mathematical, common-sense, and visual reasoning, but their grasp of the underlying physics remains underexplored. Existing benchmarks attempting to measure this matter rely on synthetic, Visual Question Answer templates or focus on perceptual video quality that is tangential to measuring how well the video abides by physical laws. To address this fragmentation, we introduce PhysicsMind, a unified benchmark with both real and simulation environments that evaluates law-consistent reasoning and generation over three canonical principles: Center of Mass, Lever Equilibrium, and Newton's First Law. PhysicsMind comprises two main tasks: i) VQA tasks, testing whether models can reason and determine physical quantities and values from images or short videos, and ii) Video Generation(VG) tasks, evaluating if predicted motion trajectories obey the same center-of-mass, torque, and inertial constraints as the ground truth. A broad range of recent models and video generation models is evaluated on PhysicsMind and found to rely on appearance heuristics while often violating basic mechanics. These gaps indicate that current scaling and training are still insufficient for robust physical understanding, underscoring PhysicsMind as a focused testbed for physics-aware multimodal models. Our data will be released upon acceptance.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 28 of its 39 references that are in the map. First posted on arXiv 22 Jan 2026.
Builds on
28 of 39 references.
Closest ancestors · 2
Same direction, newest first
- 2025WoW: Towards a World omniscient World model Through Embodied Interaction26 Sep
- 2018Learning Latent Dynamics for Planning from Pixels12 Nov
Other references · 26
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2025Do generative video models understand physical principles?cited by 151
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 147
14 more
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
- 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
- 2025Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areascited by 93
- 2020CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractionscited by 44
- 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
- 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Modelscited by 35
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025A Shortcut-aware Video-QA Benchmark for Physical Understanding via Minimal Video Pairscited by 30
- 2024EVA: An Embodied World Model for Future Video Anticipationcited by 28
- 2025WorldPrediction: A Benchmark for High-level World Modeling and Long-horizon Procedural Planningcited by 19
- 2025Can World Models Benefit VLMs for World Dynamics?cited by 9
- 2025Benchmarking World-Model Learning with Environment-Level Queriescited by 7
- 2025PAC Bench: Do Foundation Models Understand Prerequisites for Executing Manipulation Policies?cited by 3
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMscited by 1
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026APT: Atomic Physical Transitions for Causal Video-Language Understandingcited by 0
- 2026One Perturbation Is Not Enough: Identifiability and Blind Baselines for Behavioral AI Evaluationcited by 0
- 2026MindTopo: Can Foundation Models Reason in Topological Space?cited by 0
- 2026OmniFysics-Captioner Technical Report: Grounding Omni-Modal Understanding in the Physical World for Better Captioningcited by 0
- 2026MultiEcho: An Experimental Science of Learned Worldscited by 0
- 2026PhysFieldBench: Can Multimodal Models Understand Physical Fields?cited by 0
- 2026PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loopcited by 0
- 2026PhysVista: Benchmarking Physical Intelligence in VLMs via a Perception-Reasoning-Assessment Loop30 Sep 2026
- 2026PhysFieldBench: Can Multimodal Models Understand Physical Fields?28 Sep 2026
- 2026MultiEcho: An Experimental Science of Learned Worlds27 Sep 2026
- 2026OmniFysics-Captioner Technical Report: Grounding Omni-Modal Understanding in the Physical World for Better Captioning21 Sep 2026
- 2026MindTopo: Can Foundation Models Reason in Topological Space?10 Sep 2026
- 2026One Perturbation Is Not Enough: Identifiability and Blind Baselines for Behavioral AI Evaluation5 Sep 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026APT: Atomic Physical Transitions for Causal Video-Language Understanding17 Jun 2026
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMs29 May 2026
- 2026Human Cognition in Machines: A Unified Perspective of World Models17 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
- 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibility
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Concepts
- 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning
- 2026World Models' Last Exam in Physics
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstruction
- 2025InPhyRe Discovers: Large Multimodal Models Struggle in Inductive Physical Reasoning
- 2026PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning