mlsanityData to 7 Oct 2026

PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models

arXiv 2601.16007 ↗First posted 22 Jan 2026cs.CV cs.AIcited by 10

On the map: World models → Latent predictive world models

also in 2 more
Abstract (arXiv)

Modern foundational Multimodal Large Language Models (MLLMs) and video world models have advanced significantly in mathematical, common-sense, and visual reasoning, but their grasp of the underlying physics remains underexplored. Existing benchmarks attempting to measure this matter rely on synthetic, Visual Question Answer templates or focus on perceptual video quality that is tangential to measuring how well the video abides by physical laws. To address this fragmentation, we introduce PhysicsMind, a unified benchmark with both real and simulation environments that evaluates law-consistent reasoning and generation over three canonical principles: Center of Mass, Lever Equilibrium, and Newton's First Law. PhysicsMind comprises two main tasks: i) VQA tasks, testing whether models can reason and determine physical quantities and values from images or short videos, and ii) Video Generation(VG) tasks, evaluating if predicted motion trajectories obey the same center-of-mass, torque, and inertial constraints as the ground truth. A broad range of recent models and video generation models is evaluated on PhysicsMind and found to rely on appearance heuristics while often violating basic mechanics. These gaps indicate that current scaling and training are still insufficient for robust physical understanding, underscoring PhysicsMind as a focused testbed for physics-aware multimodal models. Our data will be released upon acceptance.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 28 of its 39 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

28 of 39 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025WoW: Towards a World omniscient World model Through Embodied Interaction26 Sep
  2. 2018Learning Latent Dynamics for Planning from Pixels12 Nov

Other references · 26

  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  6. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
  7. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  8. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  9. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
  10. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
  11. 2025Do generative video models understand physical principles?cited by 151
  12. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 147
14 more
  1. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  2. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  3. 2025WorldModelBench: Judging Video Generation Models As World Modelscited by 116
  4. 2025Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areascited by 93
  5. 2020CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractionscited by 44
  6. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  7. 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Modelscited by 35
  8. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  9. 2025A Shortcut-aware Video-QA Benchmark for Physical Understanding via Minimal Video Pairscited by 30
  10. 2024EVA: An Embodied World Model for Future Video Anticipationcited by 28
  11. 2025WorldPrediction: A Benchmark for High-level World Modeling and Long-horizon Procedural Planningcited by 19
  12. 2025Can World Models Benefit VLMs for World Dynamics?cited by 9
  13. 2025Benchmarking World-Model Learning with Environment-Level Queriescited by 7
  14. 2025PAC Bench: Do Foundation Models Understand Prerequisites for Executing Manipulation Policies?cited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
  2. 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibility
  3. 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Concepts
  4. 2026Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning
  5. 2026World Models' Last Exam in Physics
  6. 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstruction
  7. 2025InPhyRe Discovers: Large Multimodal Models Struggle in Inductive Physical Reasoning
  8. 2026PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning