mlsanityData to 14 Oct 2026

PhysUniBench: A Multi-Modal Physics Reasoning Benchmark at Undergraduate Level

arXiv 2506.17667 ↗First posted 21 Jun 2025cs.AIcited by 16

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Physics problem-solving is a challenging domain for AI models, requiring integration of conceptual understanding, mathematical reasoning, and interpretation of physical diagrams. Existing evaluations fail to capture the full breadth and complexity of undergraduate physics, whereas this level provides a rigorous yet standardized testbed for pedagogical assessment of multi-step physical reasoning. To this end, we present PhysUniBench, a large-scale multimodal benchmark designed to evaluate and improve the reasoning capabilities of multimodal large language models (MLLMs) specifically on undergraduate-level physics problems. PhysUniBench consists of 3,304 physics questions spanning 8 major sub-disciplines of physics, each accompanied by one visual diagram. The benchmark includes both open-ended and multiple-choice questions, systematically curated and difficulty-rated through an iterative process. The benchmark's construction involved a rigorous multi-stage process, including multiple roll-outs, expert-level evaluation, automated filtering of easily solved problems, and a nuanced difficulty grading system with five levels. Through extensive experiments, we observe that current models encounter substantial challenges in physics reasoning, where GPT-5 achieves only 51.6% accuracy in the PhysUniBench. These results highlight that current MLLMs struggle with advanced physics reasoning, especially on multi-step problems and those requiring precise diagram interpretation. By providing a broad and rigorous assessment tool, PhysUniBench aims to drive progress in AI for Science, encouraging the development of models with stronger physical reasoning, problem-solving skills, and multimodal understanding.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 70 references that are in the map. First posted on arXiv 21 Jun 2025.

Builds on

37 of 70 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs27 May
  2. 2025SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning25 May
  3. 2025PhyX: Does Your Model Have the "Wits" for Physical Reasoning?21 May
  4. 2025PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensions21 May
  5. 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models22 Apr
  6. 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning17 Feb
  7. 2025UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models1 Feb

Other references · 30

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  8. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  9. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  10. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  11. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  12. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
18 more
  1. 2024DeepSeek-V3 Technical Reportcited by 811
  2. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  3. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
  4. 2025Llama-Nemotron: Efficient Reasoning Modelscited by 158
  5. 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoningcited by 156
  6. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmarkcited by 134
  7. 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 72
  8. 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 66
  9. 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoningcited by 40
  10. 2025BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Modelcited by 37
  11. 2025Nature Language Model: Deciphering the Language of Nature for Scientific Discoverycited by 36
  12. 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 34
  13. 2024MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Modelscited by 33
  14. 2025Physics: Benchmarking Foundation Models on University-Level Physics Problem Solvingcited by 31
  15. 2024Speak-to-Structure: Evaluating LLMs in Open-domain Natural Language-Driven Molecule Generationcited by 25
  16. 2025ChemMLLM: Chemical Multimodal Large Language Modelcited by 17
  17. 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Datacited by 14
  18. 2025EarthSE: A Benchmark for Evaluating Earth Scientific Exploration Capability of LLMscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 14.

16 papers.

Sort:

By area:

  1. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  2. 2026TSRBench: A Comprehensive Multi-task Multi-modal Time Series Reasoning Benchmark for Generalist Modelscited by 18
  3. 2026General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Taskscited by 6
  4. 2026Vision Language Models Cannot Reason About Physical Transformationcited by 4
  5. 2025ARCHE: A Novel Task to Evaluate LLMs on Latent Reasoning Chain Extractioncited by 3
  6. 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Modelscited by 2
  7. 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMscited by 1
  8. 2026Decoupled Physical Modeling and Execution for Physics Reasoningcited by 1
  9. 2026PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?cited by 1
  10. 2026FeynmanBench: Benchmarking Multimodal LLMs on Diagrammatic Physics Reasoningcited by 0
  11. 2026Hidden in Plain Sight: Visual-to-Symbolic Analytical Solution Inference from Field Visualizationscited by 0
  12. 2026Physics-R1: An Audited Olympiad Corpus and Released Verifiers for Visual Physics Reasoningcited by 0
4 more
  1. 2026IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMscited by 0
  2. 2026Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoningcited by 0
  3. 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalitiescited by 0
  4. 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topicscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Multi-Physics: A Comprehensive Benchmark for Multimodal LLMs Reasoning on Chinese Multi-Subject Physics Problems
  2. 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
  3. 2025Scaling Physical Reasoning with the PHYSICS Dataset
  4. 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems
  5. 2026OmniPhys: A Unified Multimodal Benchmark for Physics Understanding and Generation from Chinese Educational Corpora
  6. 2025Symbolic or Numerical? Understanding Physics Problem Solving in Reasoning LLMs
  7. 2025Benchmarking Foundation Models with Retrieval-Augmented Generation in Olympic-Level Physics Problem Solving
  8. 2025PhysicsEval: Inference-Time Techniques to Improve the Reasoning Proficiency of Large Language Models on Physics Problems