PhysUniBench: A Multi-Modal Physics Reasoning Benchmark at Undergraduate Level
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Physics problem-solving is a challenging domain for AI models, requiring integration of conceptual understanding, mathematical reasoning, and interpretation of physical diagrams. Existing evaluations fail to capture the full breadth and complexity of undergraduate physics, whereas this level provides a rigorous yet standardized testbed for pedagogical assessment of multi-step physical reasoning. To this end, we present PhysUniBench, a large-scale multimodal benchmark designed to evaluate and improve the reasoning capabilities of multimodal large language models (MLLMs) specifically on undergraduate-level physics problems. PhysUniBench consists of 3,304 physics questions spanning 8 major sub-disciplines of physics, each accompanied by one visual diagram. The benchmark includes both open-ended and multiple-choice questions, systematically curated and difficulty-rated through an iterative process. The benchmark's construction involved a rigorous multi-stage process, including multiple roll-outs, expert-level evaluation, automated filtering of easily solved problems, and a nuanced difficulty grading system with five levels. Through extensive experiments, we observe that current models encounter substantial challenges in physics reasoning, where GPT-5 achieves only 51.6% accuracy in the PhysUniBench. These results highlight that current MLLMs struggle with advanced physics reasoning, especially on multi-step problems and those requiring precise diagram interpretation. By providing a broad and rigorous assessment tool, PhysUniBench aims to drive progress in AI for Science, encouraging the development of models with stronger physical reasoning, problem-solving skills, and multimodal understanding.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 70 references that are in the map. First posted on arXiv 21 Jun 2025.
Builds on
37 of 70 references.
Closest ancestors · 7
Same direction, newest first
- 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMs27 May
- 2025SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoning25 May
- 2025PhyX: Does Your Model Have the "Wits" for Physical Reasoning?21 May
- 2025PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensions21 May
- 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models22 Apr
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning17 Feb
- 2025UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models1 Feb
Other references · 30
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
18 more
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 267
- 2025Llama-Nemotron: Efficient Reasoning Modelscited by 158
- 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoningcited by 156
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmarkcited by 134
- 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 72
- 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 66
- 2025MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoningcited by 40
- 2025BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Modelcited by 37
- 2025Nature Language Model: Deciphering the Language of Nature for Scientific Discoverycited by 36
- 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 34
- 2024MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Modelscited by 33
- 2025Physics: Benchmarking Foundation Models on University-Level Physics Problem Solvingcited by 31
- 2024Speak-to-Structure: Evaluating LLMs in Open-domain Natural Language-Driven Molecule Generationcited by 25
- 2025ChemMLLM: Chemical Multimodal Large Language Modelcited by 17
- 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Datacited by 14
- 2025EarthSE: A Benchmark for Evaluating Earth Scientific Exploration Capability of LLMscited by 7
Built on by
Citing papers per year: 2025: 2; 2026: 14.
16 papers.
Sort:
By area:
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
- 2026TSRBench: A Comprehensive Multi-task Multi-modal Time Series Reasoning Benchmark for Generalist Modelscited by 18
- 2026General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Taskscited by 6
- 2026Vision Language Models Cannot Reason About Physical Transformationcited by 4
- 2025ARCHE: A Novel Task to Evaluate LLMs on Latent Reasoning Chain Extractioncited by 3
- 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Modelscited by 2
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMscited by 1
- 2026Decoupled Physical Modeling and Execution for Physics Reasoningcited by 1
- 2026PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?cited by 1
- 2026FeynmanBench: Benchmarking Multimodal LLMs on Diagrammatic Physics Reasoningcited by 0
- 2026Hidden in Plain Sight: Visual-to-Symbolic Analytical Solution Inference from Field Visualizationscited by 0
- 2026Physics-R1: An Audited Olympiad Corpus and Released Verifiers for Visual Physics Reasoningcited by 0
4 more
- 2026IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMscited by 0
- 2026Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoningcited by 0
- 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalitiescited by 0
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topicscited by 0
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topics25 Sep 2026
- 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalities22 Sep 2026
- 2026PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?25 Aug 2026
- 2026Decoupled Physical Modeling and Execution for Physics Reasoning22 Aug 2026
- 2026Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoning17 Jul 2026
- 2026IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMs1 Jul 2026
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMs29 May 2026
- 2026Physics-R1: An Audited Olympiad Corpus and Released Verifiers for Visual Physics Reasoning13 May 2026
- 2026General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks13 Apr 2026
- 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Models11 Apr 2026
- 2026Hidden in Plain Sight: Visual-to-Symbolic Analytical Solution Inference from Field Visualizations10 Apr 2026
- 2026FeynmanBench: Benchmarking Multimodal LLMs on Diagrammatic Physics Reasoning4 Apr 2026
4 more
- 2026Vision Language Models Cannot Reason About Physical Transformation7 Mar 2026
- 2026TSRBench: A Comprehensive Multi-task Multi-modal Time Series Reasoning Benchmark for Generalist Models26 Jan 2026
- 2025ARCHE: A Novel Task to Evaluate LLMs on Latent Reasoning Chain Extraction16 Nov 2025
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun 2025
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
- 2026TSRBench: A Comprehensive Multi-task Multi-modal Time Series Reasoning Benchmark for Generalist Modelscited by 18
- 2026General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Taskscited by 6
- 2026Vision Language Models Cannot Reason About Physical Transformationcited by 4
- 2025ARCHE: A Novel Task to Evaluate LLMs on Latent Reasoning Chain Extractioncited by 3
- 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Modelscited by 2
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMscited by 1
- 2026Decoupled Physical Modeling and Execution for Physics Reasoningcited by 1
- 2026FeynmanBench: Benchmarking Multimodal LLMs on Diagrammatic Physics Reasoningcited by 0
- 2026Hidden in Plain Sight: Visual-to-Symbolic Analytical Solution Inference from Field Visualizationscited by 0
- 2026IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMscited by 0
- 2026Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoningcited by 0
- 2026Decoupled Physical Modeling and Execution for Physics Reasoning22 Aug 2026
- 2026Lost in Perception: Isolating Perceptual and Reasoning Failures in Multimodal Physics and Geometry Reasoning17 Jul 2026
- 2026IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMs1 Jul 2026
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMs29 May 2026
- 2026General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks13 Apr 2026
- 2026Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Models11 Apr 2026
- 2026Hidden in Plain Sight: Visual-to-Symbolic Analytical Solution Inference from Field Visualizations10 Apr 2026
- 2026FeynmanBench: Benchmarking Multimodal LLMs on Diagrammatic Physics Reasoning4 Apr 2026
- 2026Vision Language Models Cannot Reason About Physical Transformation7 Mar 2026
- 2026TSRBench: A Comprehensive Multi-task Multi-modal Time Series Reasoning Benchmark for Generalist Models26 Jan 2026
- 2025ARCHE: A Novel Task to Evaluate LLMs on Latent Reasoning Chain Extraction16 Nov 2025
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun 2025
- 2026PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?cited by 1
- 2026Physics-R1: An Audited Olympiad Corpus and Released Verifiers for Visual Physics Reasoningcited by 0
- 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalitiescited by 0
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topicscited by 0
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topics25 Sep 2026
- 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalities22 Sep 2026
- 2026PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?25 Aug 2026
- 2026Physics-R1: An Audited Olympiad Corpus and Released Verifiers for Visual Physics Reasoning13 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Multi-Physics: A Comprehensive Benchmark for Multimodal LLMs Reasoning on Chinese Multi-Subject Physics Problems
- 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
- 2025Scaling Physical Reasoning with the PHYSICS Dataset
- 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems
- 2026OmniPhys: A Unified Multimodal Benchmark for Physics Understanding and Generation from Chinese Educational Corpora
- 2025Symbolic or Numerical? Understanding Physics Problem Solving in Reasoning LLMs
- 2025Benchmarking Foundation Models with Retrieval-Augmented Generation in Olympic-Level Physics Problem Solving
- 2025PhysicsEval: Inference-Time Techniques to Improve the Reasoning Proficiency of Large Language Models on Physics Problems