OmniPhys: A Unified Multimodal Benchmark for Physics Understanding and Generation from Chinese Educational Corpora
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have demonstrated strong abilities in solving diverse visual and textual reasoning tasks. However, their development in the physics domain is significantly hindered by the lack of a comprehensive benchmark. To fill this gap, we introduce OmniPhys, a large-scale benchmark for multimodal physics understanding and reasoning, covering middle school through university-level problems from Chinese Educational Corpora. OmniPhys consists of 15,246 questions and 19,850 images, accompanied by detailed annotations that support fine-grained analysis of reasoning processes and knowledge usage. Beyond conventional evaluation, OmniPhys is a benchmark that systematically evaluates multimodal outputs in the physics domain, including models' ability to generate structured physics diagrams, which constitute a fundamental component of authentic physics problem solving. Extensive evaluations reveal critical gaps in the capabilities of current MLLMs, especially in complex reasoning and visual generation. To address this, we release OmniPhys to serve as a foundational resource for advancing multimodal intelligence in physics and scientific domains. Codes and data are available at https://github.com/ECNU-RAIL/OmniPhys-EMNLP2026.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 66 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
35 of 66 references.
Closest ancestors · 3
Same direction, newest first
- 2025Multi-Physics: A Comprehensive Benchmark for Multimodal LLMs Reasoning on Chinese Multi-Subject Physics Problems19 Sep
- 2025Kimi-VL Technical Report10 Apr
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2024OpenAI o1 System Cardcited by 1,244
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
20 more
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2024Phi-4 Technical Reportcited by 711
- 2024Hallucination of Multimodal Large Language Models: A Surveycited by 388
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
- 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 246
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 192
- 2023Evaluating the Performance of Large Language Models on GAOKAO Benchmarkcited by 186
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoningcited by 59
- 2025UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Modelscited by 48
- 2025SeePhys: Does Seeing Help Thinking? -- Benchmarking Vision-Based Physics Reasoningcited by 34
- 2024Improving Physics Reasoning in Large Language Models Using Mixture of Refinement Agentscited by 24
- 2025RBench-V: A Primary Assessment for Visual Reasoning Models with Multi-modal Outputscited by 17
- 2023Using Large Language Model to Solve and Explain Physics Word Problems Approaching Human Levelcited by 16
- 2025MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Modelscited by 15
- 2025Scaling Physical Reasoning with the PHYSICS Datasetcited by 13
- 2025PhysicsArena: The First Multimodal Physics Reasoning Benchmark Exploring Variable, Process, and Solution Dimensionscited by 9
- 2025K12Vista: Exploring the Boundaries of MLLMs in K-12 Educationcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025PhysUniBench: A Multi-Modal Physics Reasoning Benchmark at Undergraduate Level
- 2024VisScience: An Extensive Benchmark for Evaluating K12 Educational Multi-modal Scientific Reasoning
- 2025MMSciBench: Benchmarking Language Models on Chinese Multimodal Scientific Problems
- 2025CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs
- 2026PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?
- 2026Unveiling Fine-Grained Visual Traces: Evaluating Multimodal Interleaved Reasoning Chains in Multimodal STEM Tasks
- 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
- 2025VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge