PhySense: Principle-Based Physics Reasoning Benchmarking for Large Language Models
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Large language models (LLMs) have rapidly advanced and are increasingly capable of tackling complex scientific problems, including those in physics. Despite this progress, current LLMs often fail to emulate the concise, principle-based reasoning characteristic of human experts, instead generating lengthy and opaque solutions. This discrepancy highlights a crucial gap in their ability to apply core physical principles for efficient and interpretable problem solving. To systematically investigate this limitation, we introduce PhySense, a novel principle-based physics reasoning benchmark designed to be easily solvable by experts using guiding principles, yet deceptively difficult for LLMs without principle-first reasoning. Our evaluation across multiple state-of-the-art LLMs and prompt types reveals a consistent failure to align with expert-like reasoning paths, providing insights for developing AI systems with efficient, robust and interpretable principle-based scientific reasoning.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 44 references that are in the map. First posted on arXiv 30 May 2025.
Builds on
25 of 44 references.
Closest ancestors · 6
Same direction, newest first
- 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models22 Apr
- 2025FEABench: Evaluating Language Models on Multiphysics Reasoning Ability8 Apr
- 2025Advancing AI-Scientist Understanding: Multi-Agent LLMs with Interpretable Physics Reasoning2 Apr
- 2025Theoretical Physics Benchmark (TPBench) -- a Dataset and Study of AI Reasoning Capabilities in Theoretical Physics19 Feb
- 2025PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning17 Feb
- 2025UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models1 Feb
Other references · 19
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
- 2025Humanity's Last Examcited by 491
- 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 464
- 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 256
7 more
- 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 192
- 2024LLM-SR: Scientific Equation Discovery via Programming with Large Language Modelscited by 133
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
- 2025CURIE: Evaluating LLMs On Multitask Scientific Long Context Understanding and Reasoningcited by 28
- 2023Using Large Language Model to Solve and Explain Physics Word Problems Approaching Human Levelcited by 16
- 2025Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Modelscited by 14
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researcherscited by 4
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2026Discovering High Level Patterns from Simulation Tracescited by 0
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topicscited by 0
- 2026A Benchmark for LLM's Understanding of Middle School and High School Science Topics25 Sep 2026
- 2026Discovering High Level Patterns from Simulation Traces10 Feb 2026
- 2025CMT-Benchmark: A Benchmark for Condensed Matter Theory Built by Expert Researchers6 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
- 2026PhysElite: How Far Are LLMs from Solving Olympiad-Level Physics Problems?
- 2025PhysicsEval: Inference-Time Techniques to Improve the Reasoning Proficiency of Large Language Models on Physics Problems
- 2025Can Theoretical Physics Research Benefit from Language Agents?
- 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems
- 2023NEWTON: Are Large Language Models Capable of Physical Reasoning?
- 2026Scientific Logicality Enriched Methodology for LLM Reasoning: A Practice in Physics
- 2025Symbolic or Numerical? Understanding Physics Problem Solving in Reasoning LLMs