mlsanityData to 14 Oct 2026

PhysMaster: Building an Autonomous AI Physicist for Theoretical and Computational Physics Research

arXiv 2512.19799 ↗First posted 22 Dec 2025cs.AI hep-latcited by 2

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Advances in LLM reasoning and tool use have enabled agentic science, yet frontier theoretical and computational physics remains challenging because research requires deep domain expertise, long-horizon reasoning, and reliable numerical computation. We introduce PRL-Bench, a research-reproduction benchmark adapted from 100 Physical Review Letters papers across major areas of modern physics. PRL-Bench distills realistic research workflows into traceable tasks with explicit intermediate artifacts and diverse evaluation rubrics; each task is estimated by domain experts to require more than six hours for a specialized PhD student to reproduce independently. Evaluations show that existing agents remain unreliable on extended research workflows. We therefore present PhysMaster, a scientific agent combining adaptive MCTS-based multi-trajectory exploration with hierarchical memory to improve long-horizon robustness and knowledge accumulation. PhysMaster achieves the highest overall PRL-Bench score of 51.08, outperforming Codex, OpenHands, OpenClaw, and ReAct, and yields relative improvements of 14.13 percent to 93.38 percent across backbone models. Error analysis shows that PhysMaster substantially reduces failures from incomplete long-horizon execution, while remaining bottlenecks lie in physics knowledge and analytical reasoning. Together, PRL-Bench and PhysMaster provide a rigorous benchmark and effective system for advancing autonomous AI research in frontier physics.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 39 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

10 of 39 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models22 Apr
  2. 2025Theoretical Physics Benchmark (TPBench) -- a Dataset and Study of AI Reasoning Capabilities in Theoretical Physics19 Feb

Other references · 8

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  3. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  4. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  5. 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 92
  6. 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Modelscited by 70
  7. 2025ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoningcited by 61
  8. 2025Physics: Benchmarking Foundation Models on University-Level Physics Problem Solvingcited by 31

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PRL-Bench: A Comprehensive Benchmark Evaluating LLMs' Capabilities in Frontier Physics Research
  2. 2025PhysGym: Benchmarking LLMs in Interactive Physics Discovery with Controlled Priors
  3. 2026TheoPhysEval: Assessing AI agents at autonomous theoretical physics problem solving
  4. 2025Can Theoretical Physics Research Benefit from Language Agents?
  5. 2025PhysicsMinions: Winning Gold Medals in the Latest Physics Olympiads with a Coevolutionary Multimodal Multi-Agent System
  6. 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
  7. 2026Grounded autonomous research: a fault-tolerant LLM pipeline from corpus to manuscript in frontier computational physics
  8. 2026Grounded autonomous scrutiny at scale: emergent critique from reproduction of published computational physics papers