PhysCodeBench: Benchmarking Physics-Aware Symbolic Simulation of 3D Scenes via Self-Corrective Multi-Agent Refinement
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Translating natural-language descriptions of physical phenomena into executable simulation code requires both programming expertise and physical reasoning. Current large language models (LLMs) lack this combination: they frequently produce code that runs but simulates the wrong physics. We introduce PhysCodeBench, the first benchmark for this task, with 1,200 expert-validated examples spanning four physical domains. Its evaluation suite, PhysCodeEval, goes beyond executability and visual fidelity to measure physical correctness directly from the engine state via conservation-law residuals and expert-written assertions, and supports cross-engine evaluation to disentangle physics reasoning from API fluency. As a reference method, we propose the Self-Corrective Multi-Agent Refinement Framework (SMRF), which decouples physics-aware error correction from code generation through specialized agents. This design is motivated by our finding that targeted correction, rather than generic iterative refinement, is the key driver of physical accuracy. SMRF nearly triples the physical-assertion pass rate of the best proprietary baseline (70.6% vs. 23.8%) and retains its advantage under cross-engine transfer.
Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 31 of its 46 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
31 of 46 references.
Closest ancestors · 1
Same direction, newest first
Other references · 30
- 2022Training language models to follow instructions with human feedbackcited by 15,856
- 2021Evaluating Large Language Models Trained on Codecited by 8,205
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
- 2024Qwen2.5 Technical Reportcited by 4,840
- 2024GPT-4o System Cardcited by 4,536
- 2021Program Synthesis with Large Language Modelscited by 3,573
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,407
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,395
- 2023Code Llama: Open Foundation Models for Codecited by 2,130
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,945
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,186
18 more
- 2023Teaching Large Language Models to Self-Debugcited by 972
- 2023ChatDev: Communicative Agents for Software Developmentcited by 901
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 739
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 731
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 549
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 478
- 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 475
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 406
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 208
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 148
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 121
- 2022Mind's Eye: Grounded Language Model Reasoning through Simulationcited by 83
- 2023CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modulescited by 58
- 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Modelscited by 57
- 2023Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Propertiescited by 54
- 2024SimGen: Simulator-conditioned Driving Scene Generationcited by 34
- 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Enginescited by 29
- 2024ContPhy: Continuum Physical Concept Learning and Reasoning from Videoscited by 25
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoningcited by 8
- 2026MPMWorlds: Material-Point-Method Simulations for Inferring and Extrapolating Physical Dynamicscited by 3
- 2026ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Constructioncited by 2
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026PACE-Bench: Benchmarking Physics Adaptation via Code Evolution in Dynamic Environmentscited by 0
- 20264DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenescited by 0
- 2026WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?cited by 0
- 2026WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?6 Oct 2026
- 20264DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes2 Oct 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning27 Aug 2026
- 2026PACE-Bench: Benchmarking Physics Adaptation via Code Evolution in Dynamic Environments14 Aug 2026
- 2026MPMWorlds: Material-Point-Method Simulations for Inferring and Extrapolating Physical Dynamics1 Jun 2026
- 2026ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Construction14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Perceptual Self-Reflection in Agentic Physics Simulation Code Generation
- 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
- 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation
- 2026Training and Benchmarking Code Generation for Physics-Inspired Animations
- 2025PhysMaster: Building an Autonomous AI Physicist for Theoretical and Computational Physics Research
- 2026Code2Worlds: Empowering Coding LLMs for 4D World Generation
- 2026Decoupled Physical Modeling and Execution for Physics Reasoning
- 2026PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generation