mlsanityData to 13 Oct 2026

PhysCodeBench: Benchmarking Physics-Aware Symbolic Simulation of 3D Scenes via Self-Corrective Multi-Agent Refinement

arXiv 2604.23580 ↗First posted 26 Apr 2026cs.RO cs.AIcited by 7

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Translating natural-language descriptions of physical phenomena into executable simulation code requires both programming expertise and physical reasoning. Current large language models (LLMs) lack this combination: they frequently produce code that runs but simulates the wrong physics. We introduce PhysCodeBench, the first benchmark for this task, with 1,200 expert-validated examples spanning four physical domains. Its evaluation suite, PhysCodeEval, goes beyond executability and visual fidelity to measure physical correctness directly from the engine state via conservation-law residuals and expert-written assertions, and supports cross-engine evaluation to disentangle physics reasoning from API fluency. As a reference method, we propose the Self-Corrective Multi-Agent Refinement Framework (SMRF), which decouples physics-aware error correction from code generation through specialized agents. This design is motivated by our finding that targeted correction, rather than generic iterative refinement, is the key driver of physical accuracy. SMRF nearly triples the physical-assertion pass rate of the best proprietary baseline (70.6% vs. 23.8%) and retains its advantage under cross-engine transfer.

Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 31 of its 46 references that are in the map. First posted on arXiv 26 Apr 2026.

Builds on

31 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar

Other references · 30

  1. 2022Training language models to follow instructions with human feedbackcited by 15,856
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,205
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,986
  4. 2024Qwen2.5 Technical Reportcited by 4,840
  5. 2024GPT-4o System Cardcited by 4,536
  6. 2021Program Synthesis with Large Language Modelscited by 3,573
  7. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,407
  8. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,395
  9. 2023Code Llama: Open Foundation Models for Codecited by 2,130
  10. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,945
  11. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,775
  12. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,186
18 more
  1. 2023Teaching Large Language Models to Self-Debugcited by 972
  2. 2023ChatDev: Communicative Agents for Software Developmentcited by 901
  3. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 739
  4. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 731
  5. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 549
  6. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 478
  7. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 475
  8. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 406
  9. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 208
  10. 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 148
  11. 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 121
  12. 2022Mind's Eye: Grounded Language Model Reasoning through Simulationcited by 83
  13. 2023CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modulescited by 58
  14. 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Modelscited by 57
  15. 2023Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Propertiescited by 54
  16. 2024SimGen: Simulator-conditioned Driving Scene Generationcited by 34
  17. 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Enginescited by 29
  18. 2024ContPhy: Continuum Physical Concept Learning and Reasoning from Videoscited by 25

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Perceptual Self-Reflection in Agentic Physics Simulation Code Generation
  2. 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
  3. 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation
  4. 2026Training and Benchmarking Code Generation for Physics-Inspired Animations
  5. 2025PhysMaster: Building an Autonomous AI Physicist for Theoretical and Computational Physics Research
  6. 2026Code2Worlds: Empowering Coding LLMs for 4D World Generation
  7. 2026Decoupled Physical Modeling and Execution for Physics Reasoning
  8. 2026PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generation