Perceptual Self-Reflection in Agentic Physics Simulation Code Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
We present a multi-agent framework for generating physics simulation code from natural language descriptions, featuring a novel perceptual self-reflection mechanism for validation. The system employs four specialized agents: a natural language interpreter that converts user requests into physics-based descriptions; a technical requirements generator that produces scaled simulation parameters; a physics code generator with automated self-correction; and a physics validator that implements perceptual self-reflection. The key innovation is perceptual validation, which analyzes rendered animation frames using a vision-capable language model rather than inspecting code structure directly. This approach addresses the ``oracle gap'' where syntactically correct code produces physically incorrect behavior--a limitation that conventional testing cannot detect. We evaluate the system across seven domains including classical mechanics, fluid dynamics, thermodynamics, electromagnetics, wave physics, reaction-diffusion systems, and non-physics data visualization. The perceptual self-reflection architecture demonstrates substantial improvement over single-shot generation baselines, with the majority of tested scenarios achieving target physics accuracy thresholds. The system exhibits robust pipeline stability with consistent code self-correction capability, operating at approximately 0.20 per animation. These results validate our hypothesis that feeding visual simulation outputs back to a vision-language model for iterative refinement significantly outperforms single-shot code generation for physics simulation tasks and highlights the potential of agentic AI to support engineering workflows and physics data generation pipelines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 19 of its 24 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
19 of 24 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 442
- 2023LEVER: Learning to Verify Language-to-Code Generation with Executioncited by 228
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 136
- 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 132
- 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 123
- 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 118
6 more
- 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discoverycited by 82
- 2023ALGO: Synthesizing Algorithmic Programs with LLM-Generated Oracle Verifierscited by 41
- 2025Fine-tuning a Large Language Model for Automating Computational Fluid Dynamics Simulationscited by 18
- 2023Automating the Correctness Assessment of AI-generated Code for Security Contextscited by 6
- 2023Physics simulation capabilities of LLMscited by 6
- 2026Predictive Prototyping: Evaluating Design Concepts with ChatGPTcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026PhysCodeBench: Benchmarking Physics-Aware Symbolic Simulation of 3D Scenes via Self-Corrective Multi-Agent Refinement
- 2026Training and Benchmarking Code Generation for Physics-Inspired Animations
- 2026PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generation
- 2026Text2Sim: Agentic Physics-Based Simulation Generation with Distilled Expertise
- 2026Agentic Scientific Simulation: Execution-Grounded Model Construction and Reconstruction
- 2026ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Construction
- 2026WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?
- 2026PhysicsSolutionAgent: Towards Multimodal Explanations for Numerical Physics Problem Solving