WorldAgent: Verification-Guided Agentic Physical World Construction
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Constructing complex physical worlds from language requires coordinating extensive 3D environments, detailed structures and objects at different spatial scales, and interacting physical processes under both stated goals and implicit physical constraints. We present WorldAgent, an agentic framework for verification-guided physical world construction from a single natural-language prompt, without iterative user debugging. A world construction layer expands the prompt into a structured world specification and uses physical knowledge to build scenes and run numerical simulations. After every step, a verification layer inspects scene geometry and simulation states alongside rendered views. Failed checks guide automatic revisions to the specification and re-execution of the affected steps. Accepted worlds pass the required checks and remain editable for further inspection and resimulation. We introduce AgenticSimBench, on which WorldAgent achieves the best scores among the evaluated agent-based methods on five of seven metrics. In a 26-participant user study, it receives the highest mean ratings across all four criteria.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 36 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
35 of 36 references.
Closest ancestors · 13
Same direction, newest first
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug
- 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulation23 Jul
- 2026Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents21 Jul
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI8 Jul
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation2 Jul
- 2026PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback7 Jun
- 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learning10 May
- 2026PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangement16 Feb
- 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AI10 Feb
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes9 Feb
- 2026Vision-as-Inverse-Graphics Agent via Interleaved Multimodal Reasoning16 Jan
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation5 May
Other references · 22
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 326
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2024Diffusion Models Are Real-Time Game Enginescited by 296
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 95
10 more
- 2022Do Differentiable Simulators Give Better Policy Gradients?cited by 89
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 2025Scalable Real2Sim: Physics-Aware Asset Generation Via Robotic Pick-and-Place Setupscited by 30
- 2026Code2Worlds: Empowering Coding LLMs for 4D World Generationcited by 19
- 2026SimFoundry: Modular and Automated Scene Generation for Policy Learning and Evaluationcited by 16
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
- 2025Differentiable Simulation of Hard Contacts with Soft Gradients for Learning and Controlcited by 5
- 2026Agentic Scientific Simulation: Execution-Grounded Model Construction and Reconstructioncited by 4
- 2026LychSim: A Controllable and Interactive Simulation Framework for Vision Researchcited by 3
- 2026ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Constructioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Code2Worlds-2: Physically Plausible Agent Harness for Embodied World Simulation
- 2026ExeWorldBench: Benchmarking Code-Based Executable 3D World Modeling
- 2026WorldAgents: Can Foundation Image Models be Agents for 3D World Models?
- 2026World Craft: Agentic Framework to Create Visualizable Worlds via Text
- 2026Asking the World: Generalist Physical Reasoning through Agentic World Modeling and Probing
- 2026aDSL: Agentic 3D Creation via Joint Agent-Program Design
- 2026PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition
- 2026Authoring for Living Worlds: Tool-Constrained LLM Agents for Executable Multi-Actor Scenarios