Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedback
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
Symbolic world models (e.g., PDDL domains or executable simulators) are central to model-based planning, but training LLMs to generate such world models is limited by the lack of large-scale verifiable supervision. Current approaches rely primarily on static validation methods that fail to catch behavior-level errors arising from interactive execution. In this paper, we propose Agent2World, a tool-augmented multi-agent framework that achieves strong inference-time world-model generation and also serves as a data engine for supervised fine-tuning, by grounding generation in multi-agent feedback. Agent2World follows a three-stage pipeline: (i) A Deep Researcher agent performs knowledge synthesis by web searching to address specification gaps; (ii) A Model Developer agent implements executable world models; And (iii) a specialized Testing Team conducts adaptive unit testing and simulation-based validation. Agent2World demonstrates superior inference-time performance across three benchmarks spanning both Planning Domain Definition Language (PDDL) and executable code representations, achieving consistent state-of-the-art results. Beyond inference, Testing Team serves as an interactive environment for the Model Developer, providing behavior-aware adaptive feedback that yields multi-turn training trajectories. The model fine-tuned on these trajectories substantially improves world-model generation, yielding an average relative gain of 30.95% over the same model before training. Project page: https://agent2world.github.io.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 33 of its 41 references that are in the map. First posted on arXiv 26 Dec 2025.
Builds on
33 of 41 references.
Closest ancestors · 6
Same direction, newest first
- 2025Generating Symbolic World Models via Test-time Scaling of Large Language Models7 Feb
- 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search24 May
- 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
- 2023Reasoning with Language Model is Planning with World Model24 May
- 2023Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning24 May
- 2023ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games24 May
Other references · 27
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024GPT-4o System Cardcited by 4,588
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Qwen Technical Reportcited by 3,344
- 2020Learning to summarize from human feedbackcited by 2,588
- 2023A Survey of Large Language Modelscited by 2,576
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
15 more
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Modelcited by 106
- 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 83
- 20253D and 4D World Modeling: A Surveycited by 67
- 2025AI4Research: A Survey of Artificial Intelligence for Scientific Researchcited by 60
- 2025AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learningcited by 20
- 2025X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic Systemcited by 10
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Qwen-AgentWorld: Language World Models for General Agentscited by 28
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Makingcited by 8
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 5
- 2026MetaMind: General and Cognitive World Models in Multi-Agent Systems by Meta-Theory of Mindcited by 3
- 2026Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learningcited by 3
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 3
- 2026AI for Games in the Foundation Model Eracited by 3
- 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agentscited by 0
- 2026Agent-Editing World Model: Rethinking World Modeling for LLM Agents23 Sep 2026
- 2026AI for Games in the Foundation Model Era15 Sep 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learning4 Aug 2026
- 2026Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Making24 Jun 2026
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026MetaMind: General and Cognitive World Models in Multi-Agent Systems by Meta-Theory of Mind28 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Simulating Environments with Reasoning Models for Agent Training
- 2026Self-Evolving World Models for LLM Agent Planning
- 2026C-World: A Computer Use Agent Environment Creator
- 2026PDDLCoder: Agentic PDDL Generation for LLM-Assisted Symbolic Planning
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence
- 2026Aligning Agentic World Models via Knowledgeable Experience Learning
- 2026PatchWorld: Gradient-Free Optimization of Executable World Models for Agent Environments
- 2026MemWM: Memory-Augmented Text-Based World Model