mlsanityData to 14 Oct 2026

Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedback

arXiv 2512.22336 ↗First posted 26 Dec 2025cs.AI cs.CLcited by 9

On the map: World models → World models for language agents

also in 1 more
Abstract (arXiv)

Symbolic world models (e.g., PDDL domains or executable simulators) are central to model-based planning, but training LLMs to generate such world models is limited by the lack of large-scale verifiable supervision. Current approaches rely primarily on static validation methods that fail to catch behavior-level errors arising from interactive execution. In this paper, we propose Agent2World, a tool-augmented multi-agent framework that achieves strong inference-time world-model generation and also serves as a data engine for supervised fine-tuning, by grounding generation in multi-agent feedback. Agent2World follows a three-stage pipeline: (i) A Deep Researcher agent performs knowledge synthesis by web searching to address specification gaps; (ii) A Model Developer agent implements executable world models; And (iii) a specialized Testing Team conducts adaptive unit testing and simulation-based validation. Agent2World demonstrates superior inference-time performance across three benchmarks spanning both Planning Domain Definition Language (PDDL) and executable code representations, achieving consistent state-of-the-art results. Beyond inference, Testing Team serves as an interactive environment for the Model Developer, providing behavior-aware adaptive feedback that yields multi-turn training trajectories. The model fine-tuned on these trajectories substantially improves world-model generation, yielding an average relative gain of 30.95% over the same model before training. Project page: https://agent2world.github.io.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 33 of its 41 references that are in the map. First posted on arXiv 26 Dec 2025.

Builds on

33 of 41 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Generating Symbolic World Models via Test-time Scaling of Large Language Models7 Feb
  2. 2024Generating Code World Models with Large Language Models Guided by Monte Carlo Tree Search24 May
  3. 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
  4. 2023Reasoning with Language Model is Planning with World Model24 May
  5. 2023Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning24 May
  6. 2023ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games24 May

Other references · 27

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2024GPT-4o System Cardcited by 4,588
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  9. 2023Qwen Technical Reportcited by 3,344
  10. 2020Learning to summarize from human feedbackcited by 2,588
  11. 2023A Survey of Large Language Modelscited by 2,576
  12. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
15 more
  1. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  2. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  3. 2018World Modelscited by 1,513
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  5. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  6. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  7. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  8. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  9. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  10. 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Modelcited by 106
  11. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 83
  12. 20253D and 4D World Modeling: A Surveycited by 67
  13. 2025AI4Research: A Survey of Artificial Intelligence for Scientific Researchcited by 60
  14. 2025AutoEnv: Automated Environments for Measuring Cross-Environment Agent Learningcited by 20
  15. 2025X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic Systemcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Simulating Environments with Reasoning Models for Agent Training
  2. 2026Self-Evolving World Models for LLM Agent Planning
  3. 2026C-World: A Computer Use Agent Environment Creator
  4. 2026PDDLCoder: Agentic PDDL Generation for LLM-Assisted Symbolic Planning
  5. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence
  6. 2026Aligning Agentic World Models via Knowledgeable Experience Learning
  7. 2026PatchWorld: Gradient-Free Optimization of Executable World Models for Agent Environments
  8. 2026MemWM: Memory-Augmented Text-Based World Model