mlsanityData to 14 Oct 2026

Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generation

arXiv 2512.10501 ↗First posted 11 Dec 2025cs.AIcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Procedural Content Generation (PCG) offers scalable methods for algorithmically creating complex, customizable worlds. However, controlling these pipelines requires the precise configuration of opaque technical parameters. We propose a training-free architecture that utilizes LLM agents for zero-shot PCG parameter configuration. While Large Language Models (LLMs) promise a natural language interface for PCG tools, off-the-shelf models often fail to bridge the semantic gap between abstract user instructions and strict parameter specifications. Our system pairs an Actor agent with a Critic agent, enabling an iterative workflow where the system autonomously reasons over tool parameters and refines configurations to progressively align with human design preferences. We validate this approach on the generation of various 3D maps, establishing a new benchmark for instruction-following in PCG. Experiments demonstrate that our approach outperforms single-agent baselines, producing diverse and structurally valid environments from natural language descriptions. These results demonstrate that off-the-shelf LLMs can be effectively repurposed as generalized agents for arbitrary PCG tools. By shifting the burden from model training to architectural reasoning, our method offers a scalable framework for mastering complex software without task-specific fine-tuning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 30 references that are in the map. First posted on arXiv 11 Dec 2025.

Builds on

17 of 30 references.

References · 17

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  6. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  7. 2023Augmented Language Models: a Surveycited by 403
  8. 2017Procedural Content Generation via Machine Learning (PCGML)cited by 137
  9. 2024A Survey on Large Language Model-Based Game Agentscited by 112
  10. 2023Level Generation Through Large Language Modelscited by 68
  11. 2025SeRL: Self-Play Reinforcement Learning for Large Language Models with Limited Datacited by 51
  12. 2024A Critical Evaluation of AI Feedback for Aligning Large Language Modelscited by 36
5 more
  1. 2023CALYPSO: LLMs as Dungeon Masters' Assistantscited by 23
  2. 2024Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integrationcited by 22
  3. 2023Language as Reality: A Co-Creative Storytelling Game Experience in 1001 Nights using Generative AIcited by 21
  4. 2023The Right Variety: Improving Expressive Range Analysis with Metric Selection Methodscited by 6
  5. 2025Narrative-to-Scene Generation: An LLM-Driven Pipeline for 2D Game Environmentscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ShapeCraft: LLM Agents for Structured, Textured and Interactive 3D Modeling
  2. 2026WorldClaw: Agentic 3D Open-World Generation at Scale
  3. 2026aDSL: Agentic 3D Creation via Joint Agent-Program Design
  4. 2026Imagine a City: CityGenAgent for Procedural 3D City Generation
  5. 2025Video Game Level Design as a Multi-Agent Reinforcement Learning Problem
  6. 2025LL3M: Large Language 3D Modelers
  7. 2025WorldGen: From Text to Traversable and Interactive 3D Worlds
  8. 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulation