mlsanityData to 7 Oct 2026

WorldClaw: Agentic 3D Open-World Generation at Scale

arXiv 2608.05248 ↗First posted 5 Aug 2026cs.AI cs.CVcited by 6

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Generating large-scale, freely explorable 3D worlds from open-ended text remains challenging because a system must jointly maintain global spatial coherence, rich local content, and explicit assets suitable for downstream editing and reuse. We present WorldClaw, a fully agentic, coarse-to-fine framework for open-world 3D scene generation. Planning agents translate a text prompt into a structured specification of regions, terrain, assets, materials, and spatial relations. WorldClaw then builds a globally coherent terrain foundation from semantic layouts, reusable assets, generative or procedural materials, and a region-aware height field. For detail-demanding regions, it generates terrain-conditioned compositions, reconstructs editable textured meshes, and recovers their placement on the terrain; render-based agents further refine terrain, objects, appearance, and contacts. Across diverse open-world prompts, WorldClaw produces large-scale scenes with coherent spatial organization, visually compelling local content, and editable instance-level assets while preserving a consistent global terrain structure.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 92 of its 110 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

92 of 110 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation2 Jul
  2. 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code31 May
  3. 2026GenClaw: Code-Driven Agentic Image Generation28 May
  4. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation14 May
  5. 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learning10 May
  6. 2026Gen-Searcher: Reinforcing Agentic Search for Image Generation30 Mar
  7. 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AI10 Feb
  8. 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes9 Feb
  9. 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation2 Feb
  10. 2026Vision-as-Inverse-Graphics Agent via Interleaved Multimodal Reasoning16 Jan
  11. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent24 Sep
  12. 2025Agentic 3D Scene Generation with Spatially Contextualized VLMs26 May
2 more
  1. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation5 May
  2. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar

Other references · 78

  1. 2025SAM 3: Segment Anything with Conceptscited by 835
  2. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  3. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  4. 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
  5. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  6. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  7. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
  8. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
  9. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  10. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  11. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  12. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
38 more
  1. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
  2. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
  3. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
  4. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  5. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
  6. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
  7. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  8. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  9. 2024I-Design: Personalized LLM Interior Designercited by 87
  10. 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
  11. 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 81
  12. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 81
  13. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 75
  14. 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
  15. 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 60
  16. 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
  17. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  18. 2024LT3SD: Latent Trees for 3D Scene Diffusioncited by 53
  19. 2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
  20. 2023PERF: Panoramic Neural Radiance Field from a Single Panoramacited by 45
  21. 2023Persistent Nature: A Generative Model of Unbounded 3D Worldscited by 44
  22. 2024Generative Gaussian Splatting for Unbounded 3D City Generationcited by 43
  23. 2024L3DG: Latent 3D Gaussian Diffusioncited by 42
  24. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 34
  25. 2025WonderTurbo: Generating Interactive 3D World in 0.72 Secondscited by 31
  26. 2025SynCity: Training-Free Generation of 3D Worldscited by 30
  27. 2024Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Planecited by 26
  28. 2025WorldExplorer: Towards Generating Fully Navigable 3D Scenescited by 26
  29. 2024CityCraft: A Real Crafter for 3D City Generationcited by 25
  30. 2024FastScene: Text-Driven Fast 3D Indoor Scene Generation via Panoramic Gaussian Splattingcited by 24
  31. 2024HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptionscited by 24
  32. 2024SceneDreamer360: Text-Driven 3D-Consistent Scene Generation with Panoramic Gaussian Splattingcited by 24
  33. 2024SceneFactor: Factored Latent 3D Diffusion for Controllable 3D Scene Generationcited by 24
  34. 20253D Scene Generation: A Surveycited by 24
  35. 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
  36. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
  37. 2024Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketchescited by 21
  38. 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Citiescited by 20

50 most cited of 78 All 78 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generation
  2. 2026WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenes
  3. 2026World Craft: Agentic Framework to Create Visualizable Worlds via Text
  4. 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulation
  5. 2025UrbanWorld2.0: A Multimodal Agentic Framework for Reality-Aligned 3D World Generation at City-Scale
  6. 2026SceneAssistant: A Visual Feedback Agent for Open-Vocabulary 3D Scene Generation
  7. 2026MUSE: Agentic 3D Scene Authoring via Memory-Grounded Incremental Requirement Satisfaction
  8. 2026SceneOrchestra: Efficient Agentic 3D Scene Synthesis via Full Tool-Call Trajectory Generation