mlsanityData to 7 Oct 2026

LL3M: Large Language 3D Modelers

arXiv 2508.08228 ↗First posted 11 Aug 2025cs.GR cs.AIcited by 18

Not on the map. Why?

Abstract (arXiv)

We present LL3M, a multi-agent system that leverages pretrained large language models (LLMs) to generate 3D assets by writing interpretable Python code in Blender. We break away from the typical generative approach that learns from a collection of 3D data. Instead, we reformulate shape generation as a code-writing task, enabling greater modularity, editability, and integration with artist workflows. Given a text prompt, LL3M coordinates a team of specialized LLM agents to plan, retrieve, write, debug, and refine Blender scripts that generate and edit geometry and appearance. The generated code works as a high-level, interpretable, human-readable, well-documented representation of scenes and objects, making full use of sophisticated Blender constructs (e.g. B-meshes, geometry modifiers, shader nodes) for diverse, unconstrained shapes, materials, and scenes. This code presents many avenues for further agent and human editing and experimentation via code tweaks or procedural parameters. This medium naturally enables a co-creative loop in our system: agents can automatically self-critique using code and visuals, while iterative user instructions provide an intuitive way to refine assets. A shared code context across agents enables awareness of previous attempts, and a retrieval-augmented generation knowledge base built from Blender API documentation, BlenderRAG, equips agents with examples, types, and functions empowering advanced modeling operations and code correctness. We demonstrate the effectiveness of LL3M across diverse shape categories, style and material edits, and user-driven refinements. Our experiments showcase the power of code as a generative and interpretable medium for 3D asset creation. Our project page is at https://threedle.github.io/ll3m.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 51 of its 66 references that are in the map. First posted on arXiv 11 Aug 2025.

Builds on

51 of 66 references.

References · 51

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  6. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  7. 2024A Survey on Large Language Models for Code Generationcited by 646
  8. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  9. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  10. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  11. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  12. 2023Text-to-3D using Gaussian Splattingcited by 299
38 more
  1. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
  2. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  3. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
  4. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
  5. 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
  6. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
  7. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
  8. 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
  9. 2025CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratingscited by 109
  10. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
  11. 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
  12. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  13. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
  14. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
  15. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
  16. 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
  17. 2023PolyDiff: Generating 3D Polygonal Meshes with Diffusion Modelscited by 66
  18. 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
  19. 20213D Shape Generation with Grid-based Implicit Functionscited by 48
  20. 2020DECOR-GAN: 3D Shape Detailization by Conditional Refinementcited by 45
  21. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
  22. 2023CG3D: Compositional Generation for Text-to-3D via Gaussian Splattingcited by 42
  23. 2025TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencingcited by 38
  24. 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 34
  25. 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
  26. 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
  27. 2024L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objectscited by 26
  28. 2023ShapeCoder: Discovering Abstractions for Visual Programs from Unstructured Primitivescited by 22
  29. 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generationcited by 18
  30. 2022GeoCode: Interpretable Shape Programscited by 16
  31. 2024Turbo3D: Ultra-fast Text-to-3D Generationcited by 14
  32. 2025Geometry in Style: 3D Stylization via Surface Normal Deformationcited by 14
  33. 2024MagicClay: Sculpting Meshes With Generative Neural Fieldscited by 13
  34. 2024DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusioncited by 12
  35. 2024Learning to Edit Visual Programs with Self-Supervisioncited by 7
  36. 2025TextSplat: Text-Guided Semantic Fusion for Generalizable Gaussian Splattingcited by 6
  37. 2025OSS-Bench: Benchmark Generator for Coding LLMscited by 6
  38. 2024PyTorchGeoNodes: Enabling Differentiable Shape Programs for 3D Shape Reconstructioncited by 5

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 13.

18 papers.

Sort:

By area:

  1. 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenescited by 39
  2. 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligencecited by 9
  3. 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 9
  4. 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 8
  5. 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 6
  6. 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
  7. 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesiscited by 5
  8. 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creationcited by 4
  9. 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulationcited by 4
  10. 20253Dify: a Framework for Procedural 3D-CG Generation Assisted by LLMs Using MCP and RAGcited by 3
  11. 2025MCP4IFC: IFC-Based Building Design Using Large Language Modelscited by 2
  12. 2026EZBlender: Efficient 3D Editing with Plan-and-ReAct Agentcited by 2
6 more
  1. 2026Training-Free Dense Hand Contact Estimation with Multi-Modal Large Language Modelscited by 1
  2. 20263D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesiscited by 1
  3. 2025FloraForge: LLM-Assisted Procedural Generation of Editable and Analysis-Ready 3D Plant Geometric Models For Agricultural Applicationscited by 0
  4. 2026CMAG: Concept-Scaffolded Retrieval for Marketplace Avatar Generationcited by 0
  5. 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Modelscited by 0
  6. 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstructioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025ShapeCraft: LLM Agents for Structured, Textured and Interactive 3D Modeling
  2. 2026ViSculpt: Visual-Centric Agentic Geometry Editing
  3. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation
  4. 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds
  5. 2026Procedura: Agentic 3D Modeling with Procedural Control
  6. 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agents
  7. 2023Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback
  8. 2025Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generation