LL3M: Large Language 3D Modelers
Not on the map. Why?
Abstract (arXiv)
We present LL3M, a multi-agent system that leverages pretrained large language models (LLMs) to generate 3D assets by writing interpretable Python code in Blender. We break away from the typical generative approach that learns from a collection of 3D data. Instead, we reformulate shape generation as a code-writing task, enabling greater modularity, editability, and integration with artist workflows. Given a text prompt, LL3M coordinates a team of specialized LLM agents to plan, retrieve, write, debug, and refine Blender scripts that generate and edit geometry and appearance. The generated code works as a high-level, interpretable, human-readable, well-documented representation of scenes and objects, making full use of sophisticated Blender constructs (e.g. B-meshes, geometry modifiers, shader nodes) for diverse, unconstrained shapes, materials, and scenes. This code presents many avenues for further agent and human editing and experimentation via code tweaks or procedural parameters. This medium naturally enables a co-creative loop in our system: agents can automatically self-critique using code and visuals, while iterative user instructions provide an intuitive way to refine assets. A shared code context across agents enables awareness of previous attempts, and a retrieval-augmented generation knowledge base built from Blender API documentation, BlenderRAG, equips agents with examples, types, and functions empowering advanced modeling operations and code correctness. We demonstrate the effectiveness of LL3M across diverse shape categories, style and material edits, and user-driven refinements. Our experiments showcase the power of code as a generative and interpretable medium for 3D asset creation. Our project page is at https://threedle.github.io/ll3m.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 51 of its 66 references that are in the map. First posted on arXiv 11 Aug 2025.
Builds on
51 of 66 references.
References · 51
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024GPT-4o System Cardcited by 4,467
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2023Text-to-3D using Gaussian Splattingcited by 299
38 more
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
- 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
- 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
- 2025CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratingscited by 109
- 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
- 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
- 2023PolyDiff: Generating 3D Polygonal Meshes with Diffusion Modelscited by 66
- 2023GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planningcited by 61
- 20213D Shape Generation with Grid-based Implicit Functionscited by 48
- 2020DECOR-GAN: 3D Shape Detailization by Conditional Refinementcited by 45
- 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
- 2023CG3D: Compositional Generation for Text-to-3D via Gaussian Splattingcited by 42
- 2025TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencingcited by 38
- 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 34
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
- 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
- 2024L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objectscited by 26
- 2023ShapeCoder: Discovering Abstractions for Visual Programs from Unstructured Primitivescited by 22
- 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generationcited by 18
- 2022GeoCode: Interpretable Shape Programscited by 16
- 2024Turbo3D: Ultra-fast Text-to-3D Generationcited by 14
- 2025Geometry in Style: 3D Stylization via Surface Normal Deformationcited by 14
- 2024MagicClay: Sculpting Meshes With Generative Neural Fieldscited by 13
- 2024DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusioncited by 12
- 2024Learning to Edit Visual Programs with Self-Supervisioncited by 7
- 2025TextSplat: Text-Guided Semantic Fusion for Generalizable Gaussian Splattingcited by 6
- 2025OSS-Bench: Benchmark Generator for Coding LLMscited by 6
- 2024PyTorchGeoNodes: Enabling Differentiable Shape Programs for 3D Shape Reconstructioncited by 5
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 13.
18 papers.
Sort:
By area:
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenescited by 39
- 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligencecited by 9
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 9
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 8
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 6
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
- 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesiscited by 5
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creationcited by 4
- 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulationcited by 4
- 20253Dify: a Framework for Procedural 3D-CG Generation Assisted by LLMs Using MCP and RAGcited by 3
- 2025MCP4IFC: IFC-Based Building Design Using Large Language Modelscited by 2
- 2026EZBlender: Efficient 3D Editing with Plan-and-ReAct Agentcited by 2
6 more
- 2026Training-Free Dense Hand Contact Estimation with Multi-Modal Large Language Modelscited by 1
- 20263D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesiscited by 1
- 2025FloraForge: LLM-Assisted Procedural Generation of Editable and Analysis-Ready 3D Plant Geometric Models For Agricultural Applicationscited by 0
- 2026CMAG: Concept-Scaffolded Retrieval for Marketplace Avatar Generationcited by 0
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Modelscited by 0
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstructioncited by 0
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction1 Oct 2026
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Models6 Sep 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulation23 Jul 2026
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation2 Jul 2026
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning9 Jun 2026
- 20263D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesis9 Jun 2026
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code31 May 2026
- 2026CMAG: Concept-Scaffolded Retrieval for Marketplace Avatar Generation18 May 2026
- 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis18 May 2026
- 2026Training-Free Dense Hand Contact Estimation with Multi-Modal Large Language Models7 May 2026
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes9 Feb 2026
6 more
- 2026EZBlender: Efficient 3D Editing with Plan-and-ReAct Agent12 Jan 2026
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3D15 Dec 2025
- 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligence14 Dec 2025
- 2025FloraForge: LLM-Assisted Procedural Generation of Editable and Analysis-Ready 3D Plant Geometric Models For Agricultural Applications11 Dec 2025
- 2025MCP4IFC: IFC-Based Building Design Using Large Language Models29 Oct 2025
- 20253Dify: a Framework for Procedural 3D-CG Generation Assisted by LLMs Using MCP and RAG6 Oct 2025
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenescited by 39
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 9
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
- 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesiscited by 5
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creationcited by 4
- 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulationcited by 4
- 2026EZBlender: Efficient 3D Editing with Plan-and-ReAct Agentcited by 2
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstructioncited by 0
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction1 Oct 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 2026GS-Agent: Creating 4D Physical Worlds With Generative Simulation23 Jul 2026
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation2 Jul 2026
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code31 May 2026
- 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis18 May 2026
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes9 Feb 2026
- 2026EZBlender: Efficient 3D Editing with Plan-and-ReAct Agent12 Jan 2026
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3Dcited by 6
- 20253Dify: a Framework for Procedural 3D-CG Generation Assisted by LLMs Using MCP and RAGcited by 3
- 2025MCP4IFC: IFC-Based Building Design Using Large Language Modelscited by 2
- 20263D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesiscited by 1
- 2025FloraForge: LLM-Assisted Procedural Generation of Editable and Analysis-Ready 3D Plant Geometric Models For Agricultural Applicationscited by 0
- 2026CMAG: Concept-Scaffolded Retrieval for Marketplace Avatar Generationcited by 0
- 20263D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesis9 Jun 2026
- 2026CMAG: Concept-Scaffolded Retrieval for Marketplace Avatar Generation18 May 2026
- 2025Feedforward 3D Editing via Text-Steerable Image-to-3D15 Dec 2025
- 2025FloraForge: LLM-Assisted Procedural Generation of Editable and Analysis-Ready 3D Plant Geometric Models For Agricultural Applications11 Dec 2025
- 2025MCP4IFC: IFC-Based Building Design Using Large Language Models29 Oct 2025
- 20253Dify: a Framework for Procedural 3D-CG Generation Assisted by LLMs Using MCP and RAG6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025ShapeCraft: LLM Agents for Structured, Textured and Interactive 3D Modeling
- 2026ViSculpt: Visual-Centric Agentic Geometry Editing
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds
- 2026Procedura: Agentic 3D Modeling with Procedural Control
- 2025WorldCraft: Photo-Realistic 3D World Creation and Customization via LLM Agents
- 2023Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback
- 2025Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generation