aDSL: Agentic 3D Creation via Joint Agent-Program Design
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Programmatic representations provide a compelling paradigm for 3D content creation, enabling fine-grained edits, interpretability, and explicit structural control. Yet, agentic workflows that rely on large language models (LLMs) to author 3D programs remain brittle, often failing to translate high-level intent into consistent low-level geometry. We attribute this fragility to a mismatch between existing programmatic interfaces and the reasoning strengths of LLMs, which favor semantic structure and spatial relations over fragile numeric choices. In this paper, we jointly design an Agent-centric Domain-Specific Language (aDSL) and a role-specialized multi-agent system to close this gap. aDSL bridges semantic logic and geometric constraints by emphasizing composability and spatial reasoning; it enables agents to manipulate geometry through relational operators instead of brittle absolute coordinates. Building on aDSL, our training-free multi-agent system follows a Plan-Execute-Critic loop to decompose requests, synthesize code, and iteratively repair errors and constraint violations using execution feedback. Experiments show that this co-design improves robustness, controllability, and faithfulness to user intent. Our method outperforms prior LLM-based baselines on text-to-shape and image-to-shape tasks while preserving explicit structure, editability, and interpretability. It also enables downstream applications such as articulated object creation and structured scene composition. Our code is available at https://github.com/sig-pku/aDSL.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 45 of its 108 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
45 of 108 references.
Closest ancestors · 1
Same direction, newest first
Other references · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
32 more
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2023Scalable 3D Captioning with Pretrained Modelscited by 203
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 147
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 118
- 2017CSGNet: Neural Shape Parser for Constructive Solid Geometrycited by 106
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 93
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
- 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 91
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 89
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2020UCSG-Net -- Unsupervised Discovering of Constructive Solid Geometry Treecited by 78
- 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 44
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2021Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured Sequencescited by 39
- 2024Img2CAD: Conditioned 3D CAD Model Generation from Single Image with Structured Visual Geometrycited by 37
- 2024The Scene Language: Representing Scenes with Programs, Words, and Embeddingscited by 36
- 2025OctGPT: Octree-based Multiscale Autoregressive Models for 3D Shape Generationcited by 30
- 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvementcited by 29
- 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Citiescited by 22
- 20243D-PreMise: Can Large Language Models Generate 3D Shapes with Sharp Features and Parametric Control?cited by 21
- 2025Efficient Autoregressive Shape Generation via Octree-Based Adaptive Tokenizationcited by 13
- 2025A Solver-Aided Hierarchical Language for LLM-Driven CAD Designcited by 10
- 2025Procedural Scene Programs for Open-Universe Scene Generation: LLM-Free Error Correction via Program Searchcited by 10
- 2025CAD-Coder:Text-Guided CAD Files Code Generationcited by 9
- 2025SpaceControl: Introducing Test-Time Spatial Control to 3D Generative Modelingcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generation
- 2025Visual Agentic AI for Spatial Reasoning with a Dynamic API
- 2026ViSculpt: Visual-Centric Agentic Geometry Editing
- 2026Socratic-Geo: Synthetic Data Generation and Geometric Reasoning via Multi-Agent Interaction
- 2026Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interaction
- 2026WorldAgent: Verification-Guided Agentic Physical World Construction
- 2026Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes
- 2026MUSE: Agentic 3D Scene Authoring via Memory-Grounded Incremental Requirement Satisfaction