Articraft: An Agentic System for Scalable Articulated 3D Asset Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
A bottleneck in learning to understand articulated 3D objects is the lack of large and diverse datasets. In this paper, we propose to leverage large language models (LLMs) to close this gap and generate articulated assets at scale. We reduce the problem of generating an articulated 3D asset to that of writing a program that builds it. We then introduce a new agentic system, Articraft, that writes such programs automatically. We design a programmatic interface and harness to help the LLM do so effectively. The LLM writes code against a domain-specific SDK for defining parts, composing geometry, specifying joints, and writing tests to validate the resulting assets. The harness exposes a restricted workspace and interface to the LLM, validates the resulting assets, and returns structured feedback. In this way, the LLM is not distracted by details such as authoring a URDF file or managing a complex software environment. We show that this produces higher-quality assets than both state-of-the-art articulated-asset generators and general-purpose coding agents. Using Articraft, we build Articraft-10K, a curated dataset of over 10K articulated assets spanning 245 categories, and show its utility both for training models of articulated assets and in downstream applications such as robotics simulation and virtual reality.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 68 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
43 of 68 references.
Closest ancestors · 1
Same direction, newest first
Other references · 42
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2022PAL: Program-aided Language Modelscited by 635
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
30 more
- 2019Category-Level Articulated Object Pose Estimationcited by 158
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 81
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
- 2024GRUtopia: Dream General Robots in a City at Scalecited by 54
- 2025CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Rewardcited by 53
- 2023CAGE: Controllable Articulation GEnerationcited by 50
- 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
- 2024MatSynth: A Modern PBR Materials Datasetcited by 42
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
- 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 32
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 21
- 2025LiteReality: Graphics-Ready 3D Scene Reconstruction from RGB-D Scanscited by 21
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 20
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
- 2024Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materialscited by 17
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
Built on by
Citing papers per year: 2026: 25.
25 papers.
Sort:
By area:
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 9
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 8
- 2026Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agentscited by 6
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 2
- 2026Sequential Planning via Anchored Robotic Keypointscited by 2
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
- 2026Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interactioncited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2026Procedura: Agentic 3D Modeling with Procedural Controlcited by 1
- 2026Visual General Intelligence: A White Papercited by 0
- 2026UniMate: One Unified Model to Animate Diverse Skeletonscited by 0
13 more
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026KaiNinja: Extending Native 3D Generators to the Part Levelcited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulationcited by 0
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videoscited by 0
- 2026VPTwin: Real-Sim-Real Video Prediction for Robotic Manipulation Planningcited by 0
- 2026ArticulateArena: A Metric for Articulated Kinematicscited by 0
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstructioncited by 0
- 2026FACT: Fidelity-Aware Construction of Articulated Twinscited by 0
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstructioncited by 0
- 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policiescited by 0
- 2026GATOR: Generative and Agentic 3D Object Reconstruction From Casual Imagescited by 0
- 2026LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homescited by 0
- 2026LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes8 Oct 2026
- 2026GATOR: Generative and Agentic 3D Object Reconstruction From Casual Images8 Oct 2026
- 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policies7 Oct 2026
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction1 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction28 Sep 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026VPTwin: Real-Sim-Real Video Prediction for Robotic Manipulation Planning27 Sep 2026
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos21 Sep 2026
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulation19 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
13 more
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026UniMate: One Unified Model to Animate Diverse Skeletons4 Sep 2026
- 2026Procedura: Agentic 3D Modeling with Procedural Control26 Aug 2026
- 2026Visual General Intelligence: A White Paper26 Aug 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction19 Aug 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 2026Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents21 Jul 2026
- 2026Sequential Planning via Anchored Robotic Keypoints29 Jun 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning9 Jun 2026
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code31 May 2026
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 9
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
- 2026Procedura: Agentic 3D Modeling with Procedural Controlcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulationcited by 0
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstructioncited by 0
- 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policiescited by 0
- 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policies7 Oct 2026
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction1 Oct 2026
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulation19 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Procedura: Agentic 3D Modeling with Procedural Control26 Aug 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code31 May 2026
- 2026Sequential Planning via Anchored Robotic Keypointscited by 2
- 2026Sequential Planning via Anchored Robotic Keypoints29 Jun 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
- 2026Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interactioncited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2026Visual General Intelligence: A White Papercited by 0
- 2026UniMate: One Unified Model to Animate Diverse Skeletonscited by 0
- 2026KaiNinja: Extending Native 3D Generators to the Part Levelcited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videoscited by 0
- 2026ArticulateArena: A Metric for Articulated Kinematicscited by 0
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstructioncited by 0
- 2026FACT: Fidelity-Aware Construction of Articulated Twinscited by 0
- 2026GATOR: Generative and Agentic 3D Object Reconstruction From Casual Imagescited by 0
12 most cited of 13 All 13 (JSON)
- 2026LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes8 Oct 2026
- 2026GATOR: Generative and Agentic 3D Object Reconstruction From Casual Images8 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction28 Sep 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos21 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026UniMate: One Unified Model to Animate Diverse Skeletons4 Sep 2026
- 2026Visual General Intelligence: A White Paper26 Aug 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction19 Aug 2026
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025LL3M: Large Language 3D Modelers
- 2026ArtLLM: Generating Articulated Assets via 3D LLM
- 2025ShapeCraft: LLM Agents for Structured, Textured and Interactive 3D Modeling
- 2026ArtiMo: Agent-Driven Articulated Mesh Animation
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
- 2024L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objects
- 2026NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generation
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code