mlsanityData to 7 Oct 2026

Articraft: An Agentic System for Scalable Articulated 3D Asset Generation

arXiv 2605.15187 ↗First posted 14 May 2026cs.CV cs.GR cs.ROcited by 25

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

A bottleneck in learning to understand articulated 3D objects is the lack of large and diverse datasets. In this paper, we propose to leverage large language models (LLMs) to close this gap and generate articulated assets at scale. We reduce the problem of generating an articulated 3D asset to that of writing a program that builds it. We then introduce a new agentic system, Articraft, that writes such programs automatically. We design a programmatic interface and harness to help the LLM do so effectively. The LLM writes code against a domain-specific SDK for defining parts, composing geometry, specifying joints, and writing tests to validate the resulting assets. The harness exposes a restricted workspace and interface to the LLM, validates the resulting assets, and returns structured feedback. In this way, the LLM is not distracted by details such as authoring a URDF file or managing a complex software environment. We show that this produces higher-quality assets than both state-of-the-art articulated-asset generators and general-purpose coding agents. Using Articraft, we build Articraft-10K, a curated dataset of over 10K articulated assets spanning 245 categories, and show its utility both for training models of articulated assets and in downstream applications such as robotics simulation and virtual reality.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 68 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

43 of 68 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generation13 Apr

Other references · 42

  1. 2020Denoising Diffusion Implicit Modelscited by 9,655
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  7. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  9. 2022PAL: Program-aided Language Modelscited by 635
  10. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  11. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  12. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
30 more
  1. 2019Category-Level Articulated Object Pose Estimationcited by 158
  2. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
  3. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
  4. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
  5. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
  6. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
  7. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
  8. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  9. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
  10. 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
  11. 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 81
  12. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
  13. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
  14. 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
  15. 2024GRUtopia: Dream General Robots in a City at Scalecited by 54
  16. 2025CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Rewardcited by 53
  17. 2023CAGE: Controllable Articulation GEnerationcited by 50
  18. 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
  19. 2024MatSynth: A Modern PBR Materials Datasetcited by 42
  20. 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
  21. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
  22. 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
  23. 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 32
  24. 2023NAP: Neural 3D Articulation Priorcited by 25
  25. 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 21
  26. 2025LiteReality: Graphics-Ready 3D Scene Reconstruction from RGB-D Scanscited by 21
  27. 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 20
  28. 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
  29. 2024Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materialscited by 17
  30. 2024Survey on Modeling of Human-made Articulated Objectscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 25.

25 papers.

Sort:

By area:

  1. 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 9
  2. 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 8
  3. 2026Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agentscited by 6
  4. 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
  5. 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 2
  6. 2026Sequential Planning via Anchored Robotic Keypointscited by 2
  7. 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
  8. 2026Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interactioncited by 1
  9. 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
  10. 2026Procedura: Agentic 3D Modeling with Procedural Controlcited by 1
  11. 2026Visual General Intelligence: A White Papercited by 0
  12. 2026UniMate: One Unified Model to Animate Diverse Skeletonscited by 0
13 more
  1. 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
  2. 2026KaiNinja: Extending Native 3D Generators to the Part Levelcited by 0
  3. 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
  4. 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulationcited by 0
  5. 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videoscited by 0
  6. 2026VPTwin: Real-Sim-Real Video Prediction for Robotic Manipulation Planningcited by 0
  7. 2026ArticulateArena: A Metric for Articulated Kinematicscited by 0
  8. 2026LEGO-Anything: Coding Agents for 3D Scene Reconstructioncited by 0
  9. 2026FACT: Fidelity-Aware Construction of Articulated Twinscited by 0
  10. 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstructioncited by 0
  11. 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policiescited by 0
  12. 2026GATOR: Generative and Agentic 3D Object Reconstruction From Casual Imagescited by 0
  13. 2026LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025LL3M: Large Language 3D Modelers
  2. 2026ArtLLM: Generating Articulated Assets via 3D LLM
  3. 2025ShapeCraft: LLM Agents for Structured, Textured and Interactive 3D Modeling
  4. 2026ArtiMo: Agent-Driven Articulated Mesh Animation
  5. 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
  6. 2024L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objects
  7. 2026NaLA: A 3D Native LLM Layout Agent for High-quality 3D Scene Generation
  8. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code