mlsanityData to 7 Oct 2026

ArtiMo: Agent-Driven Articulated Mesh Animation

arXiv 2608.20699 ↗First posted 21 Aug 2026cs.CVcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Animating articulated 3D meshes via text requires satisfying strict kinematic constraints, modeling causal interactions between parts, and achieving instruction fidelity. Due to the absence of task-specific training data and explicit articulation supervision, existing data-driven mesh animation methods are largely inapplicable to this setting. To address this, we propose ArtiMo, a novel agent-driven framework for text-guided articulated mesh animation. Operating in a zero-shot manner, ArtiMo develops an agentic pipeline powered by Large Language and Vision-Language Models (LLMs/VLMs) to orchestrate motion generation. By synergizing the explicit kinematic constraints of URDF with the agent's reasoning and planning capabilities, it effectively produces causally coherent part motions and interactions without requiring model fine-tuning. To ensure motion correctness, the agent additionally utilizes a visual self-improvement mechanism: generated animations are rendered into compact keyframes and motion cues, enabling the VLM to iteratively diagnose and correct errors. Furthermore, we contribute a new benchmark dataset spanning 21 articulated object categories, featuring high-quality motion annotations enriched with causal relationships. Extensive experiments demonstrate that ArtiMo significantly outperforms baselines, particularly on complex, causally driven motions. The project page is available at https://zou-2004.github.io/ArtiMo/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 42 references that are in the map. First posted on arXiv 21 Aug 2026.

Builds on

29 of 42 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AI10 Feb
  2. 2026Vision-as-Inverse-Graphics Agent via Interleaved Multimodal Reasoning16 Jan
  3. 2025IR3D-Bench: Evaluating Vision-Language Model Scene Understanding as Agentic Inverse Rendering29 Jun

Other references · 26

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  4. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  5. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  6. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  7. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  8. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  9. 2020Integrated Task and Motion Planningcited by 281
  10. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  11. 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
  12. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
14 more
  1. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
  2. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
  3. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
  4. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  5. 2022FlowBot3D: Learning 3D Articulation Flow to Manipulate Articulated Objectscited by 91
  6. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
  7. 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 78
  8. 2024Animate3D: Animating Any 3D Model with Multi-view Video Diffusioncited by 55
  9. 2025AnimateAnyMesh: A Feed-Forward 4D Foundation Model for Text-Driven Universal Mesh Animationcited by 31
  10. 2024Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamicscited by 28
  11. 2025BlenderGym: Benchmarking Foundational Model Systems for Graphics Editingcited by 27
  12. 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
  13. 2025ArtVIP: Articulated Digital Assets of Visual Realism, Modular Interaction, and Physical Fidelity for Robot Learningcited by 14
  14. 2023Understanding URDF: A Dataset and Analysiscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image
  2. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation
  3. 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
  4. 2026ArtLLM: Generating Articulated Assets via 3D LLM
  5. 2025ArticFlow: Generative Simulation of Articulated Mechanisms
  6. 2025ArtiBench and ArtiBrain: Benchmarking Generalizable Vision-Language Articulated Object Manipulation
  7. 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control
  8. 2026SMART: Zero-Shot Sim-to-Real Articulated Object Manipulation via Large-Scale Synthetic Pretraining