Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Reconstructing articulated 3D objects is important for animation, gaming, and robotic simulations. Recent neural networks can estimate the articulated structure of 3D objects, but their generalization remains limited by the scarcity of annotated data for this task. To address this gap, we introduce Instruct-Particulate, a model that takes a 3D mesh together with a target kinematic specification, including part descriptions, connectivity, joint types, and optional point prompts, and predicts the corresponding kinematic part segmentation and joint motion parameters. The kinematic specification disambiguates the task and allows the model to target annotations of different granularity, thereby making it possible to use more abundant heterogeneous training data. At test time, the kinematic specification can be obtained automatically from large-scale vision-language models, so the model can be applied to any input mesh. To train our model at scale, we construct a heterogeneous dataset of more than 150,000 articulated 3D objects, extending existing publicly available collections with data obtained by partially labelling other 3D models (monolithic or already decomposed into parts) with kinematic labels by means of vision-language models. Experiments show that our model generalizes better across categories and to AI-generated meshes, enabling articulated asset reconstruction from real-world images via image-to-3D models.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 76 of its 83 references that are in the map. First posted on arXiv 12 Jun 2026.
Builds on
76 of 83 references.
Closest ancestors · 1
Same direction, newest first
Other references · 75
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
38 more
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 95
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2024Learning the 3D Fauna of the Webcited by 59
- 2024GRUtopia: Dream General Robots in a City at Scalecited by 59
- 2022Self-supervised Neural Articulated Shape and Appearance Modelscited by 51
- 2025RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assetscited by 47
- 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
- 2025P3-SAM: Native 3D Part Segmentationcited by 43
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
- 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 38
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
- 2024Segment Any Meshcited by 37
50 most cited of 75 All 75 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Visual General Intelligence: A White Papercited by 1
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstructioncited by 0
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmarkcited by 0
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inferencecited by 0
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction1 Oct 2026
- 2026Visual General Intelligence: A White Paper26 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Model
- 2026Articulated Object Reconstruction from Rest-State Observation
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning
- 2025ArtGen: Conditional Generative Modeling of Articulated Objects in Arbitrary Part-Level States
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledge
- 2023CAGE: Controllable Articulation GEneration