mlsanityData to 14 Oct 2026

Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control

arXiv 2606.14699 ↗First posted 12 Jun 2026cs.CV cs.GR cs.ROcited by 4

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Reconstructing articulated 3D objects is important for animation, gaming, and robotic simulations. Recent neural networks can estimate the articulated structure of 3D objects, but their generalization remains limited by the scarcity of annotated data for this task. To address this gap, we introduce Instruct-Particulate, a model that takes a 3D mesh together with a target kinematic specification, including part descriptions, connectivity, joint types, and optional point prompts, and predicts the corresponding kinematic part segmentation and joint motion parameters. The kinematic specification disambiguates the task and allows the model to target annotations of different granularity, thereby making it possible to use more abundant heterogeneous training data. At test time, the kinematic specification can be obtained automatically from large-scale vision-language models, so the model can be applied to any input mesh. To train our model at scale, we construct a heterogeneous dataset of more than 150,000 articulated 3D objects, extending existing publicly available collections with data obtained by partially labelling other 3D models (monolithic or already decomposed into parts) with kinematic labels by means of vision-language models. Experiments show that our model generalizes better across categories and to AI-generated meshes, enabling articulated asset reconstruction from real-world images via image-to-3D models.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 76 of its 83 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

76 of 83 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Model2 Nov

Other references · 75

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023Segment Anythingcited by 8,234
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  7. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  8. 2025Qwen3-VL Technical Reportcited by 2,793
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  10. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  11. 2021Grounded Language-Image Pre-trainingcited by 1,156
  12. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
38 more
  1. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  2. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  3. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  4. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
  5. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  6. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  7. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  8. 2025Native and Compact Structured Latents for 3D Generationcited by 175
  9. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  10. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
  11. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
  12. 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
  13. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
  14. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
  15. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
  16. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
  17. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
  18. 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 95
  19. 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
  20. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
  21. 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
  22. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
  23. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  24. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  25. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
  26. 2024Learning the 3D Fauna of the Webcited by 59
  27. 2024GRUtopia: Dream General Robots in a City at Scalecited by 59
  28. 2022Self-supervised Neural Articulated Shape and Appearance Modelscited by 51
  29. 2025RigAnything: Template-Free Autoregressive Rigging for Diverse 3D Assetscited by 47
  30. 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
  31. 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
  32. 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
  33. 2025P3-SAM: Native 3D Part Segmentationcited by 43
  34. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
  35. 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
  36. 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 38
  37. 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
  38. 2024Segment Any Meshcited by 37

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Model
  2. 2026Articulated Object Reconstruction from Rest-State Observation
  3. 2026PWM-ArtGen: Part World Model for Articulated Object Generation
  4. 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning
  5. 2025ArtGen: Conditional Generative Modeling of Articulated Objects in Arbitrary Part-Level States
  6. 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects
  7. 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledge
  8. 2023CAGE: Controllable Articulation GEneration