Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark
Not on the map. Why?
Abstract (arXiv)
In this paper, we study physically grounded articulated 3D asset generation---moving the goal from reproducing how objects look to capturing how they move and function. Inspired by the literature on procedural and agentic generation, we present Artisan, a system that extends the latest method Articraft by introducing a multi-agent pipeline with physical simulation feedback, enabling comprehensive attributes beyond geometry, appearance, and physically plausible articulation, such as collision-free motion, stability under gravity, and accurate mass and material properties. Furthermore, we construct a unified benchmark spanning four key aspects: spatial fidelity, physical plausibility, downstream task performance, and overall quality. The benchmark encompasses 100 reference assets from ArtVIP and LightWheel, 50 stability prompts, and 50 ABO objects with reference masses, with protocols evaluating various metrics. Through extensive evaluation of more than 10 representative models, Artisan achieves competitive spatial fidelity while attaining the lowest collision rates and highest stability rates among the evaluated methods. Together, our system and benchmark establish insights for advancing 3D generation towards physically plausible, functionally usable assets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 64 of its 81 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
64 of 81 references.
References · 64
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
38 more
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 96
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 79
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 69
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2022Approximate Convex Decomposition for 3D Meshes with Collision-Aware Concavity and Tree Searchcited by 67
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 56
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 54
- 2023CAGE: Controllable Articulation GEnerationcited by 52
- 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 48
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
- 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 39
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 30
- 2025REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraintscited by 28
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objectscited by 25
- 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 25
- 2025PUGS: Zero-shot Physical Understanding with Gaussian Splattingcited by 24
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 22
- 2024Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabricationcited by 20
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 19
- 2025Eval3D: Interpretable and Fine-grained Evaluation for 3D Generationcited by 16
- 2025ArtVIP: Articulated Digital Assets of Visual Realism, Modular Interaction, and Physical Fidelity for Robot Learningcited by 16
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 15
- 2024PBR-NeRF: Inverse Rendering with Physics-Based Neural Fieldscited by 13
- 2025Procedural Generation of Articulated Simulation-Ready Assetscited by 11
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
- 2025Hoi! - A Multimodal Dataset for Force-Grounded, Cross-View Articulated Manipulationcited by 10
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objectscited by 9
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 9
50 most cited of 64 All 64 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation
- 2026PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition
- 2026ArtLLM: Generating Articulated Assets via 3D LLM
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World
- 2026CoDimRecon: Agentic Reconstruction of Sim-Ready 3D Scenes with Deformable Curves, Surfaces, and Volumes
- 2025PhysX-3D: Physical-Grounded 3D Asset Generation
- 2026DeformSmith: Physics Harness-Guided Hierarchical Generation of Deformable Assets for Robot Manipulation ↗