MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins
Not on the map. Why?
Abstract (arXiv)
Converting static 3D meshes into interactable articulated assets is crucial for embodied AI and robotic simulation. However, existing zero-shot pipelines struggle with complex assets due to a critical lack of physical grounding. Specifically, ungrounded Vision-Language Models (VLMs) frequently suffer from kinematic hallucinations, while unconstrained joint estimation inevitably leads to catastrophic mesh inter-penetration during physical simulation. To bridge this gap, we propose MotionAnymesh, an automated zero-shot framework that seamlessly transforms unstructured static meshes into simulation-ready digital twins. Our method features a kinematic-aware part segmentation module that grounds VLM reasoning with explicit SP4D physical priors, effectively eradicating kinematic hallucinations. Furthermore, we introduce a geometry-physics joint estimation pipeline that combines robust type-aware initialization with physics-constrained trajectory optimization to rigorously guarantee collision-free articulation. Extensive experiments demonstrate that MotionAnymesh significantly outperforms state-of-the-art baselines in both geometric precision and dynamic physical executability, providing highly reliable assets for downstream applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 46 of its 48 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
46 of 48 references.
References · 46
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
- 2019Category-Level Articulated Object Pose Estimationcited by 158
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2019PQ-NET: A Generative Part Seq2Seq Network for 3D Shapescited by 118
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
34 more
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 117
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2019SDM-NET: Deep Generative Network for Structured Deformable Meshcited by 113
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
- 2024Autonomous Character-Scene Interaction Synthesis from Text Instructioncited by 56
- 2024ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactionscited by 54
- 2023CAGE: Controllable Articulation GEnerationcited by 50
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2025P3-SAM: Native 3D Part Segmentationcited by 39
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2023DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusioncited by 32
- 2020DSG-Net: Learning Disentangled Structure and Geometry for 3D Shape Generationcited by 31
- 2025REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraintscited by 27
- 2025Anymate: A Dataset and Baselines for Learning 3D Object Riggingcited by 27
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 21
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 20
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2025PartSAM: A Scalable Promptable Part Segmentation Model Trained on Native 3D Datacited by 15
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledgecited by 6
- 2025Stable Part Diffusion 4D: Multi-View RGB and Kinematic Parts Video Generationcited by 5
- 2024Meta-Objects: Interactive and Multisensory Virtual Objects Learned from the Real World for Use in Augmented Realitycited by 4
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Articulated Object Reconstruction from Rest-State Observation
- 2025ArtGen: Conditional Generative Modeling of Articulated Objects in Arbitrary Part-Level States
- 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation
- 2026Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents
- 2026KitchenTwin: Semantically and Geometrically Grounded 3D Kitchen Digital Twins
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control
- 2026FACT: Fidelity-Aware Construction of Articulated Twins
- 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Engines