SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledge
Not on the map. Why?
Abstract (arXiv)
Articulated 3D objects are critical for embodied AI, robotics, and interactive scene understanding, yet creating simulation-ready assets remains labor-intensive and requires expert modeling of part hierarchies and motion structures. We introduce SPARK, a framework for reconstructing physically consistent, kinematic part-level articulated objects from a single RGB image. Given an input image, we first leverage VLMs to extract coarse URDF parameters and generate part-level reference images. We then integrate the part-image guidance and the inferred structure graph into a generative diffusion transformer to synthesize consistent part and complete shapes of articulated objects. To further refine the URDF parameters, we incorporate differentiable forward kinematics and differentiable rendering to optimize joint types, axes, and origins under VLM-generated open-state supervision. Extensive experiments show that SPARK produces high-quality, simulation-ready articulated assets across diverse categories, enabling downstream applications such as robotic manipulation and interaction modeling. Project page: https://heyumeng.com/SPARK/index.html.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 53 of its 66 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
53 of 66 references.
References · 53
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
38 more
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
- 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 86
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
- 2023CAGE: Controllable Articulation GEnerationcited by 50
- 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 47
- 2024L3DG: Latent 3D Gaussian Diffusioncited by 42
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
- 2023PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillationcited by 27
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 21
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 20
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2025PartRM: Modeling Part-Level Dynamics with Large Cross-State Reconstruction Modelcited by 15
- 2025PrimitiveAnything: Human-Crafted 3D Primitive Assembly Generation with Auto-Regressive Transformercited by 12
- 2024SDFit: 3D Object Pose and Shape by Fitting a Morphable SDF to a Single Imagecited by 9
- 2024Efficient and Scalable Point Cloud Generation with Sparse Point-Voxel Diffusion Modelscited by 7
- 2024DI-PCG: Diffusion-based Efficient Inverse Procedural Content Generation for High-quality 3D Asset Creationcited by 7
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 5
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 0
- 2026JODA: Composable Joint Dynamics for Articulated Objectscited by 0
- 2026ArticulateArena: A Metric for Articulated Kinematicscited by 0
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026JODA: Composable Joint Dynamics for Articulated Objects11 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026PAct: Part-Decomposed Single-View Articulated Object Generation16 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control
- 2026ArtLLM: Generating Articulated Assets via 3D LLM
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation
- 2025AOMGen: Photoreal, Physics-Consistent Demonstration Generation for Articulated Object Manipulation
- 2026Articulated Object Reconstruction from Rest-State Observation
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Image
- 2025ArtGen: Conditional Generative Modeling of Articulated Objects in Arbitrary Part-Level States