GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects
Not on the map. Why?
Abstract (arXiv)
Reconstructing articulated objects is essential for building digital twins of interactive environments. However, prior methods typically decouple geometry and motion by first reconstructing object shape in distinct states and then estimating articulation through post-hoc alignment. This separation complicates the reconstruction pipeline and restricts scalability, especially for objects with complex, multi-part articulation. We introduce a unified representation that jointly models geometry and motion using articulated 3D Gaussians. This formulation improves robustness in motion decomposition and supports articulated objects with up to 20 parts, significantly outperforming prior approaches that often struggle beyond 2--3 parts due to brittle initialization. To systematically assess scalability and generalization, we propose MPArt-90, a new benchmark consisting of 90 articulated objects across 20 categories, each with diverse part counts and motion configurations. Extensive experiments show that our method consistently achieves superior accuracy in part-level geometry reconstruction and motion estimation across a broad range of object types. We further demonstrate applicability to downstream tasks such as robotic simulation and human-scene interaction modeling, highlighting the potential of unified articulated representations in scalable physical modeling.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 71 of its 92 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
71 of 92 references.
References · 71
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2020Neural Sparse Voxel Fieldscited by 959
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
38 more
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2023Segment Any 3D Gaussianscited by 161
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2023GART: Gaussian Articulated Template Modelscited by 121
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
- 20173D-PRNN: Generating Shape Primitives with Recurrent Neural Networkscited by 77
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 69
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2024Representing Long Volumetric Video with Temporal Gaussian Hierarchycited by 58
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 56
- 2022OPD: Single-view 3D Openable Part Detectioncited by 54
- 2024SA-GS: Scale-Adaptive Gaussian Splatting for Training-Free Anti-Aliasingcited by 41
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 39
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2024Spectrally Pruned Gaussian Fields with Neural Compensationcited by 33
- 2023Jigsaw: Learning to Assemble Multiple Fractured Objectscited by 29
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
- 2025REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraintscited by 28
- 2020RPM-Net: Recurrent Prediction of Motion and Parts from Point Cloudcited by 26
- 2024GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyondcited by 25
- 2024ZeroHSI: Zero-Shot 4D Human-Scene Interaction by Video Generationcited by 25
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 13.
17 papers.
Sort:
By area:
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 10
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objectscited by 9
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generationcited by 8
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledgecited by 7
- 2025REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splattingcited by 5
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 2
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splattingcited by 1
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamicscited by 1
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Viewscited by 1
5 more
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuationcited by 0
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Imagecited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
- 2026Track2Art: Articulated Object Model Recovery with Visual-Geometric Track Representationscited by 0
- 2026Track2Art: Articulated Object Model Recovery with Visual-Geometric Track Representations23 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformation26 May 2026
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views23 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generation13 Apr 2026
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting9 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
5 more
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledge1 Dec 2025
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulation26 Nov 2025
- 2025REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splatting21 Nov 2025
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objects3 Nov 2025
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 10
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objectscited by 9
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledgecited by 7
- 2025REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splattingcited by 5
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 2
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splattingcited by 1
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamicscited by 1
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Viewscited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
12 most cited of 16 All 16 (JSON)
- 2026Track2Art: Articulated Object Model Recovery with Visual-Geometric Track Representations23 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformation26 May 2026
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views23 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting9 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
12 newest of 16 All 16 (JSON)