Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections
Not on the map. Why?
Abstract (arXiv)
3D models of manufactured objects are important for populating virtual worlds and for synthetic data generation for vision and robotics. To be most useful, such objects should be articulated: their parts should move when interacted with. While articulated object datasets exist, creating them is labor-intensive. Learning-based prediction of part motions can help, but all existing methods require annotated training data. In this paper, we present an unsupervised approach for discovering articulated motions in a part-segmented 3D shape collection. Our approach is based on a concept we call category closure: any valid articulation of an object's parts should keep the object in the same semantic category (e.g. a chair stays a chair). We operationalize this concept with an algorithm that optimizes a shape's part motion parameters such that it can transform into other shapes in the collection. We evaluate our approach by using it to re-discover part motions from the PartNet-Mobility dataset. For almost all shape categories, our method's predicted motion parameters have low error with respect to ground truth annotations, outperforming two supervised motion prediction methods.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 17 Jun 2022.
Builds on
26 of 44 references.
References · 26
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2017Embodied Question Answeringcited by 335
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
- 2019Category-Level Articulated Object Pose Estimationcited by 158
14 more
- 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
- 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2018Detailed Human Avatars from Monocular Videocited by 109
- 2017MINOS: Multimodal Indoor Simulator for Navigation in Complex Environmentscited by 66
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2014A Probabilistic Framework for Learning Kinematic Models of Articulated Objectscited by 40
- 2018CHALET: Cornell House Agent Learning Environmentcited by 38
- 2016Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networkscited by 35
- 2020RPM-Net: Recurrent Prediction of Motion and Parts from Point Cloudcited by 26
- 2015Learning Articulated Motions From Visual Demonstrationcited by 17
- 2021StrobeNet: Category-Level Multiview Reconstruction of Articulated Objectscited by 14
- 2021Unsupervised Pose-Aware Part Decomposition for 3D Articulated Objectscited by 12
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 1; 2025: 3; 2026: 1.
13 papers.
Sort:
By area:
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 117
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2023ZeroPS: High-quality Cross-modal Knowledge Transfer for Zero-Shot 3D Part Segmentationcited by 18
- 2023Semi-Weakly Supervised Object Kinematic Motion Predictioncited by 14
- 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactionscited by 3
- 2022Mates2Motion: Learning How Mechanical CAD Assemblies Workcited by 2
1 more
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactions26 Mar 2026
- 2025ART: Articulated Reconstruction Transformer16 Dec 2025
- 2025LARM: A Large Articulated-Object Reconstruction Model14 Nov 2025
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion29 Oct 2025
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objects27 Sep 2024
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimation5 Dec 2023
- 2023ZeroPS: High-quality Cross-modal Knowledge Transfer for Zero-Shot 3D Part Segmentation24 Nov 2023
- 2023NAP: Neural 3D Articulation Prior25 May 2023
- 2023Semi-Weakly Supervised Object Kinematic Motion Prediction31 Mar 2023
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objects28 Mar 2023
- 2023CA2T-Net: Category-Agnostic 3D Articulation Transfer from Single Image5 Jan 2023
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Models3 Dec 2022
1 more
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 117
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2023ZeroPS: High-quality Cross-modal Knowledge Transfer for Zero-Shot 3D Part Segmentationcited by 18
- 2023Semi-Weakly Supervised Object Kinematic Motion Predictioncited by 14
- 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactionscited by 3
- 2022Mates2Motion: Learning How Mechanical CAD Assemblies Workcited by 2
- 2023CA2T-Net: Category-Agnostic 3D Articulation Transfer from Single Imagecited by 2
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactions26 Mar 2026
- 2025ART: Articulated Reconstruction Transformer16 Dec 2025
- 2025LARM: A Large Articulated-Object Reconstruction Model14 Nov 2025
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objects27 Sep 2024
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimation5 Dec 2023
- 2023ZeroPS: High-quality Cross-modal Knowledge Transfer for Zero-Shot 3D Part Segmentation24 Nov 2023
- 2023NAP: Neural 3D Articulation Prior25 May 2023
- 2023Semi-Weakly Supervised Object Kinematic Motion Prediction31 Mar 2023
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objects28 Mar 2023
- 2023CA2T-Net: Category-Agnostic 3D Articulation Transfer from Single Image5 Jan 2023
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Models3 Dec 2022
- 2022Mates2Motion: Learning How Mechanical CAD Assemblies Work2 Aug 2022