mlsanityData to 7 Oct 2026

Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections

arXiv 2206.08497 ↗First posted 17 Jun 2022cs.GR cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

3D models of manufactured objects are important for populating virtual worlds and for synthetic data generation for vision and robotics. To be most useful, such objects should be articulated: their parts should move when interacted with. While articulated object datasets exist, creating them is labor-intensive. Learning-based prediction of part motions can help, but all existing methods require annotated training data. In this paper, we present an unsupervised approach for discovering articulated motions in a part-segmented 3D shape collection. Our approach is based on a concept we call category closure: any valid articulation of an object's parts should keep the object in the same semantic category (e.g. a chair stays a chair). We operationalize this concept with an algorithm that optimizes a shape's part motion parameters such that it can transform into other shapes in the collection. We evaluate our approach by using it to re-discover part motions from the PartNet-Mobility dataset. For almost all shape categories, our method's predicted motion parameters have low error with respect to ground truth annotations, outperforming two supervised motion prediction methods.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 26 of its 44 references that are in the map. First posted on arXiv 17 Jun 2022.

Builds on

26 of 44 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  4. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  5. 2017End-to-end Recovery of Human Shape and Posecited by 883
  6. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  7. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  8. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  9. 2017Embodied Question Answeringcited by 335
  10. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  11. 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
  12. 2019Category-Level Articulated Object Pose Estimationcited by 158
14 more
  1. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  2. 2017VNect: Real-time 3D Human Pose Estimation with a Single RGB Cameracited by 129
  3. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
  4. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
  5. 2018Detailed Human Avatars from Monocular Videocited by 109
  6. 2017MINOS: Multimodal Indoor Simulator for Navigation in Complex Environmentscited by 66
  7. 2018Deep Part Induction from Articulated Object Pairscited by 66
  8. 2014A Probabilistic Framework for Learning Kinematic Models of Articulated Objectscited by 40
  9. 2018CHALET: Cornell House Agent Learning Environmentcited by 38
  10. 2016Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networkscited by 35
  11. 2020RPM-Net: Recurrent Prediction of Motion and Parts from Point Cloudcited by 26
  12. 2015Learning Articulated Motions From Visual Demonstrationcited by 17
  13. 2021StrobeNet: Category-Level Multiview Reconstruction of Articulated Objectscited by 14
  14. 2021Unsupervised Pose-Aware Part Decomposition for 3D Articulated Objectscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 6; 2024: 1; 2025: 3; 2026: 1.

13 papers.

Sort:

By area: