AutoURDF: Unsupervised Robot Modeling from Point Cloud Frames Using Cluster Registration
Not on the map. Why?
Abstract (arXiv)
Robot description models are essential for simulation and control, yet their creation often requires significant manual effort. To streamline this modeling process, we introduce AutoURDF, an unsupervised approach for constructing description files for unseen robots from point cloud frames. Our method leverages a cluster-based point cloud registration model that tracks the 6-DoF transformations of point clusters. Through analyzing cluster movements, we hierarchically address the following challenges: (1) moving part segmentation, (2) body topology inference, and (3) joint parameter estimation. The complete pipeline produces robot description files that are fully compatible with existing simulators. We validate our method across a variety of robots, using both synthetic and real-world scan data. Results indicate that our approach outperforms previous methods in registration and body topology estimation accuracy, offering a scalable solution for automated robot modeling.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 30 of its 52 references that are in the map. First posted on arXiv 7 Dec 2024.
Builds on
30 of 52 references.
References · 30
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
18 more
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2021Deep Regression on Manifolds: A 3D Rotation Case Studycited by 67
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2021Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objectscited by 50
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
- 2024Learning with 3D rotations, a hitchhiker's guide to SO(3)cited by 42
- 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Cloudscited by 34
- 2023FlowBot++: Learning Generalized Articulated Objects Manipulation via Articulation Projectioncited by 34
- 2023Teaching Robots to Build Simulations of Themselvescited by 6
Built on by
Citing papers per year: 2025: 4; 2026: 1.
5 papers.
- 2025ScrewSplat: An End-to-End Method for Articulated Object Recognitioncited by 9
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objectscited by 9
- 2025ArticFlow: Generative Simulation of Articulated Mechanismscited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2025PointCNN++: Performant Convolution on Native Pointscited by 0
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2025PointCNN++: Performant Convolution on Native Points28 Nov 2025
- 2025ArticFlow: Generative Simulation of Articulated Mechanisms22 Nov 2025
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objects3 Nov 2025
- 2025ScrewSplat: An End-to-End Method for Articulated Object Recognition4 Aug 2025