mlsanityData to 14 Oct 2026

AutoURDF: Unsupervised Robot Modeling from Point Cloud Frames Using Cluster Registration

arXiv 2412.05507 ↗First posted 7 Dec 2024cs.RO cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Robot description models are essential for simulation and control, yet their creation often requires significant manual effort. To streamline this modeling process, we introduce AutoURDF, an unsupervised approach for constructing description files for unseen robots from point cloud frames. Our method leverages a cluster-based point cloud registration model that tracks the 6-DoF transformations of point clusters. Through analyzing cluster movements, we hierarchically address the following challenges: (1) moving part segmentation, (2) body topology inference, and (3) joint parameter estimation. The complete pipeline produces robot description files that are fully compatible with existing simulators. We validate our method across a variety of robots, using both synthetic and real-world scan data. Results indicate that our approach outperforms previous methods in registration and body topology estimation accuracy, offering a scalable solution for automated robot modeling.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 30 of its 52 references that are in the map. First posted on arXiv 7 Dec 2024.

Builds on

30 of 52 references.

References · 30

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  7. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  8. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  9. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  10. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  11. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  12. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
18 more
  1. 2019Category-Level Articulated Object Pose Estimationcited by 159
  2. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
  3. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
  4. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
  5. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
  6. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
  7. 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
  8. 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
  9. 2021Deep Regression on Manifolds: A 3D Rotation Case Studycited by 67
  10. 2018Deep Part Induction from Articulated Object Pairscited by 66
  11. 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
  12. 2021Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objectscited by 50
  13. 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
  14. 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
  15. 2024Learning with 3D rotations, a hitchhiker's guide to SO(3)cited by 42
  16. 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Cloudscited by 34
  17. 2023FlowBot++: Learning Generalized Articulated Objects Manipulation via Articulation Projectioncited by 34
  18. 2023Teaching Robots to Build Simulations of Themselvescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.