You Only Estimate Once: Unified, One-stage, Real-Time Category-level Articulated Object 6D Pose Estimation for Robotic Grasping
Not on the map. Why?
Abstract (arXiv)
This paper addresses the problem of category-level pose estimation for articulated objects in robotic manipulation tasks. Recent works have shown promising results in estimating part pose and size at the category level. However, these approaches primarily follow a complex multi-stage pipeline that first segments part instances in the point cloud and then estimates the Normalized Part Coordinate Space (NPCS) representation for 6D poses. These approaches suffer from high computational costs and low performance in real-time robotic tasks. To address these limitations, we propose YOEO, a single-stage method that simultaneously outputs instance segmentation and NPCS representations in an end-to-end manner. We use a unified network to generate point-wise semantic labels and centroid offsets, allowing points from the same part instance to vote for the same centroid. We further utilize a clustering algorithm to distinguish points based on their estimated centroid distances. Finally, we first separate the NPCS region of each instance. Then, we align the separated regions with the real point cloud to recover the final pose and size. Experimental results on the GAPart dataset demonstrate the pose estimation capabilities of our proposed single-shot method. We also deploy our synthetically-trained model in a real-world setting, providing real-time visual feedback at 200Hz, enabling a physical Kinova robot to interact with unseen articulated objects. This showcases the utility and effectiveness of our proposed method.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 41 of its 47 references that are in the map. First posted on arXiv 6 Jun 2025.
Builds on
41 of 47 references.
References · 41
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 585
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
29 more
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
- 20183D-SIS: 3D Semantic Instance Segmentation of RGB-D Scanscited by 217
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2017SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentationcited by 169
- 2020Shape Prior Deformation for Categorical 6D Object Pose and Size Estimationcited by 161
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 48
- 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
- 2019VoteNet: A Deep Learning Label Fusion Method for Multi-Atlas Segmentationcited by 44
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2021GarmentNets: Category-Level Pose Estimation for Garments via Canonical Space Shape Completioncited by 43
- 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
- 2022PartAfford: Part-level Affordance Discovery from 3D Objectscited by 36
- 2022Learning 6-DoF Object Poses to Grasp Category-level Objects by Language Instructionscited by 19
- 2023GarmentTracking: Category-Level Garment Pose Trackingcited by 16
- 2022Self-supervised Transparent Liquid Segmentation for Robotic Pouringcited by 10
- 2022AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentationcited by 10
- 2023PourIt!: Weakly-supervised Liquid Perception from a Single Image for Visual Closed-Loop Robotic Pouringcited by 10
- 2023WALL-E: Embodied Robotic WAiter Load Lifting with Large Language Modelcited by 6
- 2024Polaris: Open-ended Interactive Robotic Manipulation via Syn2Real Visual Grounding and Large Language Modelscited by 6
- 2022I Know What You Draw: Learning Grasp Detection Conditioned on a Few Freehand Sketchescited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.