Towards Real-World Category-level Articulation Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Human life is populated with articulated objects. Current Category-level Articulation Pose Estimation (CAPE) methods are studied under the single-instance setting with a fixed kinematic structure for each category. Considering these limitations, we reform this problem setting for real-world environments and suggest a CAPE-Real (CAPER) task setting. This setting allows varied kinematic structures within a semantic category, and multiple instances to co-exist in an observation of real world. To support this task, we build an articulated model repository ReArt-48 and present an efficient dataset generation pipeline, which contains Fast Articulated Object Modeling (FAOM) and Semi-Authentic MixEd Reality Technique (SAMERT). Accompanying the pipeline, we build a large-scale mixed reality dataset ReArtMix and a real world dataset ReArtVal. We also propose an effective framework ReArtNOCS that exploits RGB-D input to estimate part-level pose for multiple instances in a single forward pass. Extensive experiments demonstrate that the proposed ReArtNOCS can achieve good performance on both CAPER and CAPE settings. We believe it could serve as a strong baseline for future research on the CAPER task.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 7 May 2021.
Builds on
17 of 21 references.
References · 17
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2019Category-Level Articulated Object Pose Estimationcited by 158
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
- 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
- 20196-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypointscited by 78
- 2018Deep Part Induction from Articulated Object Pairscited by 66
5 more
- 2018The RBO Dataset of Articulated Objects and Interactionscited by 34
- 2017LabelFusion: A Pipeline for Generating Ground Truth Labels for Real RGBD Data of Cluttered Scenescited by 32
- 2020Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimationcited by 25
- 2018Applying Domain Randomization to Synthetic Data for Object Category Detectioncited by 9
- 2020CPS++: Improving Class-level 6D Pose and Shape Estimation From Monocular Images With Self-Supervised Learningcited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 6; 2024: 8; 2025: 15; 2026: 6.
39 papers.
Sort:
By area:
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 81
- 2021ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesiscited by 76
- 2022Full-Body Articulated Human-Object Interactioncited by 76
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2023Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariancecited by 26
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
27 more
- 2023Challenges for Monocular 6D Object Pose Estimation in Roboticscited by 21
- 2023ContactArt: Learning 3D Interaction Priors for Category-level Articulated Object and Hand Poses Estimationcited by 16
- 2023GarmentTracking: Category-Level Garment Pose Trackingcited by 15
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
- 2024CAPT: Category-level Articulation Estimation from a Single Point Cloud Using Transformercited by 11
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2023RoSI: Recovering 3D Shape Interiors from Few Articulation Imagescited by 6
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videoscited by 6
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglementcited by 6
- 2024RPMArt: Towards Robust Perception and Manipulation for Articulated Objectscited by 5
- 2024Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objectscited by 5
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Imagecited by 5
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2024Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Trackercited by 3
- 2025You Only Estimate Once: Unified, One-stage, Real-Time Category-level Articulated Object 6D Pose Estimation for Robotic Graspingcited by 3
- 2023CA2T-Net: Category-Agnostic 3D Articulation Transfer from Single Imagecited by 2
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spacescited by 2
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposalscited by 1
- 2025KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generationcited by 0
- 2025Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objectscited by 0
- 2025Exploring Category-level Articulated Object Pose Tracking on SE(3) Manifoldscited by 0
- 2025ArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objectscited by 0
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verificationcited by 0
- 2026Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimationcited by 0
- 2026Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimation22 Jun 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement3 Mar 2026
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposals26 Feb 2026
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces23 Feb 2026
- 2025ART: Articulated Reconstruction Transformer16 Dec 2025
- 2025LARM: A Large Articulated-Object Reconstruction Model14 Nov 2025
- 2025ArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objects9 Nov 2025
- 2025Exploring Category-level Articulated Object Pose Tracking on SE(3) Manifolds8 Nov 2025
- 2025Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objects7 Nov 2025
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion29 Oct 2025
27 more
- 2025KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generation20 Oct 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction15 Sep 2025
- 2025PhysX-3D: Physical-Grounded 3D Asset Generation16 Jul 2025
- 2025You Only Estimate Once: Unified, One-stage, Real-Time Category-level Articulated Object 6D Pose Estimation for Robotic Grasping6 Jun 2025
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videos17 May 2025
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image15 Apr 2025
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting26 Feb 2025
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling4 Feb 2025
- 2024Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objects18 Sep 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesis24 Jun 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024RPMArt: Towards Robust Perception and Manipulation for Articulated Objects24 Mar 2024
- 2024Survey on Modeling of Human-made Articulated Objects22 Mar 2024
- 2024CAPT: Category-level Articulation Estimation from a Single Point Cloud Using Transformer27 Feb 2024
- 2024Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker9 Jan 2024
- 2023Challenges for Monocular 6D Object Pose Estimation in Robotics22 Jul 2023
- 2023ContactArt: Learning 3D Interaction Priors for Category-level Articulated Object and Hand Poses Estimation2 May 2023
- 2023RoSI: Recovering 3D Shape Interiors from Few Articulation Images13 Apr 2023
- 2023GarmentTracking: Category-Level Garment Pose Tracking24 Mar 2023
- 2023Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariance28 Feb 2023
- 2023CA2T-Net: Category-Agnostic 3D Articulation Transfer from Single Image5 Jan 2023
- 2022Full-Body Articulated Human-Object Interaction20 Dec 2022
- 2022Understanding 3D Object Articulation in Internet Videos30 Mar 2022
- 2022AKB-48: A Real-World Articulated Object Knowledge Base17 Feb 2022
- 2021ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis12 Sep 2021
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spacescited by 2
- 2026Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimationcited by 0
- 2026Flow6D: Discrete-to-Continuous Flow Matching for Efficient and Accurate Category-Level 6D Pose Estimation22 Jun 2026
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces23 Feb 2026
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion29 Oct 2025
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 81
- 2021ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesiscited by 76
- 2022Full-Body Articulated Human-Object Interactioncited by 76
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2023Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariancecited by 26
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2023Challenges for Monocular 6D Object Pose Estimation in Roboticscited by 21
12 most cited of 36 All 36 (JSON)
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement3 Mar 2026
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposals26 Feb 2026
- 2025ART: Articulated Reconstruction Transformer16 Dec 2025
- 2025LARM: A Large Articulated-Object Reconstruction Model14 Nov 2025
- 2025ArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objects9 Nov 2025
- 2025Exploring Category-level Articulated Object Pose Tracking on SE(3) Manifolds8 Nov 2025
- 2025Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objects7 Nov 2025
- 2025KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generation20 Oct 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction15 Sep 2025
12 newest of 36 All 36 (JSON)