AKB-48: A Real-World Articulated Object Knowledge Base
Not on the map. Why?
Abstract (arXiv)
Human life is populated with articulated objects. A comprehensive understanding of articulated objects, namely appearance, structure, physics property, and semantics, will benefit many research communities. As current articulated object understanding solutions are usually based on synthetic object dataset with CAD models without physics properties, which prevent satisfied generalization from simulation to real-world applications in visual and robotics tasks. To bridge the gap, we present AKB-48: a large-scale Articulated object Knowledge Base which consists of 2,037 real-world 3D articulated object models of 48 categories. Each object is described by a knowledge graph ArtiKG. To build the AKB-48, we present a fast articulation knowledge modeling (FArM) pipeline, which can fulfill the ArtiKG for an articulated object within 10-15 minutes, and largely reduce the cost for object modeling in the real world. Using our dataset, we propose AKBNet, a novel integral pipeline for Category-level Visual Articulation Manipulation (C-VAM) task, in which we benchmark three sub-tasks, namely pose estimation, object reconstruction and manipulation. Dataset, codes, and models will be publicly available at https://liuliu66.github.io/articulationobjects/.
Key facts. Cited by 82 papers in the map (data through 14 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 17 Feb 2022.
Builds on
23 of 33 references.
References · 23
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2017Hindsight Experience Replaycited by 1,136
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2020Controlling Overestimation Bias with Truncated Mixture of Continuous Distributional Quantile Criticscited by 165
- 2019Category-Level Articulated Object Pose Estimationcited by 159
11 more
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
- 2020Visual Identification of Articulated Object Partscited by 37
- 2018The RBO Dataset of Articulated Objects and Interactionscited by 34
- 2017Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lightingcited by 31
- 2020Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimationcited by 25
- 2020Sim2Real2Sim: Bridging the Gap Between Simulation and Real-World in Flexible Object Manipulationcited by 14
- 2018Applying Domain Randomization to Synthetic Data for Object Category Detectioncited by 9
Built on by
Citing papers per year: 2022: 5; 2023: 19; 2024: 21; 2025: 24; 2026: 13.
82 papers.
Sort:
By area:
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2022Full-Body Articulated Human-Object Interactioncited by 78
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2023Grounding 3D Object Affordance from 2D Interactions in Imagescited by 62
- 2024RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesiscited by 58
- 2022OPD: Single-view 3D Openable Part Detectioncited by 54
38 more
- 2023CAGE: Controllable Articulation GEnerationcited by 52
- 2023LEMON: Learning 3D Human-Object Interaction Relation from 2D Imagescited by 49
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 39
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
- 2024DragAPart: Learning a Part-Level Motion Prior for Articulated Objectscited by 32
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 30
- 2024EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Viewscited by 26
- 2025PartNeXt: A Next-Generation Dataset for Fine-Grained and Hierarchical 3D Part Understandingcited by 26
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Groundingcited by 22
- 2024GarmentLab: A Unified Simulation and Benchmark for Garment Manipulationcited by 22
- 2023Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMscited by 19
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 19
- 2023Fantastic Breaks: A Dataset of Paired 3D Scans of Real-World Broken Objects and Their Complete Counterpartscited by 18
- 2023ZeroPS: High-quality Cross-modal Knowledge Transfer for Zero-Shot 3D Part Segmentationcited by 18
- 2024GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistencycited by 18
- 2023GarmentTracking: Category-Level Garment Pose Trackingcited by 16
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2023Visual-Tactile Sensing for In-Hand Object Reconstructioncited by 13
- 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Imagecited by 13
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
- 2025AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learningcited by 12
- 2023PACE: A Large-Scale Dataset with Pose Annotations in Cluttered Environmentscited by 11
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environmentscited by 11
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Descriptioncited by 9
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objectscited by 9
- 2025Towards Scalable Spatial Intelligence via 2D-to-3D Data Liftingcited by 8
- 2023Primitive-based 3D Human-Object Interaction Modelling and Programmingcited by 7
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2023RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface Normal Estimation and Manipulationcited by 6
- 2024ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualizationcited by 6
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotationscited by 6
- 2024SM3: Self-Supervised Multi-task Modeling with Multi-view 2D Images for Articulated Objectscited by 5
- 2024Category-level Object Detection, Pose Estimation and Reconstruction from Stereo Imagescited by 5
- 2024Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objectscited by 5
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Imagecited by 5
- 2022Structure from Action: Learning Interactions for Articulated Object 3D Structure Discoverycited by 4
- 2023UniG3D: A Unified 3D Object Generation Datasetcited by 4
50 most cited of 82 All 82 (JSON)
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation22 Sep 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026Revisiting Articulated Parts Perception in Robot Manipulation6 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation14 May 2026
- 2026AirZoo: A Unified Large-Scale Dataset for Grounding Aerial Geometric 3D Vision29 Apr 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactions26 Mar 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
38 more
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces23 Feb 2026
- 2025DragMesh: Interactive 3D Generation Made Easy6 Dec 2025
- 2025GAOT: Generating Articulated Objects Through Text-Guided Diffusion Models3 Dec 2025
- 2025Exploring Category-level Articulated Object Pose Tracking on SE(3) Manifolds8 Nov 2025
- 2025Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objects7 Nov 2025
- 2025Kinematify: Open-Vocabulary Synthesis of High-DoF Articulated Objects3 Nov 2025
- 2025SynHLMA:Synthesizing Hand Language Manipulation for Articulated Object with Discrete Human Object Interaction Representation29 Oct 2025
- 2025PartNeXt: A Next-Generation Dataset for Fine-Grained and Hierarchical 3D Part Understanding23 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generation20 Oct 2025
- 2025A 3D Generation Framework from Cross Modality to Parameterized Primitive9 Oct 2025
- 2025Australian Supermarket Object Set (ASOS): A Benchmark Dataset of Physical Objects and 3D Models for Robotics and Computer Vision9 Sep 2025
- 2025Towards Scalable Spatial Intelligence via 2D-to-3D Data Lifting24 Jul 2025
- 2025Adaptive Articulated Object Manipulation On The Fly with Foundation Model Reasoning and Part Grounding24 Jul 2025
- 2025Part2GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splatting20 Jun 2025
- 2025You Only Estimate Once: Unified, One-stage, Real-Time Category-level Articulated Object 6D Pose Estimation for Robotic Grasping6 Jun 2025
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting4 Jun 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image15 Apr 2025
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environments9 Apr 2025
- 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Image4 Apr 2025
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generation17 Mar 2025
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting26 Feb 2025
- 2025AdaManip: Adaptive Articulated Object Manipulation Environments and Policy Learning16 Feb 2025
- 2025Intelligent logistics management robot path planning algorithm integrating transformer and GCN network6 Jan 2025
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotations19 Dec 2024
- 2024Locate n' Rotate: Two-stage Openable Part Detection with Foundation Model Priors17 Dec 2024
- 2024Ensuring Force Safety in Vision-Guided Robotic Manipulation via Implicit Tactile Calibration13 Dec 2024
- 2024GEAL: Generalizable 3D Affordance Learning with Cross-Modal Consistency12 Dec 2024
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Description2 Dec 2024
- 2024GarmentLab: A Unified Simulation and Benchmark for Garment Manipulation2 Nov 2024
- 2024ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualization1 Nov 2024
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects21 Oct 2024
- 20243DArticCyclists: Generating Synthetic Articulated 8D Pose-Controllable Cyclist Data for Computer Vision Applications14 Oct 2024
- 2024Discovering Conceptual Knowledge with Analytic Ontology Templates for Articulated Objects18 Sep 2024
- 2024Learning 2D Invariant Affordance Knowledge for 3D Affordance Grounding23 Aug 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Category-level Object Detection, Pose Estimation and Reconstruction from Stereo Images9 Jul 2024
50 newest of 82 All 82 (JSON)
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2022Full-Body Articulated Human-Object Interactioncited by 78
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2023Grounding 3D Object Affordance from 2D Interactions in Imagescited by 62
- 2024RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesiscited by 58
- 2022OPD: Single-view 3D Openable Part Detectioncited by 54
12 most cited of 76 All 76 (JSON)
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation22 Sep 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026Revisiting Articulated Parts Perception in Robot Manipulation6 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026AirZoo: A Unified Large-Scale Dataset for Grounding Aerial Geometric 3D Vision29 Apr 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026ArtHOI: Taming Foundation Models for Monocular 4D Reconstruction of Hand-Articulated-Object Interactions26 Mar 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2025DragMesh: Interactive 3D Generation Made Easy6 Dec 2025
- 2025Exploring Category-level Articulated Object Pose Tracking on SE(3) Manifolds8 Nov 2025
- 2025Canonical Space Representation for 4D Panoptic Segmentation of Articulated Objects7 Nov 2025
12 newest of 76 All 76 (JSON)