A Probabilistic Framework for Learning Kinematic Models of Articulated Objects
Not on the map. Why?
Abstract (arXiv)
Robots operating in domestic environments generally need to interact with articulated objects, such as doors, cabinets, dishwashers or fridges. In this work, we present a novel, probabilistic framework for modeling articulated objects as kinematic graphs. Vertices in this graph correspond to object parts, while edges between them model their kinematic relationship. In particular, we present a set of parametric and non-parametric edge models and how they can robustly be estimated from noisy pose observations. We furthermore describe how to estimate the kinematic structure and how to use the learned kinematic models for pose prediction and for robotic manipulation tasks. We finally present how the learned models can be generalized to new and previously unseen objects. In various experiments using real robots with different camera systems as well as in simulation, we show that our approach is valid, accurate and efficient. Further, we demonstrate that our approach has a broad set of applications, in particular for the emerging fields of mobile manipulation and service robotics.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jan 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 9; 2023: 8; 2024: 3; 2025: 9; 2026: 6.
40 papers.
Sort:
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 78
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 55
- 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 40
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objectscited by 33
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2022Category-Independent Articulated Object Tracking with Factor Graphscited by 24
28 more
- 2023Learning Environment-Aware Affordance for 3D Articulated Object Manipulation under Occlusionscited by 23
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 21
- 2021Distributional Depth-Based Estimation of Object Articulation Modelscited by 18
- 2025Articulated Object Estimation in the Wildcited by 18
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collectionscited by 13
- 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Imagecited by 13
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
- 2021Unsupervised Co-part Segmentation through Assemblycited by 12
- 2024CAPT: Category-level Articulation Estimation from a Single Point Cloud Using Transformercited by 11
- 2021Learning to Infer Kinematic Hierarchies for Novel Object Instancescited by 10
- 2022Inferring Articulated Rigid Body Dynamics from RGBD Videocited by 10
- 2026Articulated 3D Scene Graphs for Open-World Mobile Manipulationcited by 9
- 2022Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and Challengescited by 8
- 2023Learning Part Motion of Articulated Objects Using Spatially Continuous Neural Implicit Representationscited by 5
- 2022Structure from Action: Learning Interactions for Articulated Object 3D Structure Discoverycited by 4
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2022H-SAUR: Hypothesize, Simulate, Act, Update, and Repeat for Understanding Object Articulations from Interactionscited by 3
- 2026Online Estimation and Manipulation of Articulated Objectscited by 3
- 2026Pandora: Articulated 3D Scene Graphs from Egocentric Visioncited by 3
- 2024NARF24: Estimating Articulated Object Structure for Implicit Renderingcited by 1
- 2025Learning Sequential Kinematic Models from Demonstrations for Multi-Jointed Articulated Objectscited by 1
- 2025SPLATART: Articulated Gaussian Splatting with Estimated Object Structurecited by 1
- 2023Revisiting Proprioceptive Sensing for Articulated Object Manipulationcited by 0
- 2025ArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objectscited by 0
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videoscited by 0
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latentscited by 0
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interactioncited by 0
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interaction18 Sep 2026
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents17 Sep 2026
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
- 2026Pandora: Articulated 3D Scene Graphs from Egocentric Vision30 Mar 2026
- 2026Articulated 3D Scene Graphs for Open-World Mobile Manipulation18 Feb 2026
- 2026Online Estimation and Manipulation of Articulated Objects4 Jan 2026
- 2025ArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objects9 Nov 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 2025Articulated Object Estimation in the Wild1 Sep 2025
- 2025SPLATART: Articulated Gaussian Splatting with Estimated Object Structure13 Jun 2025
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting4 Jun 2025
28 more
- 2025Learning Sequential Kinematic Models from Demonstrations for Multi-Jointed Articulated Objects9 May 2025
- 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Image4 Apr 2025
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting26 Feb 2025
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objects10 Dec 2024
- 2024NARF24: Estimating Articulated Object Structure for Implicit Rendering15 Sep 2024
- 2024CAPT: Category-level Articulation Estimation from a Single Point Cloud Using Transformer27 Feb 2024
- 2023Learning Part Motion of Articulated Objects Using Spatially Continuous Neural Implicit Representations21 Nov 2023
- 2023Learning Environment-Aware Affordance for 3D Articulated Object Manipulation under Occlusions14 Sep 2023
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objects14 Sep 2023
- 2023NAP: Neural 3D Articulation Prior25 May 2023
- 2023Understanding 3D Object Interaction from a Single Image16 May 2023
- 2023Revisiting Proprioceptive Sensing for Articulated Object Manipulation16 May 2023
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objects28 Mar 2023
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception2 Feb 2023
- 2022H-SAUR: Hypothesize, Simulate, Act, Update, and Repeat for Understanding Object Articulations from Interactions22 Oct 2022
- 2022Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and Challenges12 Sep 2022
- 2022Structure from Action: Learning Interactions for Articulated Object 3D Structure Discovery19 Jul 2022
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collections17 Jun 2022
- 2022Category-Independent Articulated Object Tracking with Factor Graphs7 May 2022
- 2022Understanding 3D Object Articulation in Internet Videos30 Mar 2022
- 2022Inferring Articulated Rigid Body Dynamics from RGBD Video20 Mar 2022
- 2022Ditto: Building Digital Twins of Articulated Objects from Interaction16 Feb 2022
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Field1 Feb 2022
- 2021Learning to Infer Kinematic Hierarchies for Novel Object Instances15 Oct 2021
- 2021Distributional Depth-Based Estimation of Object Articulation Models12 Aug 2021
- 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objects28 Jun 2021
- 2021Unsupervised Co-part Segmentation through Assembly10 Jun 2021
- 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discovery3 May 2021
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 78
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 55
- 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 40
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objectscited by 33
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2022Category-Independent Articulated Object Tracking with Factor Graphscited by 24
12 most cited of 40 All 40 (JSON)
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interaction18 Sep 2026
- 2026FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents17 Sep 2026
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
- 2026Pandora: Articulated 3D Scene Graphs from Egocentric Vision30 Mar 2026
- 2026Articulated 3D Scene Graphs for Open-World Mobile Manipulation18 Feb 2026
- 2026Online Estimation and Manipulation of Articulated Objects4 Jan 2026
- 2025ArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objects9 Nov 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 2025Articulated Object Estimation in the Wild1 Sep 2025
- 2025SPLATART: Articulated Gaussian Splatting with Estimated Object Structure13 Jun 2025
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting4 Jun 2025
12 newest of 40 All 40 (JSON)