OPD: Single-view 3D Openable Part Detection
Not on the map. Why?
Abstract (arXiv)
We address the task of predicting what parts of an object can open and how they move when they do so. The input is a single image of an object, and as output we detect what parts of the object can open, and the motion parameters describing the articulation of each openable part. To tackle this task, we create two datasets of 3D objects: OPDSynth based on existing synthetic objects, and OPDReal based on RGBD reconstructions of real objects. We then design OPDRCNN, a neural architecture that detects openable parts and predicts their motion parameters. Our experiments show that this is a challenging task especially when considering generalization across object categories, and the limited amount of information in a single image. Our architecture outperforms baselines and prior work especially for RGB image inputs. Short video summary at https://www.youtube.com/watch?v=P85iCaD0rfc
Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 30 Mar 2022.
Builds on
33 of 50 references.
References · 33
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Mask R-CNNcited by 7,277
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
21 more
- 2017Learning from Synthetic Humanscited by 359
- 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 232
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2020Rearrangement: A Challenge for Embodied AIcited by 155
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2021Visual Room Rearrangementcited by 102
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2021Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulationcited by 44
- 2017Joint Multi-Person Pose Estimation and Semantic Part Segmentationcited by 41
- 2020Visual Identification of Articulated Object Partscited by 37
- 2018The RBO Dataset of Articulated Objects and Interactionscited by 34
- 2020RPM-Net: Recurrent Prediction of Motion and Parts from Point Cloudcited by 26
- 2020Nothing But Geometric Constraints: A Model-Free Method for Articulated Object Pose Estimationcited by 25
- 2015Joint Object and Part Segmentation using Deep Learned Potentialscited by 23
- 2014Semantic Part Segmentation using Compositional Model combining Shape and Appearancecited by 22
- 2016Beyond Holistic Object Recognition: Enriching Image Understanding with Part Statescited by 13
- 2018Learning to Group and Label Fine-Grained Shape Componentscited by 9
Built on by
Citing papers per year: 2023: 8; 2024: 9; 2025: 19; 2026: 18.
54 papers.
Sort:
By area:
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2023CAGE: Controllable Articulation GEnerationcited by 52
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 39
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objectscited by 35
- 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Cloudscited by 34
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 19
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
38 more
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Imagecited by 13
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
- 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environmentscited by 11
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Descriptioncited by 9
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2024OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimationcited by 8
- 2025Unified Semantic Transformer for 3D Scene Understandingcited by 8
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videoscited by 8
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2025REACT3D: Recovering Articulations for Interactive Physical 3D Scenescited by 7
- 2023RoSI: Recovering 3D Shape Interiors from Few Articulation Imagescited by 6
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotationscited by 6
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videoscited by 6
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglementcited by 6
- 2023Active Coarse-to-Fine Segmentation of Moveable Parts from Real Imagescited by 5
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Imagecited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2023CA2T-Net: Category-Agnostic 3D Articulation Transfer from Single Imagecited by 3
- 2026Online Estimation and Manipulation of Articulated Objectscited by 3
- 2025sim2art: Accurate Articulated Object Modeling from a Single Video using Synthetic Training Data Onlycited by 2
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 2
- 2024Opening Articulated Structures in the Real Worldcited by 1
- 2024Locate n' Rotate: Two-stage Openable Part Detection with Foundation Model Priorscited by 1
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Imagescited by 1
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposalscited by 1
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templatescited by 1
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamicscited by 1
- 2025PinPoint3D: Fine-Grained 3D Part Segmentation from a Few Clickscited by 0
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulationcited by 0
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understandingcited by 0
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verificationcited by 0
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuationcited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
50 most cited of 54 All 54 (JSON)
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image4 Oct 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understanding1 Jun 2026
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation29 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates13 Apr 2026
38 more
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videos7 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement3 Mar 2026
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposals26 Feb 2026
- 2026Online Estimation and Manipulation of Articulated Objects4 Jan 2026
- 2025ART: Articulated Reconstruction Transformer16 Dec 2025
- 2025Unified Semantic Transformer for 3D Scene Understanding16 Dec 2025
- 2025sim2art: Accurate Articulated Object Modeling from a Single Video using Synthetic Training Data Only8 Dec 2025
- 2025LARM: A Large Articulated-Object Reconstruction Model14 Nov 2025
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion29 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025REACT3D: Recovering Articulations for Interactive Physical 3D Scenes13 Oct 2025
- 2025PinPoint3D: Fine-Grained 3D Part Segmentation from a Few Clicks30 Sep 2025
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Images4 Sep 2025
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects20 Aug 2025
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videos10 Jun 2025
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting4 Jun 2025
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videos17 May 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
- 2025CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image15 Apr 2025
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environments9 Apr 2025
- 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Image4 Apr 2025
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization11 Feb 2025
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling4 Feb 2025
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotations19 Dec 2024
- 2024Locate n' Rotate: Two-stage Openable Part Detection with Foundation Model Priors17 Dec 2024
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Description2 Dec 2024
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objects27 Sep 2024
- 2024OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimation29 Aug 2024
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesis24 Jun 2024
- 2024Real2Code: Reconstruct Articulated Objects via Code Generation12 Jun 2024
- 2024Survey on Modeling of Human-made Articulated Objects22 Mar 2024
- 2024Opening Articulated Structures in the Real World27 Feb 2024
- 2023CAGE: Controllable Articulation GEneration15 Dec 2023
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objects14 Sep 2023
- 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Clouds1 Jun 2023
- 2023Understanding 3D Object Interaction from a Single Image16 May 2023
50 newest of 54 All 54 (JSON)
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2023CAGE: Controllable Articulation GEnerationcited by 52
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 39
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objectscited by 35
- 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Cloudscited by 34
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 19
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
12 most cited of 51 All 51 (JSON)
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image4 Oct 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026URDF Synthesis from RGB-D Sequences via Differentiable Joint Inference and Energy-Consistent Verification17 Jun 2026
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understanding1 Jun 2026
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation29 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates13 Apr 2026
12 newest of 51 All 51 (JSON)