OPDMulti: Openable Part Detection for Multiple Objects
Not on the map. Why?
Abstract (arXiv)
Openable part detection is the task of detecting the openable parts of an object in a single-view image, and predicting corresponding motion parameters. Prior work investigated the unrealistic setting where all input images only contain a single openable object. We generalize this task to scenes with multiple objects each potentially possessing openable parts, and create a corresponding dataset based on real-world scenes. We then address this more challenging scenario with OPDFormer: a part-aware transformer architecture. Our experiments show that the OPDFormer architecture significantly outperforms prior work. The more realistic multiple-object scenarios we investigated remain challenging for all methods, indicating opportunities for future work.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 24 Mar 2023.
Builds on
25 of 35 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017Mask R-CNNcited by 7,277
- 2015Fast R-CNNcited by 2,933
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2019Category-Level Articulated Object Pose Estimationcited by 159
13 more
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
- 2022OPD: Single-view 3D Openable Part Detectioncited by 54
- 2021Leveraging SE(3) Equivariance for Self-Supervised Category-Level Object Pose Estimationcited by 45
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 41
- 2020Visual Identification of Articulated Object Partscited by 37
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2022Category-Independent Articulated Object Tracking with Factor Graphscited by 24
- 2020Self-Supervised Learning of Part Mobility from Point Cloud Sequencecited by 18
- 2021Distributional Depth-Based Estimation of Object Articulation Modelscited by 18
- 2023CA2T-Net: Category-Agnostic 3D Articulation Transfer from Single Imagecited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 7; 2025: 17; 2026: 14.
39 papers.
Sort:
By area:
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 19
- 2025Dexterous World Modelscited by 18
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
27 more
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Descriptioncited by 9
- 2025ART: Articulated Reconstruction Transformercited by 9
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videoscited by 8
- 2025REACT3D: Recovering Articulations for Interactive Physical 3D Scenescited by 7
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videoscited by 6
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglementcited by 6
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2026FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenariocited by 3
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
- 2025sim2art: Accurate Articulated Object Modeling from a Single Video using Synthetic Training Data Onlycited by 2
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 2
- 2024Opening Articulated Structures in the Real Worldcited by 1
- 2024Locate n' Rotate: Two-stage Openable Part Detection with Foundation Model Priorscited by 1
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Imagescited by 1
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposalscited by 1
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamicscited by 1
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulationcited by 0
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understandingcited by 0
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuationcited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interactioncited by 0
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenescited by 0
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inferencecited by 0
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interaction18 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understanding1 Jun 2026
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation29 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videos7 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenario23 Mar 2026
27 more
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglement3 Mar 2026
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposals26 Feb 2026
- 2025Dexterous World Models19 Dec 2025
- 2025ART: Articulated Reconstruction Transformer16 Dec 2025
- 2025sim2art: Accurate Articulated Object Modeling from a Single Video using Synthetic Training Data Only8 Dec 2025
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulation26 Nov 2025
- 2025LARM: A Large Articulated-Object Reconstruction Model14 Nov 2025
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion29 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025REACT3D: Recovering Articulations for Interactive Physical 3D Scenes13 Oct 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction15 Sep 2025
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Images4 Sep 2025
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects20 Aug 2025
- 2025PhysX-3D: Physical-Grounded 3D Asset Generation16 Jul 2025
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videos10 Jun 2025
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videos17 May 2025
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting26 Feb 2025
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling4 Feb 2025
- 2024Locate n' Rotate: Two-stage Openable Part Detection with Foundation Model Priors17 Dec 2024
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Description2 Dec 2024
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objects27 Sep 2024
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesis24 Jun 2024
- 2024Real2Code: Reconstruct Articulated Objects via Code Generation12 Jun 2024
- 2024Survey on Modeling of Human-made Articulated Objects22 Mar 2024
- 2024Opening Articulated Structures in the Real World27 Feb 2024
- 2023Understanding 3D Object Interaction from a Single Image16 May 2023
- 2025Dexterous World Modelscited by 18
- 2025Dexterous World Models19 Dec 2025
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 19
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
12 most cited of 37 All 37 (JSON)
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026ForceTwin: Physics-informed Digital Twins for Robotic Manipulation from Instrumented Human Interaction18 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026AFUN: Towards an Affordance Foundation Model for Functionality Understanding1 Jun 2026
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation29 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 2026FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videos7 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenario23 Mar 2026
12 newest of 37 All 37 (JSON)