S2O: Static to Openable Enhancement for Articulated 3D Objects
Not on the map. Why?
Abstract (arXiv)
Despite much progress in large 3D datasets there are currently few interactive 3D object datasets, and their scale is limited due to the manual effort required in their construction. We introduce the static to openable (S2O) task which creates interactive articulated 3D objects from static counterparts through openable part detection, motion prediction, and interior geometry completion. We formulate a unified framework to tackle this task, and curate a challenging dataset of openable 3D objects that serves as a test bed for systematic evaluation. Our experiments benchmark methods from prior work, extended and improved methods, and simple yet effective heuristics for the S2O task. We find that turning static 3D objects into interactively openable counterparts is possible but that all methods struggle to generalize to realistic settings of the task, and we highlight promising future work directions. Our work enables efficient creation of interactive 3D objects for robotic manipulation and embodied AI tasks.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 46 of its 66 references that are in the map. First posted on arXiv 27 Sep 2024.
Builds on
46 of 66 references.
References · 46
- 2023Segment Anythingcited by 8,234
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
34 more
- 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2020Rearrangement: A Challenge for Embodied AIcited by 155
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 113
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2017ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scanscited by 103
- 2021ManipulaTHOR: A Framework for Visual Object Manipulationcited by 102
- 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2022OPD: Single-view 3D Openable Part Detectioncited by 54
- 2023CAGE: Controllable Articulation GEnerationcited by 52
- 2021MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan Synchronizationcited by 46
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 41
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 39
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2020MeshWalker: Deep Mesh Understanding by Random Walkscited by 32
- 2020RPM-Net: Recurrent Prediction of Motion and Parts from Point Cloudcited by 26
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objectscited by 25
- 2024Spot-Compose: A Framework for Open-Vocabulary Object Retrieval and Drawer Manipulation in Point Cloudscited by 15
- 2022Unsupervised Kinematic Motion Detection for Part-segmented 3D Shape Collectionscited by 13
- 2023Slice3D: Multi-Slice, Occlusion-Revealing, Single View 3D Reconstructioncited by 13
- 2022Optimal Correction Cost for Object Detection Evaluationcited by 11
- 2023RoSI: Recovering 3D Shape Interiors from Few Articulation Imagescited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 13.
22 papers.
Sort:
By area:
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 8
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generationcited by 8
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?cited by 6
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
10 more
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedbackcited by 2
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assetscited by 2
- 2026Articulated Object Reconstruction from Rest-State Observationcited by 1
- 2026MechVerse: Evaluating Physical Motion Consistency in Video Generation Modelscited by 0
- 2026Functionalization via Structure Completion and Motion Rectificationcited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenescited by 0
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026Articulated Object Reconstruction from Rest-State Observation30 Jul 2026
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?24 Jul 2026
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets15 Jul 2026
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026Functionalization via Structure Completion and Motion Rectification18 May 2026
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback17 May 2026
- 2026MechVerse: Evaluating Physical Motion Consistency in Video Generation Models14 May 2026
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generation13 Apr 2026
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
10 more
- 2026PAct: Part-Decomposed Single-View Articulated Object Generation16 Feb 2026
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulation26 Nov 2025
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents24 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction15 Sep 2025
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Data26 May 2025
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realism21 Apr 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization11 Feb 2025
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects21 Oct 2024
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?cited by 6
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?24 Jul 2026
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 8
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedbackcited by 2
12 most cited of 18 All 18 (JSON)
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026Articulated Object Reconstruction from Rest-State Observation30 Jul 2026
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets15 Jul 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026Functionalization via Structure Completion and Motion Rectification18 May 2026
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback17 May 2026
- 2026MechVerse: Evaluating Physical Motion Consistency in Video Generation Models14 May 2026
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
- 2026PAct: Part-Decomposed Single-View Articulated Object Generation16 Feb 2026
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulation26 Nov 2025
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents24 Oct 2025
12 newest of 18 All 18 (JSON)