OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments
Not on the map. Why?
Abstract (arXiv)
3D scene graphs (3DSGs) provide a compact and structured abstraction of 3D environments. Although advances in foundation models have enabled open-vocabulary 3DSG generation, existing approaches remain object-centric and encode limited relational information -- restricting their applicability in real-world scenarios that require fine-grained understanding. We propose OP3DSG, an open-vocabulary part-aware 3DSG generation framework that constructs unified graphs that jointly model objects, interactive parts, spatial relations, functional relations, and affordances. OP3DSG integrates object-part knowledge-guided detection with part-aware 3D fusion to preserve small and interaction-relevant components, and employs a geometry-initialized prior graph with LLM-based refinement to reduce spurious relational predictions while enabling efficient graph construction. To systematically evaluate unified 3D scene graph construction, we introduce UniGraph3D, a benchmark designed for part-aware perception and multi-level relational reasoning. Experimental results show that OP3DSG achieves state-of-the-art performance and demonstrates its effectiveness as a perception backbone in diverse real-world robotics tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 55 of its 68 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
55 of 68 references.
References · 55
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Segment Anythingcited by 8,234
- 2023Visual Instruction Tuningcited by 7,869
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
- 2025OpenAI GPT-5 System Cardcited by 989
38 more
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 208
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 178
- 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
- 2020Part-aware Prototype Network for Few-shot Semantic Segmentationcited by 162
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2023Aligning Bag of Regions for Open-Vocabulary Object Detectioncited by 119
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
- 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 106
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
- 2022Learning Object-Language Alignments for Open-Vocabulary Object Detectioncited by 96
- 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 80
- 20193-D Scene Graph: A Sparse and Semantic Representation of Physical Environments for Intelligent Agentscited by 74
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
- 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spacescited by 54
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2019PartNet: A Recursive Part Decomposition Network for Fine-grained and Hierarchical Shape Segmentationcited by 44
- 2022Continuous Scene Representations for Embodied AIcited by 39
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
- 2022Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentationcited by 38
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
- 2023Context-Aware Entity Grounding with Open-Vocabulary 3D Scene Graphscited by 33
- 2024Find Any Part in 3Dcited by 32
- 2023OV-PARTS: Towards Open-Vocabulary Part Segmentationcited by 31
- 2015Joint Object and Part Segmentation using Deep Learned Potentialscited by 23
- 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interactioncited by 23
- 2023Hydra-Multi: Collaborative Online Construction of 3D Scene Graphs with Multi-Robot Teamscited by 21
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.