mlsanityData to 14 Oct 2026

OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments

arXiv 2606.29786 ↗First posted 29 Jun 2026cs.CV cs.ROcited by 1

Not on the map. Why?

Abstract (arXiv)

3D scene graphs (3DSGs) provide a compact and structured abstraction of 3D environments. Although advances in foundation models have enabled open-vocabulary 3DSG generation, existing approaches remain object-centric and encode limited relational information -- restricting their applicability in real-world scenarios that require fine-grained understanding. We propose OP3DSG, an open-vocabulary part-aware 3DSG generation framework that constructs unified graphs that jointly model objects, interactive parts, spatial relations, functional relations, and affordances. OP3DSG integrates object-part knowledge-guided detection with part-aware 3D fusion to preserve small and interaction-relevant components, and employs a geometry-initialized prior graph with LLM-based refinement to reduce spurious relational predictions while enabling efficient graph construction. To systematically evaluate unified 3D scene graph construction, we introduce UniGraph3D, a benchmark designed for part-aware perception and multi-level relational reasoning. Experimental results show that OP3DSG achieves state-of-the-art performance and demonstrates its effectiveness as a perception backbone in diverse real-world robotics tasks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 55 of its 68 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

55 of 68 references.

References · 55

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2023Segment Anythingcited by 8,234
  7. 2023Visual Instruction Tuningcited by 7,869
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  10. 2021Grounded Language-Image Pre-trainingcited by 1,156
  11. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  12. 2025OpenAI GPT-5 System Cardcited by 989
38 more
  1. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  2. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
  3. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 614
  4. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
  5. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  6. 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
  7. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
  8. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
  9. 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 208
  10. 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
  11. 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 178
  12. 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
  13. 2020Part-aware Prototype Network for Few-shot Semantic Segmentationcited by 162
  14. 2023PACO: Parts and Attributes of Common Objectscited by 146
  15. 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
  16. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
  17. 2023Aligning Bag of Regions for Open-Vocabulary Object Detectioncited by 119
  18. 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
  19. 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
  20. 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 106
  21. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
  22. 2022Learning Object-Language Alignments for Open-Vocabulary Object Detectioncited by 96
  23. 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 80
  24. 20193-D Scene Graph: A Sparse and Semantic Representation of Physical Environments for Intelligent Agentscited by 74
  25. 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
  26. 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spacescited by 54
  27. 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
  28. 2019PartNet: A Recursive Part Decomposition Network for Fine-grained and Hierarchical Shape Segmentationcited by 44
  29. 2022Continuous Scene Representations for Embodied AIcited by 39
  30. 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
  31. 2022Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentationcited by 38
  32. 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
  33. 2023Context-Aware Entity Grounding with Open-Vocabulary 3D Scene Graphscited by 33
  34. 2024Find Any Part in 3Dcited by 32
  35. 2023OV-PARTS: Towards Open-Vocabulary Part Segmentationcited by 31
  36. 2015Joint Object and Part Segmentation using Deep Learned Potentialscited by 23
  37. 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interactioncited by 23
  38. 2023Hydra-Multi: Collaborative Online Construction of 3D Scene Graphs with Multi-Robot Teamscited by 21

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.