Object-Centric Representation Learning for Enhanced 3D Semantic Scene Graph Prediction
Not on the map. Why?
Abstract (arXiv)
3D Semantic Scene Graph Prediction aims to detect objects and their semantic relationships in 3D scenes, and has emerged as a crucial technology for robotics and AR/VR applications. While previous research has addressed dataset limitations and explored various approaches including Open-Vocabulary settings, they frequently fail to optimize the representational capacity of object and relationship features, showing excessive reliance on Graph Neural Networks despite insufficient discriminative capability. In this work, we demonstrate through extensive analysis that the quality of object features plays a critical role in determining overall scene graph accuracy. To address this challenge, we design a highly discriminative object feature encoder and employ a contrastive pretraining strategy that decouples object representation learning from the scene graph prediction. This design not only enhances object classification accuracy but also yields direct improvements in relationship prediction. Notably, when plugging in our pretrained encoder into existing frameworks, we observe substantial performance improvements across all evaluation metrics. Additionally, whereas existing approaches have not fully exploited the integration of relationship information, we effectively combine both geometric and semantic features to achieve superior relationship prediction. Comprehensive experiments on the 3DSSG dataset demonstrate that our approach significantly outperforms previous state-of-the-art methods. Our code is publicly available at https://github.com/VisualScienceLab-KHU/OCRL-3DSSG-Codes.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 53 of its 68 references that are in the map. First posted on arXiv 6 Oct 2025.
Builds on
53 of 68 references.
References · 53
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2020Supervised Contrastive Learningcited by 2,829
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
- 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 473
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
38 more
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
- 2018Graph R-CNN for Scene Graph Generationcited by 298
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
- 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 259
- 2021Parametric Contrastive Learningcited by 217
- 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 208
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
- 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
- 2019Knowledge-Embedded Routing Network for Scene Graph Generationcited by 164
- 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2021Decoupled Contrastive Learningcited by 143
- 2021Targeted Supervised Contrastive Learning for Long-Tailed Recognitioncited by 132
- 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 109
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 84
- 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 80
- 20193-D Scene Graph: A Sparse and Semantic Representation of Physical Environments for Intelligent Agentscited by 74
- 2023CLIP2: Contrastive Language-Image-Point Pretraining from Real-World Point Cloud Datacited by 69
- 2016The More You Know: Using Knowledge Graphs for Image Classificationcited by 63
- 2017Visual Relationship Detection with Internal and External Linguistic Knowledge Distillationcited by 61
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
- 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spacescited by 54
- 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 49
- 2018LinkNet: Relational Embedding for Scene Graphcited by 45
- 2023VL-SAT: Visual-Linguistic Semantics Assisted Training for 3D Semantic Scene Graph Prediction in Point Cloudcited by 43
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
- 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
- 2018Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoningcited by 27
- 20243DGraphLLM: Combining Semantic Graphs and Large Language Models for 3D Scene Understandingcited by 27
- 2020Classification by Attention: Scene Graph Classification with Prior Knowledgecited by 26
- 2025FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interactioncited by 23
- 2023SGRec3D: Self-Supervised 3D Scene Graph Learning via Object-Level Scene Reconstructioncited by 21
- 2020Retargetable AR: Context-aware Augmented Reality in Indoor Scenes based on 3D Scene Graphcited by 19
- 2023Lang3DSG: Language-based contrastive pre-training for 3D Scene Graph predictioncited by 19
- 2017Natural Language Guided Visual Relationship Detectioncited by 15
- 2024The Bare Necessities: Designing Simple, Effective Open-Vocabulary Scene Graphscited by 11
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 20263D Scene Graphs: Open Challenges and Future Directionscited by 4
- 2026PUF: Plug-and-Play Uncertainty-Aware Fusion for Online 3D Scene Graph Generationcited by 0
- 2026GHOST: Geometry-Constrained Hybrid Diffusion for Open-Vocabulary 3D Scene Graph Generationcited by 0
- 2026SWORD: Scene-Grounded Wasserstein Object-Relation Distance for 3D Scene Graph Predictioncited by 0
- 2026SWORD: Scene-Grounded Wasserstein Object-Relation Distance for 3D Scene Graph Prediction13 Oct 2026
- 2026GHOST: Geometry-Constrained Hybrid Diffusion for Open-Vocabulary 3D Scene Graph Generation12 Oct 2026
- 2026PUF: Plug-and-Play Uncertainty-Aware Fusion for Online 3D Scene Graph Generation8 Jul 2026
- 20263D Scene Graphs: Open Challenges and Future Directions15 Jun 2026