mlsanityData to 13 Oct 2026

From Scene-Centric to Observer-Centric: Modeling Observer-Aware Relations for 3D Scene Graph Generation

arXiv 2606.27412 ↗First posted 25 Jun 2026cs.CV cs.AI cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

3D Scene Graph Generation (3DSGG) represents 3D scenes as structured object--relation--object graphs for spatial understanding. In observer-centric spatial perception, the same scene may be expressed under different local observer frames while its structure remains unchanged. However, existing models typically assume a fixed scene-aligned reference frame and may produce semantically inconsistent predictions when the scene is re-expressed in another observer frame. We attribute this failure to the heterogeneous frame dependency of relational predicates. Directional predicates such as textitleft, textitfront, textitright, and textitbehind are Observer-Dependent Relations, whereas most contact, support, and semantic predicates, such as textitstanding on and textitattached to, are approximately Observer-Independent Relations. Conventional models do not distinguish these frame responses, leading to degraded relation prediction under observer-frame reorientation. We introduce Observer-Aware Relations (OAR), which combines observer-aware geometric encoding and relation specialization, supported by frame-stable object encoding, for unified multi-label predicate prediction. Experiments on 3DSSG show that OAR consistently outperforms baselines across controlled observer-frame reorientations without training-time frame-reorientation augmentation, while remaining competitive on the standard benchmark. The project page is available at https://oar-predicate.github.io/.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

35 of 42 references.

References · 35

  1. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,389
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
  3. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,197
  4. 2016Group Equivariant Convolutional Networkscited by 1,157
  5. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,147
  6. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 739
  7. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 603
  8. 2017Scene Graph Generation by Iterative Message Passingcited by 462
  9. 2019General E(2)-Equivariant Steerable CNNscited by 442
  10. 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 413
  11. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 359
  12. 2020Unbiased Scene Graph Generation from Biased Trainingcited by 355
23 more
  1. 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 305
  2. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
  3. 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 258
  4. 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 205
  5. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
  6. 2017SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentationcited by 169
  7. 2019Knowledge-Embedded Routing Network for Scene Graph Generationcited by 163
  8. 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 160
  9. 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 142
  10. 2021Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generationcited by 137
  11. 2020Bridging Knowledge Graphs to Generate Scene Graphscited by 86
  12. 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 76
  13. 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 47
  14. 2023VL-SAT: Visual-Linguistic Semantics Assisted Training for 3D Semantic Scene Graph Prediction in Point Cloudcited by 42
  15. 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
  16. 2020Retargetable AR: Context-aware Augmented Reality in Indoor Scenes based on 3D Scene Graphcited by 19
  17. 2024PARE-Net: Position-Aware Rotation-Equivariant Networks for Robust Point Cloud Registrationcited by 18
  18. 2024RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learningcited by 15
  19. 2024SG-PGM: Partial Graph Matching Network with Semantic Geometric Fusion for 3D Scene Graph Alignment and Its Downstream Taskscited by 10
  20. 2025GaussianGraph: 3D Gaussian-based Scene Graph Generation for Open-world Scene Understandingcited by 8
  21. 2025Commanding Humanoid by Free-form Language: A Large Language Action Model with Unified Motion Vocabularycited by 7
  22. 2025Statistical Confidence Rescoring for Robust 3D Scene Graph Generation from Multi-View Imagescited by 5
  23. 2026VIZOR: Viewpoint-Invariant Zero-Shot Scene Graph Generation for 3D Scene Reasoningcited by 1

Built on by

Not cited yet.