mlsanityData to 14 Oct 2026

GHOST: Geometry-Constrained Hybrid Diffusion for Open-Vocabulary 3D Scene Graph Generation

arXiv 2610.16455 ↗First posted 12 Oct 2026cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

3D scene graph generation requires understanding both object semantics and metric spatial relations. However, existing open-vocabulary methods often struggle with spatial predicates because language similarity reflects semantic co-occurrence rather than explicit geometry. We propose GHOST, a Geometry-constrained Hybrid diffusion framework for Open-vocabulary 3D Scene graph generaTion. GHOST jointly models continuous node geometry and discrete edge predicates, following a geometry-to-constraint-to-predicate denoising process to ensure geometrically consistent relation prediction. It introduces language-grounded constraint induction, which maps predicate embeddings to differentiable geometric constraints that guide both layout refinement and predicate reweighting. A Geometry-Topology Collaborative Denoiser further couples node and edge reasoning through noise-adaptive interaction and orientation-aware modeling. Experiments on 3DSSG demonstrate state-of-the-art performance in both closed-set and open-vocabulary settings, including over 17-point gains over RelationField on spatial predicates.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 54 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

30 of 54 references.

References · 30

  1. 2020Denoising Diffusion Implicit Modelscited by 9,781
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  6. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  7. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 520
  8. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  9. 2020Unbiased Scene Graph Generation from Biased Trainingcited by 356
  10. 2018Graph R-CNN for Scene Graph Generationcited by 298
  11. 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 208
  12. 2020GPS-Net: Graph Property Sensing Network for Scene Graph Generationcited by 166
18 more
  1. 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
  2. 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 80
  3. 2024Discrete-state Continuous-time Diffusion for Graph Generationcited by 76
  4. 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spacescited by 54
  5. 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 49
  6. 2023VL-SAT: Visual-Linguistic Semantics Assisted Training for 3D Semantic Scene Graph Prediction in Point Cloudcited by 43
  7. 2024EventGPT: Event Stream Understanding with Multimodal Large Language Modelscited by 28
  8. 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priorscited by 22
  9. 2023SGRec3D: Self-Supervised 3D Scene Graph Learning via Object-Level Scene Reconstructioncited by 21
  10. 2023Lang3DSG: Language-based contrastive pre-training for 3D Scene Graph predictioncited by 19
  11. 2025Knowledge-Aligned Counterfactual-Enhancement Diffusion Perception for Unsupervised Cross-Domain Visual Emotion Recognitioncited by 17
  12. 2024Towards Effective Data-Free Knowledge Distillation via Diverse Diffusion Augmentationcited by 13
  13. 2026Fixed Anchors Are Not Enough: Dynamic Retrieval and Persistent Homology for Dataset Distillationcited by 11
  14. 2025SPADE: Spatial-Aware Denoising Network for Open-vocabulary Panoptic Scene Graph Generation with Long- and Local-range Context Reasoningcited by 10
  15. 2025Open-World 3D Scene Graph Generation for Retrieval-Augmented Reasoningcited by 6
  16. 2025Beyond Random: Automatic Inner-loop Optimization in Dataset Distillationcited by 5
  17. 2025TiCAL:Typicality-Based Consistency-Aware Learning for Multimodal Emotion Recognitioncited by 5
  18. 2025Object-Centric Representation Learning for Enhanced 3D Semantic Scene Graph Predictioncited by 4

Built on by

Not cited yet.