OpenSGA: Efficient 3D Scene Graph Alignment in the Open World
Not on the map. Why?
Abstract (arXiv)
Scene graph alignment establishes object correspondences between two 3D scene graphs constructed from partially overlapping observations. This enables efficient scene understanding and object-level relocalization when a robot revisits a place, as well as global map fusion across multiple agents. Such capabilities are essential for robots that require long-term memory for long-horizon tasks involving interactions with the environment. Existing approaches mainly focus on subscan-to-subscan (S2S) alignment and depend heavily on geometric point-cloud features, leaving frame-to-scan (F2S) alignment and open-set vision-language features underexplored. In addition, existing datasets for scene graph alignment remain small-scale with limited object diversity, constraining systematic training and evaluation. We present a unified and efficient scene graph alignment framework that predicts object correspondences by fusing vision-language, textual, and geometric features with spatial context. The framework comprises modules such as a distance-gated spatial attention encoder, a minimum-cost-flow-based allocator, and a global scene embedding generator to achieve accurate alignment even under large coordinate discrepancies. We further introduce ScanNet-SG, a large-scale dataset generated via an automated annotation pipeline with over 700k samples, covering 509 object categories from ScanNet labels and over 3k categories from GPT-4o-based tagging. Experiments show that our method achieves the best overall performance on both F2S and S2S tasks, substantially outperforming existing scene graph alignment methods. Our code and dataset are released at: https://autonomousrobots.nl/paper_websites/opensga.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
36 of 58 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2016Layer Normalizationcited by 5,579
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 205
- 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 187
24 more
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 175
- 2024Clio: Real-time Task-Driven Open-Set 3D Scene Graphscited by 81
- 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 76
- 2024Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulationcited by 69
- 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spacescited by 53
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
- 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
- 2024SceneGraphLoc: Cross-Modal Coarse Visual Localization on 3D Scene Graphscited by 29
- 2022S-Graphs+: Real-time Localization and Mapping leveraging Hierarchical Representationscited by 28
- 2023Optimal Scene Graph Planning with Large Language Model Guidancecited by 26
- 2023Indoor and Outdoor 3D Scene Graph Generation via Language-Enabled Spatial Ontologiescited by 25
- 2024VLA-3D: A Dataset for 3D Semantic Scene Understanding and Navigationcited by 21
- 2024Long-Term Human Trajectory Prediction using 3D Dynamic Scene Graphscited by 15
- 2024SG-PGM: Partial Graph Matching Network with Semantic Geometric Fusion for 3D Scene Graph Alignment and Its Downstream Taskscited by 10
- 2024ROMAN: Open-Set Object Map Alignment for Robust View-Invariant Global Localizationcited by 10
- 2024Task-oriented Sequential Grounding and Navigation in 3D Scenescited by 9
- 2025Controllable 3D Outdoor Scene Generation via Scene Graphscited by 9
- 2025SG-Reg: Generalizable and Efficient Scene Graph Registrationcited by 8
- 2024MR-COGraphs: Communication-efficient Multi-Robot Open-vocabulary Mapping System via 3D Scene Graphscited by 5
- 2024Commonsense Scene Graph-based Target Localization for Object Searchcited by 4
- 2026Are Multimodal Large Language Models Good Annotators for Image Tagging?cited by 3
- 2024OpenObject-NAV: Open-Vocabulary Object-Oriented Navigation Based on Dynamic Carrier-Relationship Scene Graphcited by 2
- 2025REGRACE: A Robust and Efficient Graph-based Re-localization Algorithm using Consistency Evaluationcited by 2
- 2025SGAligner++: Cross-Modal Language-Aided 3D Scene Graph Alignmentcited by 2
Built on by
Not cited yet.