Generation of Uncertainty-Aware High-Level Spatial Concepts in Factorized 3D Scene Graphs via Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Enabling robots to autonomously discover high-level spatial concepts (e.g., rooms and walls) from primitive geometric observations (e.g., planar surfaces) within 3D Scene Graphs is essential for robust indoor navigation and mapping. These graphs provide a hierarchical metric-semantic representation in which such concepts are organized. To further enhance graph-SLAM performance, Factorized 3D Scene Graphs incorporate these concepts as optimization factors that constrain relative geometry and enforce global consistency. However, both stages of this process remain largely manual: concepts are typically derived using hand-crafted, concept-specific heuristics, while factors and their covariances are likewise manually designed. This reliance on manual specification limits generalization across diverse environments and scalability to new concept classes. This paper presents a novel learning-based method that infers spatial concepts online from observed vertical planes and introduces them as optimizable factors within a SLAM backend, eliminating the need to handcraft concept generation, factor design, and covariance specification. We evaluate our approach in simulated environments with complex layouts, improving room detection by 20.7% and trajectory estimation by 19.2%. Validated on real construction sites, room detection improves by 5.3% and map matching accuracy by 3.8%.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 18 Sep 2024.
Builds on
23 of 38 references.
References · 23
- 2017Graph Attention Networkscited by 8,854
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 205
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 195
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 175
- 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 170
- 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 141
- 2024Clio: Real-time Task-Driven Open-Set 3D Scene Graphscited by 81
- 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 76
11 more
- 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
- 2023Collaborative Dynamic 3D Scene Graphs for Automated Drivingcited by 34
- 2022S-Graphs+: Real-time Localization and Mapping leveraging Hierarchical Representationscited by 28
- 2023Indoor and Outdoor 3D Scene Graph Generation via Language-Enabled Spatial Ontologiescited by 25
- 2024MSD: A Benchmark Dataset for Floor Plan Generation of Building Complexescited by 13
- 2022Robust Structure Identification and Room Segmentation of Cluttered Indoor Environments from Occupancy Grid Mapscited by 7
- 2024Constrained Layout Generation with Factor Graphscited by 6
- 2023Learning High-level Semantic-Relational Concepts for SLAMcited by 4
- 2024Tightly Coupled SLAM with Imprecise Architectural Planscited by 4
- 2019Node Attribute Generation on Graphscited by 2
- 2022SCGG: A Deep Structure-Conditioned Graph Generative Modelcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.