mlsanityData to 7 Oct 2026

Generation of Uncertainty-Aware High-Level Spatial Concepts in Factorized 3D Scene Graphs via Graph Neural Networks

arXiv 2409.11972 ↗First posted 18 Sep 2024cs.RO cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Enabling robots to autonomously discover high-level spatial concepts (e.g., rooms and walls) from primitive geometric observations (e.g., planar surfaces) within 3D Scene Graphs is essential for robust indoor navigation and mapping. These graphs provide a hierarchical metric-semantic representation in which such concepts are organized. To further enhance graph-SLAM performance, Factorized 3D Scene Graphs incorporate these concepts as optimization factors that constrain relative geometry and enforce global consistency. However, both stages of this process remain largely manual: concepts are typically derived using hand-crafted, concept-specific heuristics, while factors and their covariances are likewise manually designed. This reliance on manual specification limits generalization across diverse environments and scalability to new concept classes. This paper presents a novel learning-based method that infers spatial concepts online from observed vertical planes and introduces them as optimizable factors within a SLAM backend, eliminating the need to handcraft concept generation, factor design, and covariance specification. We evaluate our approach in simulated environments with complex layouts, improving room detection by 20.7% and trajectory estimation by 19.2%. Validated on real construction sites, room detection improves by 5.3% and map matching accuracy by 3.8%.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 18 Sep 2024.

Builds on

23 of 38 references.

References · 23

  1. 2017Graph Attention Networkscited by 8,854
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  3. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
  4. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
  5. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
  6. 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 205
  7. 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 195
  8. 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 175
  9. 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 170
  10. 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 141
  11. 2024Clio: Real-time Task-Driven Open-Set 3D Scene Graphscited by 81
  12. 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 76
11 more
  1. 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
  2. 2023Collaborative Dynamic 3D Scene Graphs for Automated Drivingcited by 34
  3. 2022S-Graphs+: Real-time Localization and Mapping leveraging Hierarchical Representationscited by 28
  4. 2023Indoor and Outdoor 3D Scene Graph Generation via Language-Enabled Spatial Ontologiescited by 25
  5. 2024MSD: A Benchmark Dataset for Floor Plan Generation of Building Complexescited by 13
  6. 2022Robust Structure Identification and Room Segmentation of Cluttered Indoor Environments from Occupancy Grid Mapscited by 7
  7. 2024Constrained Layout Generation with Factor Graphscited by 6
  8. 2023Learning High-level Semantic-Relational Concepts for SLAMcited by 4
  9. 2024Tightly Coupled SLAM with Imprecise Architectural Planscited by 4
  10. 2019Node Attribute Generation on Graphscited by 2
  11. 2022SCGG: A Deep Structure-Conditioned Graph Generative Modelcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.