Hydra++: Real-Time Hierarchical 3D Scene Graph Construction With Object-Level Shape Estimation
Not on the map. Why?
Abstract (arXiv)
3D scene graphs provide a hierarchical abstraction of environments by encoding spatial entities, such as objects and places, and their relationships. However, existing scene graph systems model object geometry coarsely, relying on partial point clouds or class-level CAD templates, which limits instance-specific shape detail. This paper presents Hydra++, a system-level investigation into how learning-based object shape estimators can be integrated into a hierarchical 3D scene graph pipeline. Hydra++ incorporates category-agnostic shape estimation and a reprojection-mask consistency check to reject degenerate predictions from partial observations or imprecise segmentation. In its default CRISP-based configuration, Hydra++ performs online scene graph construction; slower estimators such as SAM3D are evaluated as modular alternatives to demonstrate generalization-latency trade-offs. Furthermore, to address the challenges of sparse and noisy depth measurements in outdoor environments, Hydra++ supports a hybrid LiDAR-camera configuration for large-scale operation, improving scene-level reconstruction quality. Experiments in both simulation and real-world outdoor campus scenarios demonstrate that Hydra++ improves object- and scene-level reconstruction quality. Project page is available at https://hydra-plusplus.github.io/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
28 of 35 references.
References · 28
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
- 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
- 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 144
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 136
- 2018CubeSLAM: Monocular 3D Object SLAMcited by 102
16 more
- 2018QuadricSLAM: Dual Quadrics from Object Detections as Landmarks in Object-oriented SLAMcited by 86
- 2024Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulationcited by 70
- 2018MID-Fusion: Octree-based Object-Level Multi-Instance Dynamic SLAMcited by 65
- 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
- 2021Panoptic Multi-TSDFs: a Flexible Representation for Online Multi-resolution Volumetric Mapping and Long-term Dynamic Scene Consistencycited by 39
- 2024Khronos: A Unified Approach for Spatio-Temporal Metric-Semantic SLAM in Dynamic Environmentscited by 36
- 2023Collaborative Dynamic 3D Scene Graphs for Automated Drivingcited by 34
- 2021DSP-SLAM: Object Oriented SLAM with Deep Shape Priorscited by 30
- 2021Patchwork: Concentric Zone-based Region-wise Ground Segmentation with Ground Likelihood Estimation Using a 3D LiDAR Sensorcited by 29
- 2022S-Graphs+: Real-time Localization and Mapping leveraging Hierarchical Representationscited by 28
- 2022Situational Graphs for Robot Navigation in Structured Indoor Environmentscited by 21
- 2023Resilient and Distributed Multi-Robot Visual SLAM: Datasets, Experiments, and Lessons Learnedcited by 16
- 2024SlideSLAM: Sparse, Lightweight, Decentralized Metric-Semantic SLAM for Multi-Robot Navigationcited by 11
- 2021ELLIPSDF: Joint Object Pose and Shape Optimization with a Bi-level Ellipsoid and Signed Distance Function Descriptioncited by 10
- 2024CRISP: Object Pose and Shape Estimation with Test-Time Adaptationcited by 9
- 2025Box Pose and Shape Estimation and Domain Adaptation for Large-Scale Warehouse Automationcited by 2
Built on by
Not cited yet.