mlsanityData to 14 Oct 2026

Training-Free Hierarchical Scene Understanding for Gaussian Splatting with Superpoint Graphs

arXiv 2504.13153 ↗First posted 17 Apr 2025cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

Bridging natural language and 3D geometry is a crucial step toward flexible, language-driven scene understanding. While recent advances in 3D Gaussian Splatting (3DGS) have enabled fast and high-quality scene reconstruction, research has also explored incorporating open-vocabulary understanding into 3DGS. However, most existing methods require iterative optimization over per-view 2D semantic feature maps, which not only results in inefficiencies but also leads to inconsistent 3D semantics across views. To address these limitations, we introduce a training-free framework that constructs a superpoint graph directly from Gaussian primitives. The superpoint graph partitions the scene into spatially compact and semantically coherent regions, forming view-consistent 3D entities and providing a structured foundation for open-vocabulary understanding. Based on the graph structure, we design an efficient reprojection strategy that lifts 2D semantic features onto the superpoints, avoiding costly multi-view iterative training. The resulting representation ensures strong 3D semantic coherence and naturally supports hierarchical understanding, enabling both coarse- and fine-grained open-vocabulary perception within a unified semantic field. Extensive experiments demonstrate that our method achieves state-of-the-art open-vocabulary segmentation performance, with semantic field reconstruction completed over 30× faster. Our code will be available at https://github.com/Atrovast/THGS.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 17 Apr 2025.

Builds on

38 of 56 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  6. 2022Language-driven Semantic Segmentationcited by 717
  7. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  8. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  9. 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 385
  10. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  11. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
  12. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
26 more
  1. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  2. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
  3. 2023SAM3D: Segment Anything in 3D Scenescited by 157
  4. 2024WildGaussians: 3D Gaussian Splatting in the Wildcited by 152
  5. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  6. 2023Multi-Scale 3D Gaussian Splatting for Anti-Aliased Renderingcited by 138
  7. 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
  8. 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 124
  9. 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
  10. 2023CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIPcited by 89
  11. 2023OVIR-3D: Open-Vocabulary 3D Instance Retrieval Without Training on 3D Datacited by 81
  12. 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
  13. 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 52
  14. 2019Point Cloud Oversegmentation with Graph-Structured Deep Metric Learningcited by 42
  15. 2024WE-GS: An In-the-wild Efficient 3D Gaussian Representation for Unconstrained Photo Collectionscited by 33
  16. 2024SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussianscited by 33
  17. 2024OV-NeRF: Open-vocabulary Neural Radiance Fields with Vision and Language Foundation Models for 3D Semantic Understandingcited by 22
  18. 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splattingcited by 22
  19. 2021Spline Positional Encoding for Learning 3D Implicit Signed Distance Fieldscited by 21
  20. 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16
  21. 2024TAR3D: Creating High-Quality 3D Assets via Next-Part Predictioncited by 16
  22. 2025AR-1-to-3: Single Image to Consistent 3D Object Generation via Next-View Predictioncited by 15
  23. 2023TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshescited by 14
  24. 2024Rethinking Open-Vocabulary Segmentation of Radiance Fields in 3D Spacecited by 12
  25. 2025Evolving High-Quality Rendering and Reconstruction in a Unified Framework with Contribution-Adaptive Regularizationcited by 10
  26. 2025WildSeg3D: Segment Any 3D Objects in the Wild from 2D Imagescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 6.

10 papers.