Training-Free Hierarchical Scene Understanding for Gaussian Splatting with Superpoint Graphs
Not on the map. Why?
Abstract (arXiv)
Bridging natural language and 3D geometry is a crucial step toward flexible, language-driven scene understanding. While recent advances in 3D Gaussian Splatting (3DGS) have enabled fast and high-quality scene reconstruction, research has also explored incorporating open-vocabulary understanding into 3DGS. However, most existing methods require iterative optimization over per-view 2D semantic feature maps, which not only results in inefficiencies but also leads to inconsistent 3D semantics across views. To address these limitations, we introduce a training-free framework that constructs a superpoint graph directly from Gaussian primitives. The superpoint graph partitions the scene into spatially compact and semantically coherent regions, forming view-consistent 3D entities and providing a structured foundation for open-vocabulary understanding. Based on the graph structure, we design an efficient reprojection strategy that lifts 2D semantic features onto the superpoints, avoiding costly multi-view iterative training. The resulting representation ensures strong 3D semantic coherence and naturally supports hierarchical understanding, enabling both coarse- and fine-grained open-vocabulary perception within a unified semantic field. Extensive experiments demonstrate that our method achieves state-of-the-art open-vocabulary segmentation performance, with semantic field reconstruction completed over 30× faster. Our code will be available at https://github.com/Atrovast/THGS.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 17 Apr 2025.
Builds on
38 of 56 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2022Language-driven Semantic Segmentationcited by 717
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 385
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
26 more
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
- 2023SAM3D: Segment Anything in 3D Scenescited by 157
- 2024WildGaussians: 3D Gaussian Splatting in the Wildcited by 152
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
- 2023Multi-Scale 3D Gaussian Splatting for Anti-Aliased Renderingcited by 138
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 124
- 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
- 2023CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIPcited by 89
- 2023OVIR-3D: Open-Vocabulary 3D Instance Retrieval Without Training on 3D Datacited by 81
- 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 52
- 2019Point Cloud Oversegmentation with Graph-Structured Deep Metric Learningcited by 42
- 2024WE-GS: An In-the-wild Efficient 3D Gaussian Representation for Unconstrained Photo Collectionscited by 33
- 2024SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussianscited by 33
- 2024OV-NeRF: Open-vocabulary Neural Radiance Fields with Vision and Language Foundation Models for 3D Semantic Understandingcited by 22
- 2025Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splattingcited by 22
- 2021Spline Positional Encoding for Learning 3D Implicit Signed Distance Fieldscited by 21
- 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16
- 2024TAR3D: Creating High-Quality 3D Assets via Next-Part Predictioncited by 16
- 2025AR-1-to-3: Single Image to Consistent 3D Object Generation via Next-View Predictioncited by 15
- 2023TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshescited by 14
- 2024Rethinking Open-Vocabulary Segmentation of Radiance Fields in 3D Spacecited by 12
- 2025Evolving High-Quality Rendering and Reconstruction in a Unified Framework with Contribution-Adaptive Regularizationcited by 10
- 2025WildSeg3D: Segment Any 3D Objects in the Wild from 2D Imagescited by 6
Built on by
Citing papers per year: 2025: 4; 2026: 6.
10 papers.
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2025DeOcc-1-to-3: 3D De-Occlusion from a Single Image via Self-Supervised Multi-View Diffusioncited by 10
- 2025XSpecMesh: Quality-Preserving Auto-Regressive Mesh Generation Acceleration via Multi-Head Speculative Decodingcited by 6
- 2026ReLaGS: Relational Language Gaussian Splattingcited by 6
- 2025Taking Language Embedded 3D Gaussian Splatting into the Wildcited by 1
- 2026PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understandingcited by 1
- 2026Relation-Centric Open-Vocabulary 3D Gaussian Segmentationcited by 1
- 2026Scene2Sound: Auditory-Grounded Soundscape Generation for 3D Gaussian Worldscited by 0
- 2026LEGO: Leveled Language Gaussian Splattingcited by 0
- 2026NormLift: From Lifted Features To Semantic Reliability In 3D Gaussian Splattingcited by 0
- 2026NormLift: From Lifted Features To Semantic Reliability In 3D Gaussian Splatting16 Sep 2026
- 2026LEGO: Leveled Language Gaussian Splatting10 Aug 2026
- 2026Scene2Sound: Auditory-Grounded Soundscape Generation for 3D Gaussian Worlds1 Aug 2026
- 2026Relation-Centric Open-Vocabulary 3D Gaussian Segmentation1 Jul 2026
- 2026PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding4 Jun 2026
- 2026ReLaGS: Relational Language Gaussian Splatting18 Mar 2026
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025XSpecMesh: Quality-Preserving Auto-Regressive Mesh Generation Acceleration via Multi-Head Speculative Decoding31 Jul 2025
- 2025Taking Language Embedded 3D Gaussian Splatting into the Wild26 Jul 2025
- 2025DeOcc-1-to-3: 3D De-Occlusion from a Single Image via Self-Supervised Multi-View Diffusion26 Jun 2025