mlsanityData to 14 Oct 2026

TreeGaussian: Tree-Guided Cascaded Contrastive Learning for Hierarchical Consistent 3D Gaussian Scene Segmentation and Understanding

arXiv 2604.03309 ↗First posted 31 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting (3DGS) has emerged as a real-time, differentiable representation for neural scene understanding. However, existing 3DGS-based methods struggle to represent hierarchical 3D semantic structures and capture whole-part relationships in complex scenes. Moreover, dense pairwise comparisons and inconsistent hierarchical labels from 2D priors hinder feature learning, resulting in suboptimal segmentation. To address these limitations, we introduce TreeGaussian, a tree-guided cascaded contrastive learning framework that explicitly models hierarchical semantic relationships and reduces redundancy in contrastive supervision. By constructing a multi-level object tree, TreeGaussian enables structured learning across object-part hierarchies. In addition, we propose a two-stage cascaded contrastive learning strategy that progressively refines feature representations from global to local, mitigating saturation and stabilizing training. A Consistent Segmentation Detection (CSD) mechanism and a graph-based denoising module are further introduced to align segmentation modes across views while suppressing unstable Gaussian points, enhancing segmentation consistency and quality. Extensive experiments, including open-vocabulary 3D object selection, 3D point cloud understanding, and ablation studies, demonstrate the effectiveness and robustness of our approach.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 44 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

34 of 44 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  9. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  10. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
  11. 2022Language-driven Semantic Segmentationcited by 717
  12. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
22 more
  1. 2023LERF: Language Embedded Radiance Fieldscited by 543
  2. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  3. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  4. 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
  5. 2019Neural Point-Based Graphicscited by 327
  6. 2022Matryoshka Representation Learningcited by 282
  7. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
  8. 2020OccuSeg: Occupancy-aware 3D Instance Segmentationcited by 177
  9. 2023Segment Any 3D Gaussianscited by 161
  10. 2019Learning Object Bounding Boxes for 3D Instance Segmentation on Point Cloudscited by 156
  11. 2018GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloudcited by 146
  12. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  13. 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 135
  14. 2024GARField: Group Anything with Radiance Fieldscited by 109
  15. 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Graspingcited by 78
  16. 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
  17. 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
  18. 2020DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshescited by 42
  19. 2024InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perceptioncited by 35
  20. 2024N2F2: Hierarchical Scene Understanding with Nested Neural Feature Fieldscited by 34
  21. 2024Spectrally Pruned Gaussian Fields with Neural Compensationcited by 33
  22. 2021Navigation-Oriented Scene Understanding for Robotic Autonomy: Learning to Segment Driveability in Egocentric Imagescited by 6

Built on by

Not cited yet.