DIGS: Distribution-Informed Gaussian Splatting for Training-Free Open-Vocabulary 3D Segmentation
Not on the map. Why?
Abstract (arXiv)
Open-vocabulary 3D Gaussian segmentation typically binds semantic features to the per-Gaussian state via per-scene gradient training (1-4 h) or the more recent closed-form distillation. Both commit each primitive to a single feature; therefore, boundary Gaussians spanning multiple 2D instances are forced into a hard decision that degrades retrieval accuracy and yields unstable mask boundaries at render time. We present DIGS, a training-free framework with two stages, class-agnostic mapping and multi-modal encoding, that decouples instance discovery from linguistic naming. At the Gaussian level, our distribution-informed representation maintains an explicit top-M label distribution per primitive, updated by a tempered Dirichlet rule; preservation of multi-peaked label distributions at boundary primitives allows a late-argmax renderer to recover clean instance boundaries. A bidirectional state machine aggregates these distributions into a persistent class-agnostic instance ontology. The instance-level encoding stage then fuses the CLIP visual embedding of each instance's isolated 3D footprint with the CLIP-text embedding of an LLM-generated attribute description, disambiguating visually similar instances. On a single A100, DIGS completes mapping and instance encoding on LERF-OVS in 1.0-3.2 min per scene, depending on whether LLM fusion is enabled, and serves native 3D queries in 5.4 ms. It reaches 71.95% mean mIoU on LERF-OVS, outperforming both the training-free SFS and training-based LaGa baselines. DIGS also achieves the highest mean mIoU on LERF-Mask and 3D-OVS and surpasses Gaga and ObjectGS on Replica under their respective evaluation protocols. Code is available at https://github.com/ZephyrZos/DIGS.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 50 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
44 of 50 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2023LERF: Language Embedded Radiance Fieldscited by 543
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
32 more
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
- 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
- 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 177
- 2013A General Framework for Updating Belief Distributionscited by 175
- 2022Panoptic Lifting for 3D Scene Understanding with Neural Fieldscited by 174
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 135
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
- 2023Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusioncited by 64
- 2024FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimallycited by 58
- 2024Gaga: Group Any Gaussians via 3D-aware Memory Bankcited by 41
- 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 41
- 2019Bayesian Spatial Kernel Smoothing for Scalable Dense Semantic Mappingcited by 35
- 2024SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussianscited by 33
- 20243D Vision-Language Gaussian Splattingcited by 31
- 2025Rethinking End-to-End 2D to 3D Scene Segmentation in Gaussian Splattingcited by 31
- 2025ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via Gaussian Splattingcited by 25
- 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 20
- 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16
- 2025Tackling View-Dependent Semantics in 3D Language Gaussian Splattingcited by 16
- 2023ConvBKI: Real-Time Probabilistic Semantic Mapping Network with Quantifiable Uncertaintycited by 11
- 2025Segment then Splat: Unified 3D Open-Vocabulary Segmentation via Gaussian Splattingcited by 8
- 2025Splat Feature Solvercited by 7
- 2025ExtrinSplat: Decoupling Geometry and Semantics for Open-Vocabulary Understanding in 3D Gaussian Splattingcited by 6
- 2024DCSEG: Decoupled 3D Open-Set Segmentation using Gaussian Splattingcited by 4
- 2026B3-Seg: Camera-Free, Training-Free 3DGS Segmentation via Analytic EIG and Beta-Bernoulli Bayesian Updatescited by 2
Built on by
Not cited yet.