mlsanityData to 14 Oct 2026

DIGS: Distribution-Informed Gaussian Splatting for Training-Free Open-Vocabulary 3D Segmentation

arXiv 2610.16177 ↗First posted 12 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-vocabulary 3D Gaussian segmentation typically binds semantic features to the per-Gaussian state via per-scene gradient training (1-4 h) or the more recent closed-form distillation. Both commit each primitive to a single feature; therefore, boundary Gaussians spanning multiple 2D instances are forced into a hard decision that degrades retrieval accuracy and yields unstable mask boundaries at render time. We present DIGS, a training-free framework with two stages, class-agnostic mapping and multi-modal encoding, that decouples instance discovery from linguistic naming. At the Gaussian level, our distribution-informed representation maintains an explicit top-M label distribution per primitive, updated by a tempered Dirichlet rule; preservation of multi-peaked label distributions at boundary primitives allows a late-argmax renderer to recover clean instance boundaries. A bidirectional state machine aggregates these distributions into a persistent class-agnostic instance ontology. The instance-level encoding stage then fuses the CLIP visual embedding of each instance's isolated 3D footprint with the CLIP-text embedding of an LLM-generated attribute description, disambiguating visually similar instances. On a single A100, DIGS completes mapping and instance encoding on LERF-OVS in 1.0-3.2 min per scene, depending on whether LLM fusion is enabled, and serves native 3D queries in 5.4 ms. It reaches 71.95% mean mIoU on LERF-OVS, outperforming both the training-free SFS and training-based LaGa baselines. DIGS also achieves the highest mean mIoU on LERF-Mask and 3D-OVS and surpasses Gaga and ObjectGS on Replica under their respective evaluation protocols. Code is available at https://github.com/ZephyrZos/DIGS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 50 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

44 of 50 references.

References · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  7. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  8. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
  9. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  10. 2023LERF: Language Embedded Radiance Fieldscited by 543
  11. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
  12. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
32 more
  1. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  2. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  3. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  4. 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
  5. 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
  6. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
  7. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
  8. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  9. 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 177
  10. 2013A General Framework for Updating Belief Distributionscited by 175
  11. 2022Panoptic Lifting for 3D Scene Understanding with Neural Fieldscited by 174
  12. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  13. 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 135
  14. 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
  15. 2023Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusioncited by 64
  16. 2024FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimallycited by 58
  17. 2024Gaga: Group Any Gaussians via 3D-aware Memory Bankcited by 41
  18. 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 41
  19. 2019Bayesian Spatial Kernel Smoothing for Scalable Dense Semantic Mappingcited by 35
  20. 2024SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussianscited by 33
  21. 20243D Vision-Language Gaussian Splattingcited by 31
  22. 2025Rethinking End-to-End 2D to 3D Scene Segmentation in Gaussian Splattingcited by 31
  23. 2025ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via Gaussian Splattingcited by 25
  24. 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 20
  25. 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16
  26. 2025Tackling View-Dependent Semantics in 3D Language Gaussian Splattingcited by 16
  27. 2023ConvBKI: Real-Time Probabilistic Semantic Mapping Network with Quantifiable Uncertaintycited by 11
  28. 2025Segment then Splat: Unified 3D Open-Vocabulary Segmentation via Gaussian Splattingcited by 8
  29. 2025Splat Feature Solvercited by 7
  30. 2025ExtrinSplat: Decoupling Geometry and Semantics for Open-Vocabulary Understanding in 3D Gaussian Splattingcited by 6
  31. 2024DCSEG: Decoupled 3D Open-Set Segmentation using Gaussian Splattingcited by 4
  32. 2026B3-Seg: Camera-Free, Training-Free 3DGS Segmentation via Analytic EIG and Beta-Bernoulli Bayesian Updatescited by 2

Built on by

Not cited yet.