mlsanityData to 14 Oct 2026

SAD-GS: Learning Reliable 3D Semantic Gaussian Fields via Dynamic Geo-Semantic Anchoring

arXiv 2606.29376 ↗First posted 28 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-vocabulary 3D semantic Gaussian field learning relies on multi-view 2D supervision, whose semantic targets and spatial assignments are often unreliable. Across varying viewpoints, view-dependent features cause semantic identity drift, while propagated tracker masks introduce boundary leakage and identity switches. Directly optimizing against these unreliable 2D targets forces the 3D representation to absorb multi-view contradictions, leading to severe error accumulation. To resolve this limitation, we propose SAD-GS, a framework for learning reliable 3D semantic Gaussian fields via dynamic geo-semantic anchoring. Specifically, Semantic Anchor Distillation (SAD) distills per-view visual embeddings into consensus text anchors to establish a viewpoint-invariant semantic identity. Concurrently, the Geo-Semantic Feedback Loop (GSFL) leverages the evolving 3D field to actively filter tracker anomalies and refine spatial mask assignments via a conservative three-gate update rule. Extensive evaluations on LERF-OVS, 3D-OVS, and Mip-NeRF360 show that SAD-GS consistently achieves the best overall performance in both open-vocabulary localization and semantic segmentation. These comprehensive improvements validate the effectiveness and robustness of dynamic geo-semantic anchoring for reliable 3D semantic Gaussian field learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 54 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

48 of 54 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023Segment Anythingcited by 8,234
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2025Qwen2.5-VL Technical Reportcited by 5,587
  8. 2025Qwen3-VL Technical Reportcited by 2,793
  9. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  10. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  11. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  12. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
36 more
  1. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  2. 2022Language-driven Semantic Segmentationcited by 717
  3. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
  4. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
  5. 2023LERF: Language Embedded Radiance Fieldscited by 543
  6. 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 473
  7. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  8. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  9. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  10. 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
  11. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  12. 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
  13. 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 124
  14. 2022GRiT: A Generative Region-to-text Transformer for Object Understandingcited by 121
  15. 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
  16. 2023RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understandingcited by 94
  17. 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
  18. 2024FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understandingcited by 86
  19. 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 82
  20. 2024AbsGS: Recovering Fine Details for 3D Gaussian Splattingcited by 82
  21. 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
  22. 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
  23. 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
  24. 2024DiffGS: Functional Gaussian Splatting Diffusioncited by 51
  25. 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 51
  26. 2023SAMPro3D: Locating SAM Prompts in 3D for Zero-Shot Instance Segmentationcited by 44
  27. 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 41
  28. 2023Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understandingcited by 38
  29. 20254D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Modelscited by 35
  30. 2023UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenescited by 31
  31. 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 20
  32. 2025ReferSplat: Referring Segmentation in 3D Gaussian Splattingcited by 20
  33. 2024USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentationcited by 14
  34. 2025CCL-LGS: Contrastive Codebook Learning for 3D Language Gaussian Splattingcited by 12
  35. 2025Scene-Centric Unsupervised Panoptic Segmentationcited by 10
  36. 2024Open-Vocabulary SAM3D: Towards Training-free Open-Vocabulary 3D Scene Understandingcited by 7

Built on by

Not cited yet.