SAD-GS: Learning Reliable 3D Semantic Gaussian Fields via Dynamic Geo-Semantic Anchoring
Not on the map. Why?
Abstract (arXiv)
Open-vocabulary 3D semantic Gaussian field learning relies on multi-view 2D supervision, whose semantic targets and spatial assignments are often unreliable. Across varying viewpoints, view-dependent features cause semantic identity drift, while propagated tracker masks introduce boundary leakage and identity switches. Directly optimizing against these unreliable 2D targets forces the 3D representation to absorb multi-view contradictions, leading to severe error accumulation. To resolve this limitation, we propose SAD-GS, a framework for learning reliable 3D semantic Gaussian fields via dynamic geo-semantic anchoring. Specifically, Semantic Anchor Distillation (SAD) distills per-view visual embeddings into consensus text anchors to establish a viewpoint-invariant semantic identity. Concurrently, the Geo-Semantic Feedback Loop (GSFL) leverages the evolving 3D field to actively filter tracker anomalies and refine spatial mask assignments via a conservative three-gate update rule. Extensive evaluations on LERF-OVS, 3D-OVS, and Mip-NeRF360 show that SAD-GS consistently achieves the best overall performance in both open-vocabulary localization and semantic segmentation. These comprehensive improvements validate the effectiveness and robustness of dynamic geo-semantic anchoring for reliable 3D semantic Gaussian field learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 54 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
48 of 54 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
36 more
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2022Language-driven Semantic Segmentationcited by 717
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2023LERF: Language Embedded Radiance Fieldscited by 543
- 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 473
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 124
- 2022GRiT: A Generative Region-to-text Transformer for Object Understandingcited by 121
- 2022Superpoint Transformer for 3D Scene Instance Segmentationcited by 116
- 2023RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understandingcited by 94
- 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
- 2024FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understandingcited by 86
- 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 82
- 2024AbsGS: Recovering Fine Details for 3D Gaussian Splattingcited by 82
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2024DiffGS: Functional Gaussian Splatting Diffusioncited by 51
- 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 51
- 2023SAMPro3D: Locating SAM Prompts in 3D for Zero-Shot Instance Segmentationcited by 44
- 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 41
- 2023Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understandingcited by 38
- 20254D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Modelscited by 35
- 2023UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenescited by 31
- 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 20
- 2025ReferSplat: Referring Segmentation in 3D Gaussian Splattingcited by 20
- 2024USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentationcited by 14
- 2025CCL-LGS: Contrastive Codebook Learning for 3D Language Gaussian Splattingcited by 12
- 2025Scene-Centric Unsupervised Panoptic Segmentationcited by 10
- 2024Open-Vocabulary SAM3D: Towards Training-free Open-Vocabulary 3D Scene Understandingcited by 7
Built on by
Not cited yet.