mlsanityData to 14 Oct 2026

ExtrinSplat: Decoupling Geometry and Semantics for Open-Vocabulary Understanding in 3D Gaussian Splatting

arXiv 2509.22225 ↗First posted 26 Sep 2025cs.CV cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Lifting 2D open-vocabulary understanding into 3D Gaussian Splatting (3DGS) scenes is a critical challenge. Mainstream methods, built on an embedding paradigm, suffer from three key flaws: (i) geometry-semantic inconsistency, where points, rather than objects, serve as the semantic basis, limiting semantic fidelity; (ii) semantic bloat from injecting gigabytes of feature data into the geometry; and (iii) semantic rigidity, as one feature per Gaussian struggles to capture rich polysemy. To overcome these limitations, we introduce ExtrinSplat, a framework built on the extrinsic paradigm that decouples geometry from semantics. Instead of embedding features, ExtrinSplat clusters Gaussians into multi-granularity, overlapping 3D object groups. A Vision-Language Model (VLM) then interprets these groups to generate lightweight textual hypotheses, creating an extrinsic index layer that natively supports complex polysemy. By replacing costly feature embedding with lightweight indices, ExtrinSplat reduces scene adaptation time from hours to minutes and lowers storage overhead by several orders of magnitude. On benchmark tasks for open-vocabulary 3D object selection and semantic segmentation, ExtrinSplat outperforms established embedding-based frameworks, validating the efficacy and efficiency of the proposed extrinsic paradigm.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 33 of its 36 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

33 of 36 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  7. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  8. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  9. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  10. 2023LERF: Language Embedded Radiance Fieldscited by 543
  11. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  12. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
21 more
  1. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  2. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
  3. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  4. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
  5. 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 66
  6. 2024FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimallycited by 58
  7. 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 54
  8. 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
  9. 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 51
  10. 2023Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Drivingcited by 37
  11. 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 37
  12. 2024InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perceptioncited by 35
  13. 2024SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussianscited by 33
  14. 2024SUGAR: Pre-training 3D Visual Representations for Roboticscited by 26
  15. 2025COB-GS: Clear Object Boundaries in 3DGS Segmentation Based on Boundary-Adaptive Gaussian Splittingcited by 19
  16. 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16
  17. 2025Tackling View-Dependent Semantics in 3D Language Gaussian Splattingcited by 16
  18. 2024GradiSeg: Gradient-Guided Gaussian Segmentation with Enhanced 3D Boundary Precisioncited by 12
  19. 2025CAGS: Open-Vocabulary 3D Scene Understanding with Context-Aware Gaussian Splattingcited by 11
  20. 2025VoteSplat: Hough Voting Gaussian Splatting for 3D Scene Understandingcited by 11
  21. 2025Semantic Consistent Language Gaussian Splatting for Point-Level Open-vocabulary Queryingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Open-Vocabulary and Referring Segmentation for 3D Gaussians Using 2D Detectors
  2. 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splatting
  3. 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretraining
  4. 2024GAGS: Granularity-Aware Feature Distillation for Language Gaussian Splatting
  5. 2025TextSplat: Text-Guided Semantic Fusion for Generalizable Gaussian Splatting
  6. 2026GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splatting
  7. 20243D Vision-Language Gaussian Splatting
  8. 2024FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understanding