ExtrinSplat: Decoupling Geometry and Semantics for Open-Vocabulary Understanding in 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Lifting 2D open-vocabulary understanding into 3D Gaussian Splatting (3DGS) scenes is a critical challenge. Mainstream methods, built on an embedding paradigm, suffer from three key flaws: (i) geometry-semantic inconsistency, where points, rather than objects, serve as the semantic basis, limiting semantic fidelity; (ii) semantic bloat from injecting gigabytes of feature data into the geometry; and (iii) semantic rigidity, as one feature per Gaussian struggles to capture rich polysemy. To overcome these limitations, we introduce ExtrinSplat, a framework built on the extrinsic paradigm that decouples geometry from semantics. Instead of embedding features, ExtrinSplat clusters Gaussians into multi-granularity, overlapping 3D object groups. A Vision-Language Model (VLM) then interprets these groups to generate lightweight textual hypotheses, creating an extrinsic index layer that natively supports complex polysemy. By replacing costly feature embedding with lightweight indices, ExtrinSplat reduces scene adaptation time from hours to minutes and lowers storage overhead by several orders of magnitude. On benchmark tasks for open-vocabulary 3D object selection and semantic segmentation, ExtrinSplat outperforms established embedding-based frameworks, validating the efficacy and efficiency of the proposed extrinsic paradigm.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 33 of its 36 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
33 of 36 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023LERF: Language Embedded Radiance Fieldscited by 543
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 366
21 more
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
- 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 66
- 2024FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimallycited by 58
- 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 54
- 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
- 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 51
- 2023Understanding the Robustness of 3D Object Detection with Bird's-Eye-View Representations in Autonomous Drivingcited by 37
- 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 37
- 2024InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perceptioncited by 35
- 2024SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussianscited by 33
- 2024SUGAR: Pre-training 3D Visual Representations for Roboticscited by 26
- 2025COB-GS: Clear Object Boundaries in 3DGS Segmentation Based on Boundary-Adaptive Gaussian Splittingcited by 19
- 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16
- 2025Tackling View-Dependent Semantics in 3D Language Gaussian Splattingcited by 16
- 2024GradiSeg: Gradient-Guided Gaussian Segmentation with Enhanced 3D Boundary Precisioncited by 12
- 2025CAGS: Open-Vocabulary 3D Scene Understanding with Context-Aware Gaussian Splattingcited by 11
- 2025VoteSplat: Hough Voting Gaussian Splatting for 3D Scene Understandingcited by 11
- 2025Semantic Consistent Language Gaussian Splatting for Point-Level Open-vocabulary Queryingcited by 4
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026ZeroSplat: Generalized Referring Segmentation in 3D Gaussian Splattingcited by 3
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialoguecited by 2
- 2026Relation-Centric Open-Vocabulary 3D Gaussian Segmentationcited by 1
- 2026EndoMD-SLAM: Endoscopic Gaussian Splatting SLAM under Optical Degradation with Memory and Static-Transient Decompositioncited by 0
- 2026Dyn-3D: Unveiling and Resolving Ego-Motion Ambiguity in Vision-Language Modelscited by 0
- 2026DIGS: Distribution-Informed Gaussian Splatting for Training-Free Open-Vocabulary 3D Segmentationcited by 0
- 2026DIGS: Distribution-Informed Gaussian Splatting for Training-Free Open-Vocabulary 3D Segmentation12 Oct 2026
- 2026Dyn-3D: Unveiling and Resolving Ego-Motion Ambiguity in Vision-Language Models1 Sep 2026
- 2026EndoMD-SLAM: Endoscopic Gaussian Splatting SLAM under Optical Degradation with Memory and Static-Transient Decomposition9 Aug 2026
- 2026ZeroSplat: Generalized Referring Segmentation in 3D Gaussian Splatting21 Jul 2026
- 2026Relation-Centric Open-Vocabulary 3D Gaussian Segmentation1 Jul 2026
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialogue19 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Open-Vocabulary and Referring Segmentation for 3D Gaussians Using 2D Detectors
- 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splatting
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretraining
- 2024GAGS: Granularity-Aware Feature Distillation for Language Gaussian Splatting
- 2025TextSplat: Text-Guided Semantic Fusion for Generalizable Gaussian Splatting
- 2026GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splatting
- 20243D Vision-Language Gaussian Splatting
- 2024FMGS: Foundation Model Embedded 3D Gaussian Splatting for Holistic 3D Scene Understanding