GALA: Guided Attention with Language Alignment for Open Vocabulary Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
3D scene reconstruction and understanding have gained increasing popularity, yet existing methods still struggle to capture fine-grained, language-aware 3D representations from 2D images. In this paper, we present GALA, a novel framework for open-vocabulary 3D scene understanding with 3D Gaussian Splatting (3DGS). GALA distills a scene-specific 3D instance feature field via self-supervised contrastive learning. To extend to generalized language feature fields, we introduce the core contribution of GALA, a cross-attention module with two learnable codebooks that encode view-independent semantic embeddings. This design not only ensures intra-instance feature similarity but also supports seamless 2D and 3D open-vocabulary queries. It reduces memory consumption by avoiding per-Gaussian high-dimensional feature learning. Extensive experiments on real-world datasets demonstrate GALA's remarkable open-vocabulary performance on both 2D and 3D.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 40 of its 48 references that are in the map. First posted on arXiv 19 Aug 2025.
Builds on
40 of 48 references.
References · 40
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
28 more
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2023LERF: Language Embedded Radiance Fieldscited by 543
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023LangSplat: 3D Language Gaussian Splattingcited by 415
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2022Visual Language Maps for Robot Navigationcited by 365
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
- 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 113
- 2024GARField: Group Anything with Radiance Fieldscited by 109
- 2024Clio: Real-time Task-Driven Open-Set 3D Scene Graphscited by 81
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
- 2023Aligning and Prompting Everything All at Once for Universal Visual Perceptioncited by 60
- 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
- 2024GeoGaussian: Geometry-aware Gaussian Splatting for Scene Renderingcited by 52
- 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 51
- 2024GaussNav: Gaussian Splatting for Visual Navigationcited by 49
- 2024InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perceptioncited by 35
- 2024SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussianscited by 33
- 2023DNS SLAM: Dense Neural Semantic-Informed SLAMcited by 23
- 2024GAGS: Granularity-Aware Feature Distillation for Language Gaussian Splattingcited by 18
- 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025OVSeg3R: Learn Open-vocabulary Instance Segmentation from 2D via 3D Reconstructioncited by 4
- 2025SING3R-SLAM: Submap-based Indoor Monocular Gaussian SLAM with 3D Reconstruction Priorscited by 2
- 2026Sparse Code Uplifting for Efficient 3D Language Gaussian Splattingcited by 2
- 2026OpenGaFF: Open-Vocabulary Gaussian Feature Field with Codebook Attentioncited by 1
- 2026NormLift: From Lifted Features To Semantic Reliability In 3D Gaussian Splattingcited by 0
- 2026EviSplat: Preserving Multi-View Evidence in 3D Gaussian Splatting for Open-Vocabulary Segmentationcited by 0
- 2026EviSplat: Preserving Multi-View Evidence in 3D Gaussian Splatting for Open-Vocabulary Segmentation28 Sep 2026
- 2026NormLift: From Lifted Features To Semantic Reliability In 3D Gaussian Splatting16 Sep 2026
- 2026Sparse Code Uplifting for Efficient 3D Language Gaussian Splatting13 May 2026
- 2026OpenGaFF: Open-Vocabulary Gaussian Feature Field with Codebook Attention7 May 2026
- 2025SING3R-SLAM: Submap-based Indoor Monocular Gaussian SLAM with 3D Reconstruction Priors21 Nov 2025
- 2025OVSeg3R: Learn Open-vocabulary Instance Segmentation from 2D via 3D Reconstruction28 Sep 2025