mlsanityData to 14 Oct 2026

GALA: Guided Attention with Language Alignment for Open Vocabulary Gaussian Splatting

arXiv 2508.14278 ↗First posted 19 Aug 2025cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

3D scene reconstruction and understanding have gained increasing popularity, yet existing methods still struggle to capture fine-grained, language-aware 3D representations from 2D images. In this paper, we present GALA, a novel framework for open-vocabulary 3D scene understanding with 3D Gaussian Splatting (3DGS). GALA distills a scene-specific 3D instance feature field via self-supervised contrastive learning. To extend to generalized language feature fields, we introduce the core contribution of GALA, a cross-attention module with two learnable codebooks that encode view-independent semantic embeddings. This design not only ensures intra-instance feature similarity but also supports seamless 2D and 3D open-vocabulary queries. It reduces memory consumption by avoiding per-Gaussian high-dimensional feature learning. Extensive experiments on real-world datasets demonstrate GALA's remarkable open-vocabulary performance on both 2D and 3D.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 40 of its 48 references that are in the map. First posted on arXiv 19 Aug 2025.

Builds on

40 of 48 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023Segment Anythingcited by 8,234
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  10. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  11. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  12. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
28 more
  1. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  2. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  3. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
  4. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  5. 2023LERF: Language Embedded Radiance Fieldscited by 543
  6. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  7. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  8. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  9. 2022Visual Language Maps for Robot Navigationcited by 365
  10. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  11. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
  12. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
  13. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  14. 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 113
  15. 2024GARField: Group Anything with Radiance Fieldscited by 109
  16. 2024Clio: Real-time Task-Driven Open-Set 3D Scene Graphscited by 81
  17. 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
  18. 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
  19. 2023Aligning and Prompting Everything All at Once for Universal Visual Perceptioncited by 60
  20. 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
  21. 2024GeoGaussian: Geometry-aware Gaussian Splatting for Scene Renderingcited by 52
  22. 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 51
  23. 2024GaussNav: Gaussian Splatting for Visual Navigationcited by 49
  24. 2024InstanceGaussian: Appearance-Semantic Joint Gaussian Representation for 3D Instance-Level Perceptioncited by 35
  25. 2024SuperGSeg: Open-Vocabulary 3D Segmentation with Structured Super-Gaussianscited by 33
  26. 2023DNS SLAM: Dense Neural Semantic-Informed SLAMcited by 23
  27. 2024GAGS: Granularity-Aware Feature Distillation for Language Gaussian Splattingcited by 18
  28. 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.