mlsanityData to 7 Oct 2026

Gen-LangSplat: Generalized Language Gaussian Splatting with Pre-Trained Feature Compression

arXiv 2510.22930 ↗First posted 27 Oct 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Modeling open-vocabulary language fields in 3D is essential for intuitive human-AI interaction and querying within physical environments. State-of-the-art approaches, such as LangSplat, leverage 3D Gaussian Splatting to efficiently construct these language fields, encoding features distilled from high-dimensional models like CLIP. However, this efficiency is currently offset by the requirement to train a scene-specific language autoencoder for feature compression, introducing a costly, per-scene optimization bottleneck that hinders deployment scalability. In this work, we introduce Gen-LangSplat, that eliminates this requirement by replacing the scene-wise autoencoder with a generalized autoencoder, pre-trained extensively on the large-scale ScanNet dataset. This architectural shift enables the use of a fixed, compact latent space for language features across any new scene without any scene-specific training. By removing this dependency, our entire language field construction process achieves a efficiency boost while delivering querying performance comparable to, or exceeding, the original LangSplat method. To validate our design choice, we perform a thorough ablation study empirically determining the optimal latent embedding dimension and quantifying representational fidelity using Mean Squared Error and cosine similarity between the original and reprojected 512-dimensional CLIP embeddings. Our results demonstrate that generalized embeddings can efficiently and accurately support open-vocabulary querying in novel 3D scenes, paving the way for scalable, real-time interactive 3D AI applications.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 25 references that are in the map. First posted on arXiv 27 Oct 2025.

Builds on

22 of 25 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Segment Anythingcited by 8,158
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  7. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  9. 2022Language-driven Semantic Segmentationcited by 711
  10. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
  11. 2023LERF: Language Embedded Radiance Fieldscited by 538
  12. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
10 more
  1. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  2. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  3. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  4. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
  5. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  6. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
  7. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  8. 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 133
  9. 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
  10. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splattingcited by 40

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.