Gen-LangSplat: Generalized Language Gaussian Splatting with Pre-Trained Feature Compression
Not on the map. Why?
Abstract (arXiv)
Modeling open-vocabulary language fields in 3D is essential for intuitive human-AI interaction and querying within physical environments. State-of-the-art approaches, such as LangSplat, leverage 3D Gaussian Splatting to efficiently construct these language fields, encoding features distilled from high-dimensional models like CLIP. However, this efficiency is currently offset by the requirement to train a scene-specific language autoencoder for feature compression, introducing a costly, per-scene optimization bottleneck that hinders deployment scalability. In this work, we introduce Gen-LangSplat, that eliminates this requirement by replacing the scene-wise autoencoder with a generalized autoencoder, pre-trained extensively on the large-scale ScanNet dataset. This architectural shift enables the use of a fixed, compact latent space for language features across any new scene without any scene-specific training. By removing this dependency, our entire language field construction process achieves a efficiency boost while delivering querying performance comparable to, or exceeding, the original LangSplat method. To validate our design choice, we perform a thorough ablation study empirically determining the optimal latent embedding dimension and quantifying representational fidelity using Mean Squared Error and cosine similarity between the original and reprojected 512-dimensional CLIP embeddings. Our results demonstrate that generalized embeddings can efficiently and accurately support open-vocabulary querying in novel 3D scenes, paving the way for scalable, real-time interactive 3D AI applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 25 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
22 of 25 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022Language-driven Semantic Segmentationcited by 711
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
- 2023LERF: Language Embedded Radiance Fieldscited by 538
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
10 more
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
- 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 133
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
- 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splattingcited by 40
Built on by
Citing papers per year: 2026: 1.
1 paper.