mlsanityData to 14 Oct 2026

LangStreet: Persistent Language Fields for Anchor-Decoded Street Gaussians

arXiv 2609.11616 ↗First posted 10 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Language Gaussian fields implicitly assume that the primitive carrying semantics remains identifiable across views. This assumption breaks in scalable anchor-decoded representations, where persistent anchors generate view-conditioned child Gaussians whose geometry and appearance vary with the camera. We introduce Ours, a persistent language field for such structured Gaussian scenes. Our key idea is semantic ownership: transient children route observations, while persistent decoder slots and their parent anchors own the language field. We use alpha-compositing responsibilities to accumulate additive directional evidence at slots; these statistics marginalize exactly to anchors. We then complete weakly supported slots with anchor-aligned evidence while preserving the anchor direction, and represent slot detail through low-rank residuals in anchor-relative semantic coordinates. Our primary model, Ours (base), stores anchor features together with compact slot residuals. Ours (light) retains only anchor features, whereas Ours (max) stores the full-dimensional completed slot features explicitly. Without scene-specific semantic optimization, Ours (base) nearly matches Ours (max) across KITTI, Virtual KITTI, and Waymo. On KITTI, it achieves 34.19 2D mIoU with a 2.72 GiB effective feature footprint, compared with 34.20 mIoU and 12.90 GiB for Ours (max). The same accuracy-storage trend holds on Virtual KITTI and Waymo. These results show that language fields on view-conditioned splats require persistent semantic ownership, conserved evidence, and a hierarchy that balances stability, detail, and representation cost. Our code, checkpoints, and benchmark suite will be publicly available.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 42 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

40 of 42 references.

References · 40

  1. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  2. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  3. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
  4. 2023LERF: Language Embedded Radiance Fieldscited by 543
  5. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  6. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  7. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
  8. 2020Virtual KITTI 2cited by 353
  9. 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
  10. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
  11. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 230
  12. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
28 more
  1. 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 216
  2. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
  3. 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 192
  4. 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
  5. 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
  6. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  7. 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 142
  8. 2024GARField: Group Anything with Radiance Fieldscited by 109
  9. 2024OpenNeRF: Open Set 3D Neural Scene Segmentation with Pixel-Wise Features and Rendered Novel Viewscited by 69
  10. 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 52
  11. 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 41
  12. 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 37
  13. 20254D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Modelscited by 35
  14. 2024Spectrally Pruned Gaussian Fields with Neural Compensationcited by 33
  15. 2024Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenescited by 30
  16. 2025GaussianDWM: 3D Gaussian Driving World Model for Unified Scene Understanding and Multi-Modal Generationcited by 23
  17. 2025CF3: Compact and Fast 3D Feature Fieldscited by 11
  18. 2025Chorus: Multi-Teacher Pretraining for Holistic 3D Gaussian Scene Encodingcited by 10
  19. 2022City-scale Incremental Neural Mapping with Three-layer Sampling and Panoptic Representationcited by 7
  20. 2025Splat Feature Solvercited by 7
  21. 2024Query3D: LLM-Powered Open-Vocabulary Scene Segmentation with Language Embedded 3D Gaussiancited by 5
  22. 2026LightSplat: Fast and Memory-Efficient Open-Vocabulary 3D Scene Understanding in Five Secondscited by 5
  23. 2026Sparse Code Uplifting for Efficient 3D Language Gaussian Splattingcited by 2
  24. 2026LangFlash: Feed-forward 3D Language Gaussian Splatting from Sparse Unposed Imagescited by 2
  25. 2026QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrievalcited by 1
  26. 2026CoSAG: Compact Semantic Anchor Gaussians via Training-Free Rate-Distortion Codingcited by 1
  27. 2026OutLangSplat: 3D Language Gaussian Splatting for UAV Outdoor Scenescited by 1
  28. 2026Gaussian-JEPA: Joint-Embedding Predictive Learning for 3D Gaussian Splatscited by 1

Built on by

Not cited yet.