mlsanityData to 14 Oct 2026

QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrieval

arXiv 2606.19733 ↗First posted 18 Jun 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Efficiently retrieving specific 3D instances from large-scale scenes via natural language prompts remains a formidable challenge in multimedia analysis. Existing approaches predominantly follow a "scene-level embedding" paradigm, which requires distilling high-dimensional semantic features into every 3D primitive. This strategy suffers from a fundamental architectural bottleneck: memory and computational costs scale linearly with scene complexity, inevitably triggering out-of-memory (OOM) failures in city-scale environments. To address this barrier, we propose QueryGaussian, a training-free framework for expeditious and scalable open-vocabulary 3D instance retrieval. Unlike holistic semantic distillation, QueryGaussian employs an instance-level query mechanism that decouples semantic understanding from geometric representation. Specifically, we leverage pre-trained 2D vision models to interpret user prompts and lift segmentation masks into 3D via a concurrent maximum-weight association strategy, ensuring semantic-visual consistency. To mitigate projection ambiguity, we introduce a temporal fusion module with multi-stage adaptive density clustering. Experimental results demonstrate that QueryGaussian not only matches the accuracy of state-of-the-art methods but also delivers a decisive efficiency leap, reducing GPU memory usage by over 70% and accelerating inference by 180x. Crucially, QueryGaussian enables expeditious instance retrieval on city-scale scenes containing tens of millions of Gaussians using consumer-grade hardware.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

32 of 38 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  7. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  8. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  9. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  10. 2023LERF: Language Embedded Radiance Fieldscited by 543
  11. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  12. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
20 more
  1. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 398
  2. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  3. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
  4. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  5. 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
  6. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 230
  7. 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 213
  8. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  9. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
  10. 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 192
  11. 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
  12. 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
  13. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  14. 2023Multi-Scale 3D Gaussian Splatting for Anti-Aliased Renderingcited by 138
  15. 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
  16. 2024SA-GS: Scale-Adaptive Gaussian Splatting for Training-Free Anti-Aliasingcited by 41
  17. 2024TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Renderingcited by 33
  18. 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
  19. 2024A Hierarchical Compression Technique for 3D Gaussian Splatting Compressioncited by 14
  20. 2021VoxelEmbed: 3D Instance Segmentation and Tracking with Voxel Embedding based Deep Learningcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.