mlsanityData to 14 Oct 2026

Query Rewriting for Complex Object Segmentation in 4D Gaussian Representations

arXiv 2609.02664 ↗First posted 2 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent 4D Gaussian representation frameworks have demonstrated strong performance in language-guided dynamic scene understanding. However, these methods remain highly sensitive to verbose and narrative-style queries that contain noisy contextual information. In this paper, we investigate the impact of query rewriting for complex object segmentation in 4D Gaussian representations. Inspired by recent findings in retrieval-augmented language models and keyword-guided query reformulation, we propose a training-free reinterpretation strategy that transforms long descriptive queries into concise keyword-grounded forms. Our approach progressively reduces linguistic noise while preserving semantic anchors relevant to object-centric representations. Experiments on HyperNeRF and Neu3D demonstrate that concise rewritten queries significantly improve both temporal localization and spatial segmentation performance. In particular, our method improves average temporal accuracy from 60.92% to 92.21% and average vIoU from 20.08% to 76.94% without any additional fine-tuning. Extensive ablation studies further reveal that shorter, keyword-focused queries consistently yield stable video-feature similarity distributions and better alignment with object-centric Gaussian representations

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 25 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

19 of 25 references.

References · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Segment Anythingcited by 8,234
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  7. 2025SAM 3: Segment Anything with Conceptscited by 906
  8. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  9. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  10. 2023Improving Text Embeddings with Large Language Modelscited by 303
  11. 2023Tracking Anything with Decoupled Video Segmentationcited by 197
  12. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
7 more
  1. 2025LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPScited by 41
  2. 20254D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Modelscited by 35
  3. 20244-LEGS: 4D Language Embedded Gaussian Splattingcited by 12
  4. 2025CF3: Compact and Fast 3D Feature Fieldscited by 11
  5. 2025LLM-based Query Expansion Fails for Unfamiliar and Ambiguous Queriescited by 10
  6. 2025Orientation-anchored Hyper-Gaussian for 4D Reconstruction from Casual Videoscited by 8
  7. 20254DLangVGGT: 4D Language-Visual Geometry Grounded Transformercited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understanding
  2. 2025CORE-3D: Context-aware Open-vocabulary Retrieval by Embeddings in 3D
  3. 2026Director: Instance-aware Gaussian Splatting for Dynamic Scene Modeling and Understanding
  4. 2026Open-Vocabulary and Referring Segmentation for 3D Gaussians Using 2D Detectors
  5. 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplane
  6. 2026Training-Free Open-Vocabulary 3D Point-Cloud Segmentation on the Generalized Few-Shot Benchmark
  7. 2025Lang3D-XL: Language Embedded 3D Gaussians for Large-scale Scenes
  8. 20264DVLT: Dynamic Scene Understanding with Worldline-Centered Vision-Language Tracking