mlsanityData to 7 Oct 2026

UniGround: Universal 3D Visual Grounding via Training-Free Scene Parsing

arXiv 2603.08131 ↗First posted 9 Mar 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D Visual Grounding (3DVG) localizes objects from natural-language descriptions in 3D scenes and is fundamental to embodied AI applications. Although foundation models enable open-vocabulary reasoning, they typically rely on pre-generated candidates, creating two sequential bottlenecks. The candidate bottleneck occurs when dataset-specific 3D proposal models miss, fragment, or incorrectly group targets under distribution shifts, excluding them from VLM reasoning. The evidence bottleneck stems from incomplete visual evidence: global renderings preserve spatial context but obscure object details, whereas candidate-centric views capture local appearance but lack global context. To address these bottlenecks, we propose UniGround, a zero-shot 3DVG framework that addresses both bottlenecks through Global Candidate Filtering and Contextual Precision Grounding. Global Candidate Filtering constructs topology-consistent, class-agnostic candidates from 3D topology and multi-view semantic cues, without dataset-trained 3D detectors, task-specific proposal supervision, or predefined box and category priors. Contextual Precision Grounding jointly reasons over global spatial context and candidate-centric visual evidence, followed by closed-loop consistency verification for reliable target identification. UniGround achieves 46.1%/34.1% [email protected]/0.5 on ScanRefer and 28.7% [email protected] on the evaluated ARKitScenes subset of EmbodiedScan. Further experiments demonstrate competitive grounding without dataset-specific 3D priors, cross-dataset generalization to unseen indoor scenes, and robustness to real-world reconstruction noise and practical domain shifts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 49 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

41 of 49 references.

References · 41

  1. 2023Segment Anythingcited by 8,158
  2. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  3. 2023LERF: Language Embedded Radiance Fieldscited by 538
  4. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
  5. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
  6. 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
  7. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 274
  8. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
  9. 20233D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignmentcited by 201
  10. 2021FAST-LIO2: Fast Direct LiDAR-inertial Odometrycited by 170
  11. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
  12. 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 142
29 more
  1. 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 140
  2. 2021Bottom Up Top Down Detection Transformers for Language Grounding in Images and Point Cloudscited by 128
  3. 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
  4. 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
  5. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
  6. 2022EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Groundingcited by 98
  7. 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
  8. 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 66
  9. 2023Visual Programming for Zero-shot Open-Vocabulary 3D Visual Groundingcited by 64
  10. 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
  11. 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understandingcited by 47
  12. 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulationcited by 36
  13. 2023GrowSP: Unsupervised Semantic Segmentation of 3D Point Cloudscited by 34
  14. 2023Four Ways to Improve Verbo-visual Fusion for Dense 3D Visual Groundingcited by 32
  15. 2023Optimal Scene Graph Planning with Large Language Model Guidancecited by 26
  16. 2023Object2Scene: Putting Objects in Context for Open-Vocabulary 3D Detectioncited by 24
  17. 2024Multi-branch Collaborative Learning Network for 3D Visual Groundingcited by 20
  18. 2025TSP3D: Text-guided Sparse Voxel Pruning for Efficient 3D Visual Groundingcited by 17
  19. 2022COARSE3D: Class-Prototypes for Contrastive Learning in Weakly-Supervised 3D Point Cloud Segmentationcited by 15
  20. 2025DreamNav: A Trajectory-Based Imaginative Framework for Zero-Shot Vision-and-Language Navigationcited by 15
  21. 2023RayDF: Neural Ray-surface Distance Fields with Multi-view Consistencycited by 12
  22. 2025SPAZER: Spatial-Semantic Progressive Reasoning Agent for Zero-shot 3D Visual Groundingcited by 12
  23. 2021Deep View Synthesis via Self-Consistent Generative Networkcited by 10
  24. 2025LogoSP: Local-global Grouping of Superpoints for Unsupervised Semantic Segmentation of 3D Point Cloudscited by 8
  25. 2025ViewSRD: 3D Visual Grounding via Structured Multi-View Decompositioncited by 8
  26. 2025SeqVLM: Proposal-Guided Multi-View Sequences Reasoning via VLM for Zero-Shot 3D Visual Groundingcited by 7
  27. 2025GroundFlow: A Plug-in Module for Temporal Reasoning on 3D Point Cloud Sequential Groundingcited by 4
  28. 2025View-on-Graph: Zero-shot 3D Visual Grounding via Vision-Language Reasoning on Scene Graphscited by 3
  29. 2025HERO: Hierarchical Traversable 3D Scene Graphs for Embodied Navigation Among Movable Obstaclescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Objects to Anywhere: A Holistic Benchmark for Multi-level Visual Grounding in 3D Scenes
  2. 2025OpenGround: Planning-based Online Perception for Open-World 3D Visual Grounding
  3. 2026Grounded 3D-Aware Spatial Vision-Language Modeling
  4. 2026Think, Act, Build: An Agentic Framework with Vision Language Models for Zero-Shot 3D Visual Grounding
  5. 2025Zero-Shot 3D Visual Grounding from Vision-Language Models
  6. 2026AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models
  7. 2026Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding
  8. 2026PruneGround: Plug-and-play Spatial Pruning for 3D Visual Grounding