mlsanityData to 7 Oct 2026

Z3D: Zero-Shot 3D Visual Grounding from Images

arXiv 2602.03361 ↗First posted 3 Feb 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

3D visual grounding (3DVG) aims to localize objects in a 3D scene based on natural language queries. In this work, we explore zero-shot 3DVG from multi-view images alone, without requiring any geometric supervision or object priors. We introduce Z3D, a universal grounding pipeline that flexibly operates on multi-view images while optionally incorporating camera poses and depth maps. We identify key bottlenecks in prior zero-shot methods causing significant performance degradation and address them with (i) a state-of-the-art zero-shot 3D instance segmentation method to generate high-quality 3D bounding box proposals and (ii) advanced reasoning via prompt-based segmentation, which utilizes full capabilities of modern VLMs. Extensive experiments on the ScanRefer and Nr3D benchmarks demonstrate that our approach achieves state-of-the-art performance among zero-shot methods. Code is available at https://github.com/col14m/z3d .

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 29 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

17 of 29 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  3. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  4. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  5. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
  6. 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
  7. 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 130
  8. 2022Language Conditioned Spatial Relation Reasoning for 3D Object Groundingcited by 121
  9. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
  10. 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 66
  11. 2023Visual Programming for Zero-shot Open-Vocabulary 3D Visual Groundingcited by 64
  12. 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 61
5 more
  1. 2024MaskClustering: View Consensus based Mask Graph Clustering for Open-Vocabulary 3D Instance Segmentationcited by 56
  2. 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
  3. 2024MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Groundingcited by 29
  4. 2025SPAZER: Spatial-Semantic Progressive Reasoning Agent for Zero-shot 3D Visual Groundingcited by 12
  5. 2025Language-to-Space Programming for Training-Free 3D Visual Groundingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Zero-Shot 3D Visual Grounding from Vision-Language Models
  2. 2024Solving Zero-Shot 3D Visual Grounding as Constraint Satisfaction Problems
  3. 2025SeqVLM: Proposal-Guided Multi-View Sequences Reasoning via VLM for Zero-Shot 3D Visual Grounding
  4. 2026Multiple Consistent 2D-3D Mappings for Robust Zero-Shot 3D Visual Grounding
  5. 2026Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding
  6. 2026AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models
  7. 2026UniGround: Universal 3D Visual Grounding via Training-Free Scene Parsing
  8. 2025OpenGround: Planning-based Online Perception for Open-World 3D Visual Grounding