Z3D: Zero-Shot 3D Visual Grounding from Images
Not on the map. Why?
Abstract (arXiv)
3D visual grounding (3DVG) aims to localize objects in a 3D scene based on natural language queries. In this work, we explore zero-shot 3DVG from multi-view images alone, without requiring any geometric supervision or object priors. We introduce Z3D, a universal grounding pipeline that flexibly operates on multi-view images while optionally incorporating camera poses and depth maps. We identify key bottlenecks in prior zero-shot methods causing significant performance degradation and address them with (i) a state-of-the-art zero-shot 3D instance segmentation method to generate high-quality 3D bounding box proposals and (ii) advanced reasoning via prompt-based segmentation, which utilizes full capabilities of modern VLMs. Extensive experiments on the ScanRefer and Nr3D benchmarks demonstrate that our approach achieves state-of-the-art performance among zero-shot methods. Code is available at https://github.com/col14m/z3d .
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 29 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
17 of 29 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
- 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
- 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 130
- 2022Language Conditioned Spatial Relation Reasoning for 3D Object Groundingcited by 121
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 66
- 2023Visual Programming for Zero-shot Open-Vocabulary 3D Visual Groundingcited by 64
- 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 61
5 more
- 2024MaskClustering: View Consensus based Mask Graph Clustering for Open-Vocabulary 3D Instance Segmentationcited by 56
- 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
- 2024MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Groundingcited by 29
- 2025SPAZER: Spatial-Semantic Progressive Reasoning Agent for Zero-shot 3D Visual Groundingcited by 12
- 2025Language-to-Space Programming for Training-Free 3D Visual Groundingcited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Zero-Shot 3D Visual Grounding from Vision-Language Models
- 2024Solving Zero-Shot 3D Visual Grounding as Constraint Satisfaction Problems
- 2025SeqVLM: Proposal-Guided Multi-View Sequences Reasoning via VLM for Zero-Shot 3D Visual Grounding
- 2026Multiple Consistent 2D-3D Mappings for Robust Zero-Shot 3D Visual Grounding
- 2026Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding
- 2026AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models
- 2026UniGround: Universal 3D Visual Grounding via Training-Free Scene Parsing
- 2025OpenGround: Planning-based Online Perception for Open-World 3D Visual Grounding