SPAZER: Spatial-Semantic Progressive Reasoning Agent for Zero-shot 3D Visual Grounding
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
3D Visual Grounding (3DVG) aims to localize target objects within a 3D scene based on natural language queries. To alleviate the reliance on costly 3D training data, recent studies have explored zero-shot 3DVG by leveraging the extensive knowledge and powerful reasoning capabilities of pre-trained LLMs and VLMs. However, existing paradigms tend to emphasize either spatial (3D-based) or semantic (2D-based) understanding, limiting their effectiveness in complex real-world applications. In this work, we introduce SPAZER - a VLM-driven agent that combines both modalities in a progressive reasoning framework. It first holistically analyzes the scene and produces a 3D rendering from the optimal viewpoint. Based on this, anchor-guided candidate screening is conducted to perform a coarse-level localization of potential objects. Furthermore, leveraging retrieved relevant 2D camera images, 3D-2D joint decision-making is efficiently performed to determine the best-matching object. By bridging spatial and semantic reasoning neural streams, SPAZER achieves robust zero-shot grounding without training on 3D-labeled data. Extensive experiments on ScanRefer and Nr3D benchmarks demonstrate that SPAZER significantly outperforms previous state-of-the-art zero-shot methods, achieving notable gains of 9.0% and 10.9% in accuracy.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 50 of its 58 references that are in the map. First posted on arXiv 27 Jun 2025.
Builds on
50 of 58 references.
Closest ancestors · 1
Same direction, newest first
Other references · 49
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
- 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 321
- 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
37 more
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 20233D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignmentcited by 204
- 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
- 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 147
- 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 146
- 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 141
- 2022Multi-View Transformer for 3D Visual Groundingcited by 140
- 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
- 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 135
- 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 133
- 2021Bottom Up Top Down Detection Transformers for Language Grounding in Images and Point Cloudscited by 128
- 2022Language Conditioned Spatial Relation Reasoning for 3D Object Groundingcited by 122
- 20223D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selectioncited by 110
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
- 2022EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Groundingcited by 99
- 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 67
- 2023Visual Programming for Zero-shot Open-Vocabulary 3D Visual Groundingcited by 64
- 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 63
- 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
- 2021D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Groundingcited by 52
- 2025Inst3D-LMM: Instance-Aware 3D Scene Understanding with Multi-modal Instruction Tuningcited by 51
- 2023Four Ways to Improve Verbo-visual Fusion for Dense 3D Visual Groundingcited by 32
- 2023Robust Outlier Rejection for 3D Registration with Variational Bayescited by 31
- 2024MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Groundingcited by 29
- 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 25
- 2021Sampling Network Guided Cross-Entropy Method for Unsupervised Point Cloud Registrationcited by 24
- 2025TSP3D: Text-guided Sparse Voxel Pruning for Efficient 3D Visual Groundingcited by 17
- 2023ScanERU: Interactive 3D Visual Grounding based on Embodied Reference Understandingcited by 12
- 2024Transcrib3D: 3D Referring Expression Resolution through Large Language Modelscited by 11
- 2024SPAgent: Adaptive Task Decomposition and Model Selection for General Video Generation and Editingcited by 11
- 2023Cross3DVG: Cross-Dataset 3D Visual Grounding on Different RGB-D Scanscited by 10
- 2025Language-to-Space Programming for Training-Free 3D Visual Groundingcited by 8
- 2025Multimodal Reasoning Agent for Zero-Shot Composed Image Retrievalcited by 8
- 2024Solving Zero-Shot 3D Visual Grounding as Constraint Satisfaction Problemscited by 7
- 2025ProxyTransformation: Preshaping Point Cloud Manifold With Proxy Attention For 3D Visual Groundingcited by 5
- 2025MLLM-Guided VLM Fine-Tuning with Joint Inference for Zero-Shot Composed Image Retrievalcited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025S2-MLLM: Boosting Spatial Reasoning Capability of MLLMs for 3D Visual Grounding with Structural Guidancecited by 5
- 2026Z3D: Zero-Shot 3D Visual Grounding from Imagescited by 2
- 2026UniGround: Universal 3D Visual Grounding via Training-Free Scene Parsingcited by 1
- 2026Think, Act, Build: An Agentic Framework with Vision Language Models for Zero-Shot 3D Visual Groundingcited by 1
- 2025OpenGround: Planning-based Online Perception for Open-World 3D Visual Groundingcited by 0
- 2026SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMscited by 0
- 2026DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Groundingcited by 0
- 2026Agentic Collaborative Cognition for Zero-Shot 3D Understandingcited by 0
- 2026PruneGround: Plug-and-play Spatial Pruning for 3D Visual Groundingcited by 0
- 2026TDVR: Joint Text Disambiguation and Viewpoint Reasoning for Zero-Shot 3D Visual Groundingcited by 0
- 2026Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Groundingcited by 0
- 2026Metric-Bench: Exploring In-context Spatial Metric Reasoning in VLMs for Indoor Scenescited by 0
- 2026Metric-Bench: Exploring In-context Spatial Metric Reasoning in VLMs for Indoor Scenes22 Sep 2026
- 2026Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding4 Sep 2026
- 2026TDVR: Joint Text Disambiguation and Viewpoint Reasoning for Zero-Shot 3D Visual Grounding4 Aug 2026
- 2026PruneGround: Plug-and-play Spatial Pruning for 3D Visual Grounding30 Jun 2026
- 2026Agentic Collaborative Cognition for Zero-Shot 3D Understanding23 Jun 2026
- 2026DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding28 May 2026
- 2026SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMs27 May 2026
- 2026Think, Act, Build: An Agentic Framework with Vision Language Models for Zero-Shot 3D Visual Grounding1 Apr 2026
- 2026UniGround: Universal 3D Visual Grounding via Training-Free Scene Parsing9 Mar 2026
- 2026Z3D: Zero-Shot 3D Visual Grounding from Images3 Feb 2026
- 2025OpenGround: Planning-based Online Perception for Open-World 3D Visual Grounding28 Dec 2025
- 2025S2-MLLM: Boosting Spatial Reasoning Capability of MLLMs for 3D Visual Grounding with Structural Guidance1 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025SeqVLM: Proposal-Guided Multi-View Sequences Reasoning via VLM for Zero-Shot 3D Visual Grounding
- 2025View-on-Graph: Zero-shot 3D Visual Grounding via Vision-Language Reasoning on Scene Graphs
- 2026AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models
- 2025Zero-Shot 3D Visual Grounding from Vision-Language Models
- 2026GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Grounding
- 2026SceneGraphGrounder: Zero-Shot 3D Visual Grounding via Structured Scene Graph Matching
- 2026Multiple Consistent 2D-3D Mappings for Robust Zero-Shot 3D Visual Grounding
- 2026MAG-3D: Multi-Agent Grounded Reasoning for 3D Understanding