mlsanityData to 14 Oct 2026

SPAZER: Spatial-Semantic Progressive Reasoning Agent for Zero-shot 3D Visual Grounding

arXiv 2506.21924 ↗First posted 27 Jun 2025cs.CVcited by 12

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

3D Visual Grounding (3DVG) aims to localize target objects within a 3D scene based on natural language queries. To alleviate the reliance on costly 3D training data, recent studies have explored zero-shot 3DVG by leveraging the extensive knowledge and powerful reasoning capabilities of pre-trained LLMs and VLMs. However, existing paradigms tend to emphasize either spatial (3D-based) or semantic (2D-based) understanding, limiting their effectiveness in complex real-world applications. In this work, we introduce SPAZER - a VLM-driven agent that combines both modalities in a progressive reasoning framework. It first holistically analyzes the scene and produces a 3D rendering from the optimal viewpoint. Based on this, anchor-guided candidate screening is conducted to perform a coarse-level localization of potential objects. Furthermore, leveraging retrieved relevant 2D camera images, 3D-2D joint decision-making is efficiently performed to determine the best-matching object. By bridging spatial and semantic reasoning neural streams, SPAZER achieves robust zero-shot grounding without training on 3D-labeled data. Extensive experiments on ScanRefer and Nr3D benchmarks demonstrate that SPAZER significantly outperforms previous state-of-the-art zero-shot methods, achieving notable gains of 9.0% and 10.9% in accuracy.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 50 of its 58 references that are in the map. First posted on arXiv 27 Jun 2025.

Builds on

50 of 58 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec

Other references · 49

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  5. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
  6. 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
  7. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
  8. 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
  9. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
  10. 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 321
  11. 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
  12. 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 303
37 more
  1. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  2. 20233D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignmentcited by 204
  3. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
  4. 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
  5. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 147
  6. 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 146
  7. 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 141
  8. 2022Multi-View Transformer for 3D Visual Groundingcited by 140
  9. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
  10. 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 135
  11. 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 133
  12. 2021Bottom Up Top Down Detection Transformers for Language Grounding in Images and Point Cloudscited by 128
  13. 2022Language Conditioned Spatial Relation Reasoning for 3D Object Groundingcited by 122
  14. 20223D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selectioncited by 110
  15. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
  16. 2022EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Groundingcited by 99
  17. 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 67
  18. 2023Visual Programming for Zero-shot Open-Vocabulary 3D Visual Groundingcited by 64
  19. 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 63
  20. 2024VLM-Grounder: A VLM Agent for Zero-Shot 3D Visual Groundingcited by 56
  21. 2021D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Groundingcited by 52
  22. 2025Inst3D-LMM: Instance-Aware 3D Scene Understanding with Multi-modal Instruction Tuningcited by 51
  23. 2023Four Ways to Improve Verbo-visual Fusion for Dense 3D Visual Groundingcited by 32
  24. 2023Robust Outlier Rejection for 3D Registration with Variational Bayescited by 31
  25. 2024MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Groundingcited by 29
  26. 2024A Survey on Text-guided 3D Visual Grounding: Elements, Recent Advances, and Future Directionscited by 25
  27. 2021Sampling Network Guided Cross-Entropy Method for Unsupervised Point Cloud Registrationcited by 24
  28. 2025TSP3D: Text-guided Sparse Voxel Pruning for Efficient 3D Visual Groundingcited by 17
  29. 2023ScanERU: Interactive 3D Visual Grounding based on Embodied Reference Understandingcited by 12
  30. 2024Transcrib3D: 3D Referring Expression Resolution through Large Language Modelscited by 11
  31. 2024SPAgent: Adaptive Task Decomposition and Model Selection for General Video Generation and Editingcited by 11
  32. 2023Cross3DVG: Cross-Dataset 3D Visual Grounding on Different RGB-D Scanscited by 10
  33. 2025Language-to-Space Programming for Training-Free 3D Visual Groundingcited by 8
  34. 2025Multimodal Reasoning Agent for Zero-Shot Composed Image Retrievalcited by 8
  35. 2024Solving Zero-Shot 3D Visual Grounding as Constraint Satisfaction Problemscited by 7
  36. 2025ProxyTransformation: Preshaping Point Cloud Manifold With Proxy Attention For 3D Visual Groundingcited by 5
  37. 2025MLLM-Guided VLM Fine-Tuning with Joint Inference for Zero-Shot Composed Image Retrievalcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 10.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SeqVLM: Proposal-Guided Multi-View Sequences Reasoning via VLM for Zero-Shot 3D Visual Grounding
  2. 2025View-on-Graph: Zero-shot 3D Visual Grounding via Vision-Language Reasoning on Scene Graphs
  3. 2026AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models
  4. 2025Zero-Shot 3D Visual Grounding from Vision-Language Models
  5. 2026GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Grounding
  6. 2026SceneGraphGrounder: Zero-Shot 3D Visual Grounding via Structured Scene Graph Matching
  7. 2026Multiple Consistent 2D-3D Mappings for Robust Zero-Shot 3D Visual Grounding
  8. 2026MAG-3D: Multi-Agent Grounded Reasoning for 3D Understanding