mlsanityData to 14 Oct 2026

G2VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning

arXiv 2511.21688 ↗First posted 26 Nov 2025cs.CV cs.AI cs.CLcited by 44

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Vision-Language Models (VLMs) still lack robustness in spatial intelligence, demonstrating poor performance on spatial understanding and reasoning tasks. We attribute this gap to the absence of a visual geometry learning process capable of reconstructing 3D space from 2D images. We present G2VLM, a geometry grounded vision-language model that bridges two fundamental aspects of spatial intelligence: spatial 3D reconstruction and spatial understanding. G2VLM natively leverages learned 3D visual geometry features to directly predict 3D attributes and enhance spatial reasoning tasks via in-context learning and interleaved reasoning. Our unified design is highly scalable for spatial understanding: it trains on abundant multi-view image and video data, while simultaneously leveraging the benefits of 3D visual priors that are typically only derived from hard-to-collect annotations. Experimental results demonstrate G2VLM is proficient in both tasks, achieving comparable results to state-of-the-art feed-forward 3D reconstruction models and achieving better or competitive results across spatial understanding and reasoning tasks. By unifying a semantically strong VLM with low-level 3D vision tasks, we hope G2VLM can serve as a strong baseline for the community and unlock more future applications, such as 3D scene editing.

Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 88 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

36 of 88 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective23 Sep
  2. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  3. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  4. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec

Other references · 32

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  6. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  7. 2023Vision Transformers Need Registerscited by 871
  8. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  9. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  10. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  11. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  12. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
20 more
  1. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
  2. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  3. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
  4. 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 302
  5. 20243D Reconstruction with Spatial Memorycited by 277
  6. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  7. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  8. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
  9. 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
  10. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  11. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 163
  12. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
  13. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
  14. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
  15. 2024X-VILA: Cross-Modality Alignment for Large Language Modelcited by 46
  16. 2024OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flowscited by 46
  17. 20253DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Modelcited by 25
  18. 2025OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understandingcited by 24
  19. 2024Visually Descriptive Language Model for Vector Graphics Reasoningcited by 14
  20. 2025Towards Enhanced Image Generation Via Multi-modal Chain of Thought in Unified Generative Modelscited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 44.

44 papers.

Sort:

By area:

  1. 2026Thinking with Geometry: Active Geometry Integration for Spatial Reasoningcited by 18
  2. 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoningcited by 17
  3. 2026Vision as Unified Multimodal Generationcited by 7
  4. 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
  5. 2026Cambrian-P: Pose-Grounded Video Understandingcited by 5
  6. 2026Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulatorscited by 5
  7. 2026See, Remember, Explore: A Benchmark and Baselines for Streaming Spatial Reasoningcited by 4
  8. 2026Text-Guided 6D Object Pose Rearrangement via Closed-Loop VLM Agentscited by 4
  9. 2026Unlocking Dense Metric Depth Estimation in VLMscited by 4
  10. 2026Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Modelscited by 4
  11. 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Modelscited by 3
  12. 20263D HAMSTER: Bridging Planning and Control in Hierarchical Vision Language Action Models through 3D Trajectory Guidancecited by 3
32 more
  1. 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Taskscited by 2
  2. 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMscited by 2
  3. 20263D-RFT: Reinforcement Fine-Tuning for Video-based 3D Scene Understandingcited by 1
  4. 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoningcited by 1
  5. 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Modelscited by 1
  6. 2026Stream3D-VLM: Online 3D Spatial Understanding with Incremental Geometry Priorscited by 1
  7. 2026Natural Language Camera Movement Understandingcited by 1
  8. 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understandingcited by 1
  9. 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1
  10. 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstructioncited by 1
  11. 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Modelscited by 1
  12. 2026Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answeringcited by 1
  13. 2026Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurementcited by 0
  14. 2026OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RLcited by 0
  15. 2026Not All Tasks Quantize Equally: Fisher-Guided Quantization for Visual Geometry Transformercited by 0
  16. 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoningcited by 0
  17. 2026RefineAny3D: Depth Refinement as Semantic Alignment for Monocular 3D Detectioncited by 0
  18. 2026Multi-View Relational Distillation for Spatial Reasoning with Vision-Language Modelscited by 0
  19. 2026SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generationcited by 0
  20. 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoningcited by 0
  21. 2026DepthEvidence: Unifying Metric Depth Prediction and Geometric Reasoning in Multimodal Language Modelscited by 0
  22. 2026SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoningcited by 0
  23. 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometrycited by 0
  24. 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Modelscited by 0
  25. 2026Soft Spatial Reasoningcited by 0
  26. 2026Agentic Relative Camera Pose Estimation via Learned Ranking and Verificationcited by 0
  27. 2026GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoningcited by 0
  28. 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Drivingcited by 0
  29. 2026What Makes a Good Visual Representation for Spatial Understanding in MLLMs?cited by 0
  30. 2026GeoReader: Learning Latent Geometry for Spatial Reasoning in Vision-Language Modelscited by 0
  31. 2026GeoThinker-F: Endogenous Predictive World Representations for Fast Spatial Intelligencecited by 0
  32. 2026Can Learning to Answer Spatial Questions Improve Novel-View Generation?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024I Know About "Up"! Enhancing Spatial Reasoning in Visual Language Models Through 3D Reconstruction
  2. 2025SD-VLM: Spatial Measuring and Understanding with Depth-Encoded Vision-Language Models
  3. 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Models
  4. 2026Boosting MLLM Spatial Reasoning with Geometrically Referenced 3D Scene Representations
  5. 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
  6. 20263D-Aware VLMs with Implicit and Explicit Geometries
  7. 2025GRAID: Enhancing Spatial Reasoning of VLMs Through High-Fidelity Data Generation
  8. 2026Make Geometry Matter for Spatial Reasoning