GeoThinker-F: Endogenous Predictive World Representations for Fast Spatial Intelligence
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Existing geometry-aware Multimodal Large Language Models (MLLMs) increasingly rely on external 3D encoders to provide structural priors, but executing these additional encoder paths at inference introduces substantial latency and computational overhead. We propose GeoThinker-F, an efficient framework that internalizes spatiotemporal perception by transforming causal MLLM hidden states into predictive latent world representations. Our key insight is that intermediate semantic representations contain sufficient information to predict useful representations of current geometry and future semantics, without requiring an exact reproduction of features from a dedicated 3D encoder. To realize this idea, GeoThinker-F adopts a decoupled two-stage training strategy. In the first stage, the MLLM backbone is frozen while lightweight Latent Frame Prediction (LFP) heads learn from an offline 3D geometry expert and next-frame semantic targets. In the second stage, the external expert is removed, and the model is jointly optimized to generate and selectively integrate its self-predicted priors through a specialized Spatial-Grounded Temporal (SGT) Fusion module. Extensive evaluations show that GeoThinker-F eliminates runtime dependence on external 3D geometry encoders while maintaining competitive performance across diverse spatial intelligence benchmarks. It achieves up to a 3.6× inference speedup, reducing latency from 1.45,s to 0.40,s while retaining strong spatial reasoning performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 49 of its 57 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
49 of 57 references.
Closest ancestors · 14
Same direction, newest first
- 2026ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning27 Apr
- 2026Thinking with Geometry: Active Geometry Integration for Spatial Reasoning5 Feb
- 2025G2VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning26 Nov
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
- 2025Reasoning in Space via Grounding in the World15 Oct
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
- 20253D-MoRe: Unified Modal-Contextual Reasoning for Embodied Question Answering16 Jul
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
- 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding2 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
2 more
Other references · 35
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
23 more
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 112
- 2025Visual Spatial Tuningcited by 89
- 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
- 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 63
- 2023CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detectioncited by 52
- 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 38
- 2025SITE: towards Spatial Intelligence Thorough Evaluationcited by 29
- 2025Holistic Evaluation of Multimodal LLMs on Spatial Intelligencecited by 29
- 2025Benchmark Designers Should "Train on the Test Set" to Expose Exploitable Non-Visual Shortcutscited by 29
- 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detectioncited by 9
- 2026Cambrian-P: Pose-Grounded Video Understandingcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models
- 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding
- 2026GAP-MLLM: Geometry-Aligned Pre-training for Activating 3D Spatial Perception in Multimodal Large Language Models
- 2026SpatialSV: Internalizing Interpretable 3D Spatial Awareness in MLLMs via Task-Oriented Visual Supervision
- 2026GeoSense: Internalizing Geometric Necessity Perception for Multimodal Reasoning
- 2026GeoWeaver: Grounding Visual Tokens with Geometric Evidence before Scene Reasoning
- 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models
- 2026GeoSem-WAM: Geometry- and Semantic-Aware World Action Models