mlsanityData to 14 Oct 2026

EagleVision: A Dual-Stage Framework with BEV-grounding-based Chain-of-Thought for Spatial Intelligence

arXiv 2512.15160 ↗First posted 17 Dec 2025cs.CVcited by 3

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Video-based spatial reasoning -- such as estimating distances, judging directions, or understanding layouts from multiple views -- requires selecting informative frames and, when needed, actively seeking additional viewpoints during inference. Existing multimodal large language models (MLLMs) consume a fixed set of uniformly sampled frames and cannot request new views once reasoning begins, often missing the geometric cues necessary for reliable spatial judgments. We present EagleVision, a dual-stage framework that combines geometry-aware frame selection with active, Bird's-Eye-View (BEV)-grounded reasoning. In the first stage (macro perception), a semantics-perspective-fusion determinantal point process (SPF-DPP) selects a compact set of keyframes that jointly maximize semantic relevance and viewpoint diversity under a fixed token budget. In the second stage (micro verification), the model performs iterative spatial Chain-of-Thought: at each step it can either reason in text or predict a pose on the BEV plane to retrieve the nearest real frame, forming a closed-loop hypothesize-look-verify cycle. The querying policy is trained purely via reinforcement learning with a spatial grounding reward, requiring no human-annotated reasoning traces. On VSI-Bench and SQA3D, EagleVision achieves state-of-the-art performance among open-source vision-language models.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 61 references that are in the map. First posted on arXiv 17 Dec 2025.

Builds on

40 of 61 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  2. 2025Struct2D: A Perception-Guided Framework for Spatial Reasoning in MLLMs4 Jun
  3. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  4. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  5. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  6. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  7. 2022SQA3D: Situated Question Answering in 3D Scenes14 Oct

Other references · 33

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  7. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  8. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  9. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  10. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  11. 2024Long Context Transfer from Language to Visioncited by 515
  12. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
21 more
  1. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
  2. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
  3. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  4. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
  5. 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 137
  6. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
  7. 2025FG-CLIP: Fine-Grained Visual and Textual Alignmentcited by 81
  8. 20253D-LLaVA: Towards Generalist 3D LMMs with Omni Superpoint Transformercited by 68
  9. 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 63
  10. 2024Interleaved-Modal Chain-of-Thoughtcited by 51
  11. 2024Situational Awareness Matters in 3D Vision Language Reasoningcited by 33
  12. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
  13. 2024MapDistill: Boosting Efficient Camera-based HD Map Construction via Camera-LiDAR Fusion Model Distillationcited by 26
  14. 2024PriorDrive: Enhancing Online HD Mapping with Unified Vector Priorscited by 10
  15. 2025Layered Chain-of-Thought Prompting for Multi-Agent LLM Systems: A Comprehensive Approach to Explainable Large Language Modelscited by 10
  16. 2025SeqGrowGraph: Learning Lane Topology as a Chain of Graph Expansionscited by 10
  17. 2025Stability Under Scrutiny: Benchmarking Representation Paradigms for Online HD Mappingcited by 7
  18. 2025Persistent Autoregressive Mapping with Traffic Rules for Autonomous Drivingcited by 6
  19. 2025UniMapGen: A Generative Framework for Large-Scale Map Construction from Multi-modal Datacited by 4
  20. 2024SP2T: Sparse Proxy Attention for Dual-stream Point Transformercited by 3
  21. 2025Online Navigation Refinement: Achieving Lane-Level Guidance by Associating Standard-Definition and Online Perception Mapscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
  2. 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
  3. 2026Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence
  4. 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
  5. 2025Reasoning Path and Latent State Analysis for Multi-view Visual Spatial Reasoning: A Cognitive Science Perspective
  6. 2026Multi-View Relational Distillation for Spatial Reasoning with Vision-Language Models
  7. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
  8. 2026Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images