mlsanityData to 14 Oct 2026

AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neuroscience

arXiv 2606.31467 ↗First posted 30 Jun 2026cs.CVcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

With the rapid advancement of aerospace embodied intelligence, enabling Unmanned Aerial Vehicles (UAVs) to autonomously understand and reason about complex environments has become increasingly important. However, existing UAV-based spatial reasoning approaches face critical limitations: single-view perception renders them vulnerable to occlusions and perspective distortions, while most VLMs lack explicit geometric modeling, relying on semantic cues and yielding inconsistent reasoning under viewpoint and scale variations. To address these challenges, we propose SatAgent, a UAV-Satellite collaborative spatial reasoning model inspired by the dual-pathway mechanism of the human visual system. By jointly leveraging satellite and UAV perspectives, SatAgent enables robust, accurate reasoning in complex urban environments. We first introduce a Geometric-Aware 3D Reconstruction Encoder that elevates 2D UAV features into explicit 3D spatial representations. Next, we design a multi-view topology-semantic alignment module integrating cross-view features within a unified BEV coordinate system. We further introduce a multi-view consistency loss encouraging viewpoint-invariant representations. Finally, we construct SatAgent-SR130K, the first large-scale UAV-Satellite collaborative multi-view spatial reasoning dataset. Experiments show SatAgent outperforms state-of-the-art general-purpose foundation models and specialized spatial reasoning models by 25.91% and 11.69%, respectively, across diverse tasks, achieving particularly high accuracy in complex geometric relationship reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 69 of its 101 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

69 of 101 references.

Closest ancestors · 15

Same direction, newest first

  1. 2026CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environments20 Jan
  2. 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning14 Nov
  3. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  4. 2025Spatial-ViLT: Enhancing Visual Spatial Reasoning through Multi-Task Learning3 Oct
  5. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  6. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  7. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  8. 2025Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas3 Mar
  9. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  10. 2024Sparkle: Mastering Basic Spatial Capabilities in Vision Language Models Elicits Generalization to Spatial Reasoning21 Oct
  11. 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
  12. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models21 Jun
3 more
  1. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  2. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  3. 2022Visual Spatial Reasoning30 Apr

Other references · 54

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2017Graph Attention Networkscited by 8,923
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  7. 2017Squeeze-and-Excitation Networkscited by 4,789
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  9. 2025Qwen3-VL Technical Reportcited by 2,793
  10. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  11. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  12. 2015Spatial Transformer Networkscited by 1,429
38 more
  1. 2024Depth Anything V2cited by 1,422
  2. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  3. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  4. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  5. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  6. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  7. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  8. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  9. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  10. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
  11. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  12. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  13. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  14. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  15. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  16. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  17. 2017Gated Multimodal Units for Information Fusioncited by 248
  18. 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 216
  19. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
  20. 2016Learning to Navigate in Complex Environmentscited by 198
  21. 2025MiniMax-01: Scaling Foundation Models with Lightning Attentioncited by 166
  22. 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 159
  23. 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 157
  24. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
  25. 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
  26. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Modelcited by 113
  27. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 73
  28. 2024RegionGPT: Towards Region Understanding Vision Language Modelcited by 71
  29. 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 52
  30. 2022Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matchingcited by 44
  31. 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 42
  32. 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagerycited by 31
  33. 2024SPHERE: Unveiling Spatial Blind Spots in Vision-Language Models Through Hierarchical Evaluationcited by 31
  34. 2026Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligencecited by 30
  35. 2021Knowledge-based Embodied Question Answeringcited by 29
  36. 2024UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarioscited by 28
  37. 2022Learning Perception-Aware Agile Flight in Cluttered Environmentscited by 23
  38. 2024NavAgent: Multi-scale Urban Street View Fusion For UAV Embodied Vision-and-Language Navigationcited by 18

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration
  2. 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models
  3. 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning
  4. 2026SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagery
  5. 2026SpatialFly: Implicit 3D Prior-Guided Visual Reparameterization for Continuous UAV Vision-and-Language Navigation
  6. 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence
  7. 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs
  8. 2026Grid Spatial Understanding: A Dataset for Textual Spatial Reasoning over Grids, Embodied Settings, and Coordinate Structures