Is your VLM Sky-Ready? A Comprehensive Spatial Intelligence Benchmark for UAV Navigation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Vision-Language Models (VLMs), leveraging their powerful visual perception and reasoning capabilities, have been widely applied in Unmanned Aerial Vehicle (UAV) tasks. However, the spatial intelligence capabilities of existing VLMs in UAV scenarios remain largely unexplored, raising concerns about their effectiveness in navigating and interpreting dynamic environments. To bridge this gap, we introduce SpatialSky-Bench, a comprehensive benchmark specifically designed to evaluate the spatial intelligence capabilities of VLMs in UAV navigation. Our benchmark comprises two categories-Environmental Perception and Scene Understanding-divided into 13 subcategories, including bounding boxes, color, distance, height, and landing safety analysis, among others. Extensive evaluations of various mainstream open-source and closed-source VLMs reveal unsatisfactory performance in complex UAV navigation scenarios, highlighting significant gaps in their spatial capabilities. To address this challenge, we developed the SpatialSky-Dataset, a comprehensive dataset containing 1M samples with diverse annotations across various scenarios. Leveraging this dataset, we introduce Sky-VLM, a specialized VLM designed for UAV spatial reasoning across multiple granularities and contexts. Extensive experimental results demonstrate that Sky-VLM achieves state-of-the-art performance across all benchmark tasks, paving the way for the development of VLMs suitable for UAV scenarios. The source code is available at https://github.com/linglingxiansen/SpatialSKy.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 64 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
46 of 64 references.
Closest ancestors · 8
Same direction, newest first
- 2025SoraNav: Adaptive UAV Task-Centric Navigation via Zeroshot VLM Reasoning29 Oct
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025AffordGrasp: In-Context Affordance Reasoning for Open-Vocabulary Task-Oriented Grasping in Clutter2 Mar
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
Other references · 38
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2015VQA: Visual Question Answeringcited by 2,506
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 233
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 135
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
26 more
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
- 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Modelscited by 99
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open Worldcited by 90
- 2025RoboBrain 2.0 Technical Reportcited by 89
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
- 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 55
- 2025UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generationcited by 28
- 2025UAVScenes: A Multi-Modal Dataset for UAVscited by 27
- 2024TriHelper: Zero-Shot Object Navigation with Dynamic Assistancecited by 25
- 2025Embodied Scene Understanding for Vision Language Models via MetaVQAcited by 19
- 2025See, Point, Fly: A Learning-Free VLM Framework for Universal Unmanned Aerial Navigationcited by 18
- 2025Exploring Typographic Visual Prompts Injection Threats in Cross-Modality Generation Modelscited by 14
- 2025Video-CoT: A Comprehensive Dataset for Spatiotemporal Understanding of Videos Based on Chain-of-Thoughtcited by 14
- 2025SkyVLN: Vision-and-Language Navigation and NMPC Control for UAVs in Urban Environmentscited by 14
- 2025NavA3: Understanding Any Instruction, Navigating Anywhere, Finding Anythingcited by 14
- 2025HumanoidPano: Hybrid Spherical Panoramic-LiDAR Cross-Modal Perception for Humanoid Robotscited by 13
- 2024Multi-Floor Zero-Shot Object Navigation Policycited by 12
- 2025RynnEC: Bringing MLLMs into Embodied Worldcited by 11
- 2025UAV-VLRR: Vision-Language Informed NMPC for Rapid Response in UAV Search and Rescuecited by 7
- 2025TopoNav: Topological Graphs as a Key Enabler for Advanced Object Navigationcited by 6
- 2025VQualA 2025 Challenge on Engagement Prediction for Short Videos: Methods and Resultscited by 6
- 2025VLM-RRT: Vision Language Model Guided RRT Search for Autonomous UAV Navigationcited by 5
- 2025Team Xiaomi EV-AD VLA: Caption-Guided Retrieval System for Cross-Modal Drone Navigation -- Technical Report for IROS 2025 RoboSense Challenge Track 4cited by 3
- 2025LiPS: Large-Scale Humanoid Robot Reinforcement Learning with Parallel-Series Structurescited by 2
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Controlcited by 11
- 2026Are VLMs Lost Between Sky and Space? LinkS2Bench for UAV-Satellite Dynamic Cross-View Spatial Intelligencecited by 3
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networkscited by 2
- 2026SEF-MAP: Subspace-Decomposed Expert Fusion for Robust Multimodal HD Map Predictioncited by 2
- 2026SpatialUAV: Benchmarking Spatial Intelligence for Low-Altitude UAV Perception, Collaboration, and Motioncited by 2
- 2026Weather-Conditioned Branch Routing for Robust LiDAR-Radar 3D Object Detectioncited by 1
- 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoningcited by 1
- 2026Beyond Appearance: Can Multimodal Large Language Models Exploit Vertical Structure for Remote Sensing Natural Scene Understanding?cited by 0
- 2026Zero-Shot Mission-Level Evaluation for Aerial MLLM Agentscited by 0
- 2026RecoverFly: A Failure-Aware Reinforcement Learning Post-Training Framework for Aerial Vision-Language Navigationcited by 0
- 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning12 Aug 2026
- 2026RecoverFly: A Failure-Aware Reinforcement Learning Post-Training Framework for Aerial Vision-Language Navigation10 Aug 2026
- 2026Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents24 Jul 2026
- 2026SpatialUAV: Benchmarking Spatial Intelligence for Low-Altitude UAV Perception, Collaboration, and Motion26 Jun 2026
- 2026Beyond Appearance: Can Multimodal Large Language Models Exploit Vertical Structure for Remote Sensing Natural Scene Understanding?25 May 2026
- 2026Weather-Conditioned Branch Routing for Robust LiDAR-Radar 3D Object Detection7 Apr 2026
- 2026Are VLMs Lost Between Sky and Space? LinkS2Bench for UAV-Satellite Dynamic Cross-View Spatial Intelligence2 Apr 2026
- 2026AerialVLA: A Vision-Language-Action Model for UAV Navigation via Minimalist End-to-End Control15 Mar 2026
- 2026SEF-MAP: Subspace-Decomposed Expert Fusion for Robust Multimodal HD Map Prediction25 Feb 2026
- 2026α3-SecBench: A Large-Scale Evaluation Suite of Security, Resilience, and Trust for LLM-based UAV Agents over 6G Networks26 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025MM-UAVBench: How Well Do Multimodal Large Language Models See, Think, and Plan in Low-Altitude UAV Scenarios?
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
- 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
- 2026UAVBench and UAVIT-1M: Benchmarking and Enhancing MLLMs for Low-Altitude UAV Vision-Language Understanding
- 2026No Training, Better Flights: Test-Time Scaled VLMs for UAV Navigation
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective
- 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation