Can Vision-Language Models Think from the Sky? Unifying UAV Reasoning and Generation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Vision-Language Models have achieved strong progress in ground-view visual understanding, yet they remain brittle in high-altitude Unmanned Aerial Vehicle scenes, where objects are tiny and densely packed, textures are repetitive, and top-down orientations are ambiguous. We introduce UAVReason, a large-scale UAV-native dataset and evaluation suite for studying unified aerial reasoning and generation under this nadir-view domain shift. UAVReason aligns RGB imagery, depth maps, semantic segmentation masks, captions, and question-answer pairs within a consistent aerial domain. It contains 23.6K captioned frames, 273K VQA pairs including 68.2K two-frame temporal questions, and 188.8K cross-modal generation samples across RGB, depth, and segmentation modalities. We further adapt UAVReason-Bagel as a unified understanding-and-generation baseline that jointly optimizes language reasoning and dense visual generation objectives. Experiments show that general-purpose VLMs and off-the-shelf unified generators struggle with UAV-native grounding, while UAVReason-Bagel substantially improves over its pretrained counterpart, increasing VQA-1F F1 from 0.394 to 0.711, VQA-2F F1 from 0.427 to 0.822, and heading-aware VQA F1 from 0.798 to 0.973. For generation, it improves segmentation mIoU to 0.143 and reduces KID from 0.078 to 0.048 for depth-segmentation-text-conditioned RGB synthesis. More importantly, our ablations reveal a bidirectional synergy between synthesis and reasoning. Dense generation objectives improve temporal semantic consistency, while language-level reasoning regularizes sparse-condition image synthesis. These results suggest that unified reasoning and generation provide effective geometry-aware structural priors for physically grounded aerial intelligence. All data, code, and evaluation tools will be released.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 8 of its 41 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
8 of 41 references.
References · 8
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026RSVideo: Are Your Vision-Language Models Ready for Remote Sensing Videos?cited by 1
- 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoningcited by 0
- 2026UniGeo: A Multi-modal Large Language Model for Text-Guided Cross-View Geo-Localizationcited by 0
- 2026Understanding Dynamic Scenes at Gigapixel Scale: Wide-Area Spatio-Temporal Perception from UAVscited by 0
- 2026Understanding Dynamic Scenes at Gigapixel Scale: Wide-Area Spatio-Temporal Perception from UAVs16 Sep 2026
- 2026UniGeo: A Multi-modal Large Language Model for Text-Guided Cross-View Geo-Localization27 Aug 2026
- 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning12 Aug 2026
- 2026RSVideo: Are Your Vision-Language Models Ready for Remote Sensing Videos?3 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2025UAV-VL-R1: Generalizing Vision-Language Models via Supervised Fine-Tuning and Multi-Stage GRPO for UAV Visual Reasoning
- 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
- 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs
- 2026SkyVLaM: Multimodal Large Language Model for UAV Video Understanding in Remote Sensing
- 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation