mlsanityData to 7 Oct 2026

Can Vision-Language Models Think from the Sky? Unifying UAV Reasoning and Generation

arXiv 2604.05377 ↗First posted 7 Apr 2026cs.CVcited by 4

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Vision-Language Models have achieved strong progress in ground-view visual understanding, yet they remain brittle in high-altitude Unmanned Aerial Vehicle scenes, where objects are tiny and densely packed, textures are repetitive, and top-down orientations are ambiguous. We introduce UAVReason, a large-scale UAV-native dataset and evaluation suite for studying unified aerial reasoning and generation under this nadir-view domain shift. UAVReason aligns RGB imagery, depth maps, semantic segmentation masks, captions, and question-answer pairs within a consistent aerial domain. It contains 23.6K captioned frames, 273K VQA pairs including 68.2K two-frame temporal questions, and 188.8K cross-modal generation samples across RGB, depth, and segmentation modalities. We further adapt UAVReason-Bagel as a unified understanding-and-generation baseline that jointly optimizes language reasoning and dense visual generation objectives. Experiments show that general-purpose VLMs and off-the-shelf unified generators struggle with UAV-native grounding, while UAVReason-Bagel substantially improves over its pretrained counterpart, increasing VQA-1F F1 from 0.394 to 0.711, VQA-2F F1 from 0.427 to 0.822, and heading-aware VQA F1 from 0.798 to 0.973. For generation, it improves segmentation mIoU to 0.143 and reduces KID from 0.078 to 0.048 for depth-segmentation-text-conditioned RGB synthesis. More importantly, our ablations reveal a bidirectional synergy between synthesis and reasoning. Dense generation objectives improve temporal semantic consistency, while language-level reasoning regularizes sparse-condition image synthesis. These results suggest that unified reasoning and generation provide effective geometry-aware structural priors for physically grounded aerial intelligence. All data, code, and evaluation tools will be released.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 8 of its 41 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

8 of 41 references.

References · 8

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  5. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  6. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  7. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  8. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
  2. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
  3. 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
  4. 2025UAV-VL-R1: Generalizing Vision-Language Models via Supervised Fine-Tuning and Multi-Stage GRPO for UAV Visual Reasoning
  5. 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
  6. 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs
  7. 2026SkyVLaM: Multimodal Large Language Model for UAV Video Understanding in Remote Sensing
  8. 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation