mlsanityData to 14 Oct 2026

AirVista-II: An Agentic System for Embodied UAVs Toward Dynamic Scene Semantic Understanding

arXiv 2504.09583 ↗First posted 13 Apr 2025cs.RO cs.AIcited by 4

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Unmanned Aerial Vehicles (UAVs) are increasingly important in dynamic environments such as logistics transportation and disaster response. However, current tasks often rely on human operators to monitor aerial videos and make operational decisions. This mode of human-machine collaboration suffers from significant limitations in efficiency and adaptability. In this paper, we present AirVista-II -- an end-to-end agentic system for embodied UAVs, designed to enable general-purpose semantic understanding and reasoning in dynamic scenes. The system integrates agent-based task identification and scheduling, multimodal perception mechanisms, and differentiated keyframe extraction strategies tailored for various temporal scenarios, enabling the efficient capture of critical scene information. Experimental results demonstrate that the proposed system achieves high-quality semantic understanding across diverse UAV-based dynamic scenarios under a zero-shot setting.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 15 of its 25 references that are in the map. First posted on arXiv 13 Apr 2025.

Builds on

15 of 25 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space18 Feb
  2. 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility4 Jan
  3. 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models28 Aug

Other references · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  5. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  6. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  7. 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 251
  8. 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLMcited by 97
  9. 2024Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QAcited by 68
  10. 2023SynDrone -- Multi-modal UAV Dataset for Urban Scenarioscited by 28
  11. 2020ERA: A Dataset and Deep Learning Benchmark for Event Recognition in Aerial Videoscited by 18
  12. 2023Semi-Parametric Video-Grounded Text Generationcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgenticSwarm: Semantic Perception and Adaptive Task Allocation for Heterogeneous Multi-UAV Missions ↗
  2. 2026Towards Embodied Air-Ground Cooperative Object Search: Benchmark, Dataset and Agentic Method
  3. 2025BEDI: A Comprehensive Benchmark for Evaluating Embodied Agents on UAVs
  4. 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs
  5. 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning
  6. 2026ActiveFly-Bench: Aligning Embodied Question Answering with Vision-Language-Action for Aerial Embodied Perception
  7. 2025Agentic Aerial Cinematography: From Dialogue Cues to Cinematic Trajectories
  8. 2025Towards Autonomous UAV Visual Object Search in City Space: Benchmark and Agentic Methodology