The Gap Is in the Geometry: A Convergent Meta-Analysis of Multi-Facet Aerial and Remote Sensing Video Understanding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models also fits: Video understanding with MLLMs
Abstract (arXiv)
Aerial and remote sensing video is increasingly evaluated like web video, by posing multiple-choice questions to multimodal large language models (MLLMs) over sampled frames and reporting accuracy. This paper argues that this recipe measures the wrong aspect, and supports the claim with a convergent meta-analysis of a broad set of published results, organized in four evidence tiers, in which a claim becomes a position only when collected evidence agrees. Parameter scale exhibits a median of +3.4 accuracy points per tenfold increase on aerial benchmarks, far below a human gap of at least 19 points, whereas acquisition conditions control perception, as 315 of 318 evaluations in 19 within-paper contrasts lose accuracy when conditions such as altitude, view, object size or time horizon become harder. No aerial benchmark in the corpus combines video input with per-task human and random baselines, competence collapses from answering to acting in closed-loop navigation, and the same MLLMs score higher on the aerial benchmark than on ground spatial ones, but lower on studies that test cross-view geometry. From these findings the current study derives five falsifiable principles and proposes the AVU-Card, a reporting card for aerial video benchmarks
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 58 of its 72 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
58 of 72 references.
Closest ancestors · 17
Same direction, newest first
- 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning12 Aug
- 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs17 Jul
- 2026Can Vision-Language Models Think from the Sky? Unifying UAV Reasoning and Generation7 Apr
- 2026UAVBench and UAVIT-1M: Benchmarking and Enhancing MLLMs for Low-Altitude UAV Vision-Language Understanding15 Mar
- 2025MM-UAVBench: How Well Do Multimodal Large Language Models See, Think, and Plan in Low-Altitude UAV Scenarios?29 Dec
- 2025AirCopBench: A Benchmark for Multi-drone Collaborative Embodied Perception and Reasoning14 Nov
- 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes8 Sep
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Response27 May
- 2025DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understanding27 May
- 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence22 May
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?31 Mar
5 more
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D29 Mar
- 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces8 Mar
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks28 Nov
Other references · 41
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2018Datasheets for Datasetscited by 1,386
- 2018Model Cards for Model Reportingcited by 1,080
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
- 2020Detection and Tracking Meet Drones Challengecited by 263
- 2018The Unmanned Aerial Vehicle Benchmark: Object Detection and Trackingcited by 208
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
- 2022Revisiting the "Video" in Video-Language Understandingcited by 169
- 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 157
- 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 152
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
- 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 142
29 more
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 122
- 2023AerialVLN: Vision-and-Language Navigation for UAVscited by 121
- 2022Slicing Aided Hyper Inference and Fine-tuning for Small Object Detectioncited by 105
- 2021UAV-Human: A Large Benchmark for Human Behavior Understanding with Unmanned Aerial Vehiclescited by 96
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 91
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
- 2022SUES-200: A Multi-height Multi-scene Cross-view Image Benchmark Across Drone and Satellitecited by 64
- 2021SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Watercited by 61
- 2017Okutama-Action: An Aerial View Video Dataset for Concurrent Human Action Detectioncited by 46
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
- 2024CityNav: A Large-Scale Dataset for Real-World Aerial Navigationcited by 42
- 2024Lost in Time: A New Temporal Benchmark for VideoLLMscited by 42
- 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 33
- 2025CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Spacecited by 32
- 2021Detection, Tracking, and Counting Meets Drones in Crowds: A Benchmarkcited by 31
- 2019Delving into Robust Object Detection from Unmanned Aerial Vehicles: A Deep Nuisance Disentanglement Approachcited by 23
- 2025RefDrone: A Challenging Benchmark for Referring Expression Comprehension in Drone Scenescited by 19
- 2020ERA: A Dataset and Deep Learning Benchmark for Event Recognition in Aerial Videoscited by 18
- 2021Detecting and Tracking Small and Dense Moving Objects in Satellite Videos: A Benchmarkcited by 18
- 2023Multiview Aerial Visual Recognition (MAVREC): Can Multi-view Improve Aerial Visual Perception?cited by 18
- 2024Video2BEV: Transforming Drone Videos to BEVs for Video-based Geo-localizationcited by 17
- 2025AG-VPReID: A Challenging Large-Scale Benchmark for Aerial-Ground Video-based Person Re-Identificationcited by 13
- 2025CST Anti-UAV: A Thermal Infrared Benchmark for Tiny UAV Tracking in Complex Scenescited by 8
- 2025AerialMind: Towards Referring Multi-Object Tracking in UAV Scenarioscited by 4
- 2026SpatialUAV: Benchmarking Spatial Intelligence for Low-Altitude UAV Perception, Collaboration, and Motioncited by 2
- 2025Light-Weight Cross-Modal Enhancement Method with Benchmark Construction for UAV-based Open-Vocabulary Object Detectioncited by 1
- 2026Sky2Ground: A Benchmark for Site Modeling under Varying Altitudecited by 1
- 2026ForeSea: AI Forensic Search with Multi-modal Queries for Video Surveillancecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ReVA: A Scene-Centric Dataset Beyond Repetition for Remote Sensing Video Question Answering
- 2026Beyond Appearance: Can Multimodal Large Language Models Exploit Vertical Structure for Remote Sensing Natural Scene Understanding?
- 2026RSVideo: Are Your Vision-Language Models Ready for Remote Sensing Videos?
- 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
- 2026Are VLMs Lost Between Sky and Space? LinkS2Bench for UAV-Satellite Dynamic Cross-View Spatial Intelligence
- 2026Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark
- 2025GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding
- 2026AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration