mlsanityData to 14 Oct 2026

Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence

arXiv 2607.12477 ↗First posted 14 Jul 2026cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Autonomous UAV systems increasingly rely on multimodal large language models (MLLMs) to operate in complex real-world environments. Such embodied scenarios require not only understanding the surrounding space but also maintaining a coherent representation of the agent itself. However, existing UAV-oriented approaches and benchmarks remain largely environment-centric, primarily focusing on spatial understanding tasks, with the agent's self-awareness remaining implicit. To address this gap, we introduce SIS-Bench, a benchmark for evaluating embodied spatial intelligence in UAV scenarios under a unified self-in-space formulation. SIS-Bench organizes evaluation along two complementary dimensions, space and self, and a three-level hierarchy of perception, memory, and reasoning. It contains 4,856 question--answer pairs across 13 tasks derived from 1,646 real-world UAV videos through a task-conditioned construction pipeline with expert verification. Extensive evaluations reveal that current MLLMs exhibit fundamental limitations in modeling dynamic and agent-centered processes. In particular, we observe a clear imbalance between spatial cognition and self-awareness, as well as a progressive performance degradation across cognitive levels. Motivated by these findings, we further explore a motion-aware representation that incorporates self-related dynamics through optical flow and visual feature fusion. Experimental results show that modeling agent motion consistently improves perception and memory performance, not only in spatial cognition but also in self-awareness, and generalizes to downstream UAV decision-making tasks. Our results highlight the importance of self-awareness for advancing embodied spatial intelligence, and provide both a new benchmark and empirical evidence for motion-aware self-in-space modeling.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 49 of its 60 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

49 of 60 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  8. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  9. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  10. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
  11. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  12. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
37 more
  1. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  2. 2025Kimi-VL Technical Reportcited by 388
  3. 2023An Embodied Generalist Agent in 3D Worldcited by 365
  4. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  5. 2018Speaker-Follower Models for Vision-and-Language Navigationcited by 340
  6. 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planningcited by 210
  7. 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
  8. 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoningcited by 175
  9. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
  10. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 144
  11. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
  12. 2023Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenescited by 129
  13. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
  14. 2024Grounded 3D-LLM with Referent Tokenscited by 115
  15. 2025MiMo-VL Technical Reportcited by 115
  16. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
  17. 2025Ovis2.5 Technical Reportcited by 108
  18. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
  19. 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
  20. 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
  21. 2021Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigationcited by 47
  22. 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
  23. 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spacescited by 36
  24. 2026STEP3-VL-10B Technical Reportcited by 32
  25. 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecturecited by 30
  26. 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 29
  27. 2025UAVScenes: A Multi-Modal Dataset for UAVscited by 27
  28. 2025Exo2EgoSyn: Unlocking Foundation Video Generation Models for Exocentric-to-Egocentric Video Synthesiscited by 15
  29. 2025V2-SAM: Marrying SAM2 with Multi-Prompt Experts for Cross-View Object Correspondencecited by 14
  30. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVscited by 11
  31. 2025IndoorUAV: Benchmarking Vision-Language UAV Navigation in Continuous Indoor Environmentscited by 10
  32. 2025MM-UAVBench: How Well Do Multimodal Large Language Models See, Think, and Plan in Low-Altitude UAV Scenarios?cited by 10
  33. 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoningcited by 8
  34. 2025AirScape: An Aerial Generative World Model with Motion Controllabilitycited by 7
  35. 2025Agentic UAVs: LLM-Driven Autonomy with Integrated Tool-Calling and Cognitive Reasoningcited by 7
  36. 2026Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorialcited by 4
  37. 2025Embodiment in multimodal large language modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024AeroVerse: UAV-Agent Benchmark Suite for Simulating, Pre-training, Finetuning, and Evaluating Aerospace Embodied World Models
  2. 2026AirGroundBench: Probing Spatial Intelligence in Multimodal Large Models under Heterogeneous Multi-View Embodied Collaboration
  3. 2026Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
  4. 2026ActiveFly-Bench: Aligning Embodied Question Answering with Vision-Language-Action for Aerial Embodied Perception
  5. 2025NavSpace: How Navigation Agents Follow Spatial Intelligence Instructions
  6. 2025BEDI: A Comprehensive Benchmark for Evaluating Embodied Agents on UAVs
  7. 2025Embodied4C: Measuring What Matters for Embodied Vision-Language Navigation
  8. 2026Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents