mlsanityData to 14 Oct 2026

EgoSIS: From Factorized Visual Ego-Transitions to Motion-Canonical Spatial Evidence for UAV Reasoning

arXiv 2609.08938 ↗First posted 8 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

UAV video question answering requires separating camera motion from changes in the scene, but RGB-only multimodal models receive no explicit, stable reference for that separation. We present EgoSIS, a pose-free adapter that converts RGB-derived bidirectional flow into motion-canonical visual evidence in three stages. Factorized Visual Ego-Transitions (FVET) fits a robust image-plane transition and exposes motion, residual-support, and reliability factors. Reliability-Gated Ego-Transition Memory (ReTEM) uses reliability-weighted updates for a bounded history and re-anchors it at cuts or sustained uncertainty. Ego-Aligned Spatial Evidence (EASE) warps supported visual features into each segment's local anchor and injects four spatial evidence tokens per visual slice through zero-initialized residuals, without changing Qwen's visual-token count. On SIS-Bench, EgoSIS-8B obtains 89.9% perception, 82.5% perception-plus-memory, and 76.2% overall accuracy, with the largest gains concentrated in self-awareness perception and memory. The adapter thus provides an interpretable interface between optical flow and spatial reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 32 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

25 of 32 references.

References · 25

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  6. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  7. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  8. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  9. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  10. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  11. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  12. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
13 more
  1. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
  2. 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 224
  3. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
  4. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
  5. 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
  6. 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 70
  7. 2025Towards Understanding Camera Motions in Any Videocited by 64
  8. 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Frameworkcited by 24
  9. 2025Agent-Based Anti-Jamming Techniques for UAV Communications in Adversarial Environments: A Comprehensive Surveycited by 8
  10. 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligencecited by 6
  11. 2025Frequency Point Game Environment for UAVs via Expert Knowledge and Large Language Modelcited by 4
  12. 2026Zero-Parameter Geometric Gating for Temporally Stable Low-Altitude UAV Video Semantic Segmentationcited by 4
  13. 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perceptioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understanding
  2. 2026Minerva-Ego: Spatiotemporal Hints for Egocentric Video Understanding
  3. 2026OmniEgo-R2: A Routed Reasoning Framework for the 1st Cross-Domain EgoCross Challenge at CVPR 2026
  4. 2025EgoPrune: Efficient Token Pruning for Egomotion Video Reasoning in Embodied Agent
  5. 2026Spatial-Conditioned Reasoning in Long-Egocentric Videos
  6. 2026ScoutVLA: UAV-Centric Active Perception via a Dual-Expert VLA Model for Open-World Embodied Question Answering
  7. 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoT
  8. 2026SpatialUAV: Benchmarking Spatial Intelligence for Low-Altitude UAV Perception, Collaboration, and Motion