mlsanityData to 14 Oct 2026

Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

arXiv 2609.37938 ↗First posted 29 Sep 2026cs.CV cs.AI cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Embodied systems must make knowledge acquired during one encounter usable in another despite changes in viewpoint, motion, and illumination. Yet aggregate cross-video accuracy conflates failures of local perception with failures to preserve observation identity, establish correspondence, and compose evidence, obscuring whether local video understanding actually transfers. We introduce EgoGears, a complementary single- and multi-video benchmark designed to diagnose this transition. It contains 567 single-video and 1,487 multi-video questions derived from 126 human-collected egocentric recordings covering 39 outdoor routes. Repeated traversals across movement speeds and lighting conditions ground comparisons in shared physical environments; 531 questions require alignment across independent recordings. Single-video questions measure the local visual, spatial, and motion evidence available to a model, while multi-video questions test whether evidence remains bound to the correct observation and can be composed into consistent route relationships. We report 29 single-video and 31 multi-video MLLM configurations across six model families in the main leaderboard. Among the 20 configurations evaluated comparably on both splits, every model performs worse on multi-video questions, with a mean decrease of 22.5 percentage points, and the gap persists when answer format and scoring are held fixed. The gap is not explained simply by additional videos or recording boundaries. The central bottlenecks are observation--evidence binding and ordered route-state tracking. The code and benchmark are publicly available at https://github.com/lei-qi-233/EgoGears.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 43 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

32 of 43 references.

References · 32

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  5. 2025Gemma 3 Technical Reportcited by 1,824
  6. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  7. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
  8. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  9. 2025Qwen3-Omni Technical Reportcited by 497
  10. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  11. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  12. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
20 more
  1. 2026Gemma 4 Technical Reportcited by 259
  2. 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
  3. 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 115
  4. 2025EgoLife: Towards Egocentric Life Assistantcited by 91
  5. 2025STORM: Token-Efficient Long Video Understanding for Multimodal LLMscited by 49
  6. 2025Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric Videoscited by 44
  7. 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 38
  8. 2024AMEGO: Active Memory from long EGOcentric videoscited by 36
  9. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognitioncited by 35
  10. 2025Mavors: Multi-granularity Video Representation for Multimodal Large Language Modelcited by 32
  11. 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answeringcited by 21
  12. 2025EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging Benchmarkcited by 19
  13. 2025LanP: Rethinking the Impact of Language Priors in Large Vision-Language Modelscited by 14
  14. 2025Slow-Fast Architecture for Video Multi-Modal Large Language Modelscited by 10
  15. 2025CrossVid: A Comprehensive Benchmark for Evaluating Cross-Video Reasoning in Multimodal Large Language Modelscited by 4
  16. 2026Seeing Together: Multi-Robot Cooperative Egocentric Spatial Reasoning with Multimodal Large Language Modelscited by 4
  17. 2026Mitigating Manifold Departure: Uncertainty-Aware Subspace Rectification for Trustworthy MLLM Decodingcited by 4
  18. 2026EgoExoMem: Cross-View Memory Reasoning over Synchronized Egocentric and Exocentric Videoscited by 3
  19. 2026EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memorycited by 3
  20. 2026PROVIA: Procedure State Tracking for Online Mistake Detection in Egocentric Videoscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces
  2. 2026EgoOmniWorld: Unifying Egocentric Understanding via Ego-Action-World Interactions
  3. 2026EgoIntent: A Pre-Outcome Micro-Step Benchmark for Understanding What, Why, and Next
  4. 2026SAW-Bench: Learning Situated Awareness in the Real World
  5. 2026Minerva-Ego: Spatiotemporal Hints for Egocentric Video Understanding
  6. 2024VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI
  7. 2026EgoExo-Next:Benchmarking Vision-Language Models on Visual-Option Next-State and Cross-View Reasoning
  8. 2025EgoExoBench: A Benchmark for First- and Third-person View Video Understanding in MLLMs