mlsanityData to 14 Oct 2026

EgoProbe: Benchmarking Long-Range and Exact Memory in Streaming Egocentric Videos

arXiv 2610.17128 ↗First posted 12 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Egocentric video provides a continuous first-person record of everyday activities, making it a natural foundation for wearable AI assistants. Unlike offline video understanding, streaming systems must process observations as they arrive, while queries may refer to experiences from the distant past. Recent work has begun to explore whether information can be recalled across long temporal gaps. Yet remembering how far is only part of the challenge: recurring objects, actions, and locations also require models to remember exactly which detail belongs to which event. We introduce EgoProbe, a benchmark that evaluates streaming egocentric memory along these two complementary dimensions: long-range retention, i.e., how far, and event-specific recall under interference, i.e., how exact. Built on long-form egocentric videos, EgoProbe uses an event-grounded data engine to extend recall intervals, identify related events, and construct event-grounded distractors, followed by human verification. It contains two subsets: EgoProbe-Base, which evaluates long-range recall without intervening related events, and EgoProbe-Echo, which challenges models with similar intervening events and event-grounded distractors. EgoProbe-Echo adopts coarse-to-fine multi-turn probing: the first turn evaluates coarse-grained event recall, while the second tests whether the model can retrieve the target-specific detail associated with the designated event. Extensive evaluation across diverse models reveals substantial limitations in long-range recall, with further challenges in recovering target-event details among related experiences. Even when models correctly answer coarse-grained questions, they often fail to recall the specific details of the designated event. EgoProbe exposes this underexplored failure mode and provides a testbed for advancing long-range and exact memory in streaming egocentric video understanding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 53 of its 58 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

53 of 58 references.

References · 53

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  6. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  7. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  8. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  9. 2024Long Context Transfer from Language to Visioncited by 515
  10. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  11. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 356
  12. 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
38 more
  1. 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 225
  2. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
  3. 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
  4. 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 142
  5. 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 104
  6. 2025StreamingVLM: Real-Time Understanding for Infinite Video Streamscited by 95
  7. 2025EgoLife: Towards Egocentric Life Assistantcited by 91
  8. 2025Flash-VStream: Efficient Real-Time Understanding for Long Video Streamscited by 81
  9. 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 78
  10. 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 68
  11. 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 61
  12. 2025Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric Videoscited by 44
  13. 2026HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understandingcited by 41
  14. 2024GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Realitycited by 39
  15. 2026A Simple Baseline for Streaming Video Understandingcited by 33
  16. 2023Ego-Only: Egocentric Action Detection without Exocentric Transferringcited by 31
  17. 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 29
  18. 2026Video Streaming Thinking: VideoLLMs Can Watch and Think Simultaneouslycited by 22
  19. 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answeringcited by 21
  20. 2025EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging Benchmarkcited by 19
  21. 2026OASIS: On-Demand Hierarchical Event Memory for Streaming Video Reasoningcited by 19
  22. 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Modelcited by 16
  23. 2023EgoPCA: A New Framework for Egocentric Hand-Object Interaction Understandingcited by 15
  24. 2025Exo2EgoSyn: Unlocking Foundation Video Generation Models for Exocentric-to-Egocentric Video Synthesiscited by 15
  25. 2025V2-SAM: Marrying SAM2 with Multi-Prompt Experts for Cross-View Object Correspondencecited by 14
  26. 2026RIVER: A Real-Time Interaction Benchmark for Video LLMscited by 14
  27. 2026JoyAI-VL-Interaction: Real-Time Vision-Language Interaction Intelligencecited by 14
  28. 2026EventMemAgent: Hierarchical Event-Centric Memory for Online Video Understanding with Adaptive Tool Usecited by 12
  29. 2026Egocentric World Model for Photorealistic Hand-Object Interaction Synthesiscited by 12
  30. 2026EgoSound: Benchmarking Sound Understanding in Egocentric Videoscited by 11
  31. 2025ToG-Bench: Task-Oriented Spatio-Temporal Grounding in Egocentric Videoscited by 8
  32. 2026OFlow: Injecting Object-Aware Temporal Flow Matching for Robust Robotic Manipulationcited by 8
  33. 2026EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understandingcited by 6
  34. 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretrainingcited by 6
  35. 2026EGOSTREAM: A Diagnostic Benchmark for Streaming Episodic Memory in Egocentric Visioncited by 5
  36. 2026ObjectStream: Latent Objects as Memory Anchors for Streaming Video Understandingcited by 5
  37. 2026Afford-VLA: Action-Aligned Visual Planning via Internalized Affordancecited by 4
  38. 2023EgoSpot:Egocentric Multimodal Control for Hands-Free Mobile Manipulationcited by 3

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.