EgoProbe: Benchmarking Long-Range and Exact Memory in Streaming Egocentric Videos
Not on the map. Why?
Abstract (arXiv)
Egocentric video provides a continuous first-person record of everyday activities, making it a natural foundation for wearable AI assistants. Unlike offline video understanding, streaming systems must process observations as they arrive, while queries may refer to experiences from the distant past. Recent work has begun to explore whether information can be recalled across long temporal gaps. Yet remembering how far is only part of the challenge: recurring objects, actions, and locations also require models to remember exactly which detail belongs to which event. We introduce EgoProbe, a benchmark that evaluates streaming egocentric memory along these two complementary dimensions: long-range retention, i.e., how far, and event-specific recall under interference, i.e., how exact. Built on long-form egocentric videos, EgoProbe uses an event-grounded data engine to extend recall intervals, identify related events, and construct event-grounded distractors, followed by human verification. It contains two subsets: EgoProbe-Base, which evaluates long-range recall without intervening related events, and EgoProbe-Echo, which challenges models with similar intervening events and event-grounded distractors. EgoProbe-Echo adopts coarse-to-fine multi-turn probing: the first turn evaluates coarse-grained event recall, while the second tests whether the model can retrieve the target-specific detail associated with the designated event. Extensive evaluation across diverse models reveals substantial limitations in long-range recall, with further challenges in recovering target-event details among related experiences. Even when models correctly answer coarse-grained questions, they often fail to recall the specific details of the designated event. EgoProbe exposes this underexplored failure mode and provides a testbed for advancing long-range and exact memory in streaming egocentric video understanding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 53 of its 58 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
53 of 58 references.
References · 53
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen3 Technical Reportcited by 8,820
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
- 2024Long Context Transfer from Language to Visioncited by 515
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 356
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
38 more
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 225
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
- 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 142
- 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 104
- 2025StreamingVLM: Real-Time Understanding for Infinite Video Streamscited by 95
- 2025EgoLife: Towards Egocentric Life Assistantcited by 91
- 2025Flash-VStream: Efficient Real-Time Understanding for Long Video Streamscited by 81
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 78
- 2025Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoningcited by 68
- 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 61
- 2025Omnia de EgoTempo: Benchmarking Temporal Understanding of Multi-Modal LLMs in Egocentric Videoscited by 44
- 2026HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understandingcited by 41
- 2024GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Realitycited by 39
- 2026A Simple Baseline for Streaming Video Understandingcited by 33
- 2023Ego-Only: Egocentric Action Detection without Exocentric Transferringcited by 31
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 29
- 2026Video Streaming Thinking: VideoLLMs Can Watch and Think Simultaneouslycited by 22
- 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answeringcited by 21
- 2025EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging Benchmarkcited by 19
- 2026OASIS: On-Demand Hierarchical Event Memory for Streaming Video Reasoningcited by 19
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Modelcited by 16
- 2023EgoPCA: A New Framework for Egocentric Hand-Object Interaction Understandingcited by 15
- 2025Exo2EgoSyn: Unlocking Foundation Video Generation Models for Exocentric-to-Egocentric Video Synthesiscited by 15
- 2025V2-SAM: Marrying SAM2 with Multi-Prompt Experts for Cross-View Object Correspondencecited by 14
- 2026RIVER: A Real-Time Interaction Benchmark for Video LLMscited by 14
- 2026JoyAI-VL-Interaction: Real-Time Vision-Language Interaction Intelligencecited by 14
- 2026EventMemAgent: Hierarchical Event-Centric Memory for Online Video Understanding with Adaptive Tool Usecited by 12
- 2026Egocentric World Model for Photorealistic Hand-Object Interaction Synthesiscited by 12
- 2026EgoSound: Benchmarking Sound Understanding in Egocentric Videoscited by 11
- 2025ToG-Bench: Task-Oriented Spatio-Temporal Grounding in Egocentric Videoscited by 8
- 2026OFlow: Injecting Object-Aware Temporal Flow Matching for Robust Robotic Manipulationcited by 8
- 2026EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understandingcited by 6
- 2026LA4VLA: Learning to Act without Seeing via Language-Action Pretrainingcited by 6
- 2026EGOSTREAM: A Diagnostic Benchmark for Streaming Episodic Memory in Egocentric Visioncited by 5
- 2026ObjectStream: Latent Objects as Memory Anchors for Streaming Video Understandingcited by 5
- 2026Afford-VLA: Action-Aligned Visual Planning via Internalized Affordancecited by 4
- 2023EgoSpot:Egocentric Multimodal Control for Hands-Free Mobile Manipulationcited by 3
50 most cited of 53 All 53 (JSON)
Built on by
Not cited yet.