StreamMemBench: Streaming Evaluation of Agent Memory for Future-Oriented Assistance
Not on the map. Why?
Abstract (arXiv)
A central role of personal-agent memory is to turn stored information and prior interactions into future-oriented assistance. In daily use, useful cues come from what the agent observes and how the user interacts with the agent, and the agent must carry them forward from the current request to similar future tasks. Existing memory benchmarks usually test dialogue recall or task improvement in isolation, leaving the trajectory from streaming observations to later assistance largely untested. We introduce StreamMemBench, a streaming benchmark that constructs a two-step task sequence around each evidence anchor from EgoLife egocentric streams. The initial task tests evidence use, while the follow-up task tests whether feedback and interaction experience are reused. Four metrics diagnose evidence recall, initial evidence use, feedback incorporation, and follow-up reuse. Experiments with eight memory systems across two backbones show that current systems often fail to use observed evidence or turn feedback into reliable follow-up behavior, even when evidence is stored or feedback is incorporated locally. StreamMemBench is publicly available at https://github.com/landian60/StreamMemBench.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 12 Jun 2026.
Builds on
10 of 21 references.
References · 10
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 254
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 142
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 136
- 2025MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systemscited by 61
- 2026Evaluating Memory Capability in Continuous Lifelog Scenariocited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.