LifeSide: Benchmarking Agents as Lifelong Digital Companions
Not on the map. Why?
Abstract (arXiv)
Lifelong digital companions must integrate cross-session cues, continually update their understanding of users, and adapt to shifting privacy boundaries. Existing evaluations fail to capture this, testing memory recall and short-term empathy in isolation. To bridge this gap, we introduce benchmark, a benchmark centered on multi-session textitMemory-Emotion-Environment loops. By modeling users as persistent worlds with layered profiles and event trajectories, benchmark uses multi-agent simulation to project environmental dynamics into dialogue, preserving the critical gap between latent thoughts and observable expressions. Evaluating 2,000 personas and 111K tasks across memory tracking, user understanding, privacy control, and emotional companionship, our experiment results reveal a stark reality: even models that saturate current memory benchmarks fail to sustain accurate user understanding and true companionship over long horizons.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 57 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
29 of 57 references.
References · 29
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,270
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 236
- 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Modelscited by 232
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 140
17 more
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
- 2025NoLiMa: Long-Context Evaluation Beyond Literal Matchingcited by 120
- 2024Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Taskscited by 102
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 84
- 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 82
- 2022Improving Multi-turn Emotional Support Dialogue Generation with Lookahead Strategy Planningcited by 59
- 2022Control Globally, Understand Locally: A Global-to-Local Hierarchical Graph Network for Emotional Support Conversationcited by 56
- 2025MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systemscited by 56
- 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applicationscited by 46
- 2023Knowledge-enhanced Mixed-initiative Dialogue System for Emotional Support Conversationscited by 41
- 2025Kardia-R1: Unleashing LLMs to Reason toward Understanding and Empathy for Emotional Support via Rubric-as-Judge Reinforcement Learningcited by 22
- 2025Large Language Models Do Not Simulate Human Psychologycited by 17
- 2024MADial-Bench: Towards Real-world Evaluation of Memory-Augmented Dialogue Generationcited by 15
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 12
- 2026ES-MemEval: Benchmarking Conversational Agents on Personalized Long-Term Emotional Supportcited by 10
- 2026CloneMem: Benchmarking Long-Term Memory for AI Clonescited by 6
- 2024Mitigating Unhelpfulness in Emotional Support Conversations with Multifaceted AI Feedbackcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.