LifeSim: Long-Horizon User Life Simulator for Personalized Assistant Evaluation
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of large language models (LLMs) has accelerated progress toward universal AI assistants. However, existing benchmarks for personalized assistants remain misaligned with real-world user-assistant interactions, failing to capture the complexity of external contexts and users' cognitive states. To bridge this gap, we propose LifeSim, a user simulator that models user cognition through the Belief-Desire-Intention (BDI) model within physical environments for coherent life trajectories generation, and simulates intention-driven user interactive behaviors. Based on LifeSim, we introduce LifeSim-Eval, a comprehensive benchmark for multi-scenario, long-horizon personalized assistance. LifeSim-Eval covers 8 life domains and 1,200 diverse scenarios, and adopts a multi-turn interactive method to assess models' abilities to complete explicit and implicit intentions, recover user profiles, and produce high-quality responses. Under both single-scenario and long-horizon settings, our experiments reveal that current LLMs face significant limitations in handling implicit intention and long-term user preference modeling.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 19 of its 43 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
19 of 43 references.
References · 19
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 142
- 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 99
- 2025SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Userscited by 50
- 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 44
- 2022GLOBEM Dataset: Multi-Year Datasets for Longitudinal Human Behavior Modeling Generalizationcited by 28
7 more
- 2025From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignmentcited by 28
- 2023Personalized Large Language Model Assistant with Evolving Conditional Memorycited by 24
- 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignmentcited by 22
- 2025AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulationcited by 21
- 2025CUPID: Evaluating Personalized and Contextualized Alignment of LLMs from Interactionscited by 20
- 2025ProPerSim: Developing Proactive and Personalized AI Assistants through User-Assistant Simulationcited by 10
- 2025LIFELONG SOTOPIA: Evaluating Social Intelligence of Language Agents Over Lifelong Social Interactionscited by 7
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026SMMBench: A Benchmark for Source-Distributed Multimodal Agent Memorycited by 5
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agentscited by 3
- 2026Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agentscited by 2
- 2026Online Agent-as-a-Judge: Situation-Generating Evaluation for Interactive Agentscited by 1
- 2026OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agentscited by 1
- 2026UserGPT Technical Reportcited by 0
- 2026MemoryForge: Synthesize Lifelong Memory for Human-Like LLM Agentscited by 0
- 2026LUNAR: Benchmarking Personalized Large Language Models on UNiversal User BehAvioR Logscited by 0
- 2026LiveSim: Simulating Environment-Shaped Users in Multi-Agent Live-Stream Ecosystemscited by 0
- 2026Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental Statescited by 0
- 2026Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Livescited by 0
- 2026Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Lives1 Oct 2026
- 2026Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States14 Sep 2026
- 2026LiveSim: Simulating Environment-Shaped Users in Multi-Agent Live-Stream Ecosystems27 Aug 2026
- 2026LUNAR: Benchmarking Personalized Large Language Models on UNiversal User BehAvioR Logs5 Aug 2026
- 2026OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agents4 Aug 2026
- 2026MemoryForge: Synthesize Lifelong Memory for Human-Like LLM Agents10 Jun 2026
- 2026Bridging the Agent-World Gap: Text World Models for LLM-based Agents8 Jun 2026
- 2026Online Agent-as-a-Judge: Situation-Generating Evaluation for Interactive Agents6 Jun 2026
- 2026Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agents27 May 2026
- 2026SMMBench: A Benchmark for Source-Distributed Multimodal Agent Memory15 May 2026
- 2026UserGPT Technical Report9 May 2026