mlsanityData to 7 Oct 2026

MemoryCD: Benchmarking Long-Context User Memory of LLM Agents for Lifelong Cross-Domain Personalization

arXiv 2603.25973 ↗First posted 26 Mar 2026cs.CLcited by 15

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Recent advancements in Large Language Models (LLMs) have expanded context windows to million-token scales, yet benchmarks for evaluating memory remain limited to short-session synthetic dialogues. We introduce textscMemoryCD, the first large-scale, user-centric, cross-domain memory benchmark derived from lifelong real-world behaviors in the Amazon Review dataset. Unlike existing memory datasets that rely on scripted personas to generate synthetic user data, textscMemoryCD tracks authentic user interactions across years and multiple domains. We construct a multi-faceted long-context memory evaluation pipeline of 14 state-of-the-art LLM base models with 6 memory method baselines on 4 distinct personalization tasks over 12 diverse domains to evaluate an agent's ability to simulate real user behaviors in both single and cross-domain settings. Our analysis reveals that existing memory methods are far from user satisfaction in various domains, offering the first testbed for cross-domain life-long personalization evaluation.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 39 of its 46 references that are in the map. First posted on arXiv 26 Mar 2026.

Builds on

39 of 46 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026Learning Query-Aware Budget-Tier Routing for Runtime Agent Memory5 Feb
  2. 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agents2 Feb
  3. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents14 Jan
  4. 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agents7 Jan
  5. 2025Scaling Long-Horizon LLM Agent via Context-Folding13 Oct
  6. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
  7. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents20 Jun
  8. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
  9. 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents11 Mar
  10. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  11. 2024Large Language Models Empowered Personalized Web Agents22 Oct
  12. 2024A Survey on the Memory Mechanism of Large Language Model based Agents21 Apr
2 more
  1. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
  2. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts15 Feb

Other references · 25

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  5. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  6. 2023A Comprehensive Overview of Large Language Modelscited by 639
  7. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  8. 2023LaMP: When Large Language Models Meet Personalizationcited by 425
  9. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
  10. 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 213
  11. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  12. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
13 more
  1. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
  2. 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 142
  3. 2013A Theoretical Analysis of NDCG Type Ranking Measurescited by 119
  4. 2025MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systemscited by 56
  5. 2025HaluMem: Evaluating Hallucinations in Memory Systems of Agentscited by 51
  6. 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agentscited by 49
  7. 2025Cold-Start Recommendation towards the Era of Large Language Models (LLMs): A Comprehensive Survey and Roadmapcited by 19
  8. 2023A/B Testing: A Systematic Literature Reviewcited by 16
  9. 2025PSG-Agent: Personality-Aware Safety Guardrail for LLM-based Agentscited by 12
  10. 2025LLMInit: A Free Lunch from Large Language Models for Selective Initialization of Recommendationcited by 7
  11. 2025Deep Research with Open-Domain Evaluation and Multi-Stage Guardrails for Safetycited by 6
  12. 2025LLM-MemCluster: Empowering Large Language Models with Dynamic Memory for Text Clusteringcited by 3
  13. 2025DTRec: Learning Dynamic Reasoning Trajectories for Sequential Recommendationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 15.

15 papers.

Sort:

By area:

  1. 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 9
  2. 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
  3. 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflowscited by 5
  4. 2026MemTrace: Probing What Final Accuracy Misses in Long-Term Memorycited by 4
  5. 2026H2HMem: A Multimodal Memory Benchmark for Agents in Human-Human Interactionscited by 3
  6. 2026RubricsTree: Scalable and Evolving Open-Ended Evaluation of Personal Health Agents across Health Memory and Medical Skillscited by 3
  7. 2026LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generationcited by 1
  8. 2026MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agentscited by 1
  9. 2026BehaviorBench: Modeling Real-World User Decisions from Behavioral Tracescited by 0
  10. 2026Beyond Perplexity: A Behavioral Evaluation Framework for Deployment-Memory Claims in LLM Test-Time Trainingcited by 0
  11. 2026LUNAR: Benchmarking Personalized Large Language Models on UNiversal User BehAvioR Logscited by 0
  12. 2026Learning Preference Adaptation for Large Language Model Personalization via Verbal Reinforcement Learningcited by 0
3 more
  1. 2026Does Your Agent's Memory Survive a Model Upgrade? A Controlled Study of Memory Portabilitycited by 0
  2. 2026MemFold: Learning Compact Soft Memory for Long-Context Personalization via On-Policy Optimizationcited by 0
  3. 2026How Can Recommendation Feedback Evolve Agent Memory?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Enabling Personalized Long-term Interactions in LLM-based Agents through Persistent Memory and User Profiles
  2. 2026Personalize-then-Store: Benchmarking and Learning Personalized Memory for Long-horizon Agents
  3. 2026DyadMem: A Long-Term Memory Benchmark of How Agents Work with Users
  4. 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents
  5. 2026ES-MemEval: Benchmarking Conversational Agents on Personalized Long-Term Emotional Support
  6. 2026AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment
  7. 2026AMemGym: Interactive Memory Benchmarking for Assistants in Long-Horizon Conversations
  8. 2026Graph-Based Personalized Memory for LLM Agents: Representation, Evolution, Retrieval, and Evaluation