mlsanityData to 14 Oct 2026

Personalize-then-Store: Benchmarking and Learning Personalized Memory for Long-horizon Agents

arXiv 2605.25535 ↗First posted 25 May 2026cs.AIcited by 3

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Existing large language model (LLM) based memory systems apply universal, static policies that overlook a fundamental reality: the contexts that are worth storing in memory are different across users. This misalignment wastes limited memory budget on transient interactions while failing to preserve critical context for long horizon tasks. To address this gap, we investigate an underexplored question: can LLM based memory systems learn personalized memory policies? We introduce PerMemBench, the first benchmark for evaluating personalized memory systems, featuring multi year, multi domain interaction histories across diverse user personas. We further present the first empirical study of memory personalization, proposing session level storage gating, a lightweight framework that selectively bypasses memory operations for transient sessions. Our study confirms that personalization yields substantial retention gains under perfect gating, yet reveals that accurate gating remains an open and critical challenge.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 15 of its 21 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

15 of 21 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026PlugMem: A Task-Agnostic Plugin Memory Module for LLM Agents6 Feb
  2. 2025Memory in the Age of AI Agents15 Dec
  3. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning27 Aug
  4. 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents18 Jun
  5. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
  6. 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents11 Mar
  7. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  8. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb

Other references · 7

  1. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  2. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
  3. 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 79
  4. 2025M+: Extending MemoryLLM with Scalable Long-Term Memorycited by 54
  5. 2025HaluMem: Evaluating Hallucinations in Memory Systems of Agentscited by 54
  6. 2024DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agentscited by 20
  7. 2026AMemGym: Interactive Memory Benchmarking for Assistants in Long-Horizon Conversationscited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Graph-Based Personalized Memory for LLM Agents: Representation, Evolution, Retrieval, and Evaluation
  2. 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environments
  3. 2026AdaMem: Learning What to Remember with Adaptive Memory Policies for Personalized Agents
  4. 2026MemoryCD: Benchmarking Long-Context User Memory of LLM Agents for Lifelong Cross-Domain Personalization
  5. 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents
  6. 2026QUMem: Personalized Memory for Query-Conditioned User-State Inference in LLM Agents
  7. 2025Enabling Personalized Long-term Interactions in LLM-based Agents through Persistent Memory and User Profiles
  8. 2026Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human-Agent Interaction