mlsanityData to 14 Oct 2026

GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents

arXiv 2606.18829 ↗First posted 17 Jun 2026cs.LG cs.CLcited by 13

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Memory benchmarks for LLM agents largely assume single-user settings, leaving shared assistants for hospitals, workplaces, campuses, and households understudied. In these deployments, multiple principals write to a common memory pool and query it under different roles, scopes, and relationships, so memory quality requires governance as well as recall. We introduce GateMem, a benchmark for multi-principal shared-memory agents. GateMem jointly evaluates utility for legitimate long-horizon requests with state updates, access control across contextual authorization boundaries, and agent-facing active forgetting after explicit deletion requests. It spans medical, office, education, and household domains, with long-form multi-party episodes, incremental memory injection, hidden checkpoints, structured judging, and leak-target annotations. Across diverse baselines and backbone models, no method simultaneously achieves strong utility, robust access control, and reliable forgetting. Long-context prompting often yields the best governance score at high token cost, while retrieval-based and external-memory methods reduce cost yet still leak unauthorized or deleted information. These results show current memory agents remain far from reliable shared institutional deployment.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 33 of its 41 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

33 of 41 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents21 Apr
  2. 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications26 Feb
  3. 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks18 Feb
  4. 2026Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agents13 Jan
  5. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
  6. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents20 Jun
  7. 2025Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control23 May
  8. 2025LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners17 May
  9. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
  10. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  11. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb

Other references · 22

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  5. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  6. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  7. 2019Machine Unlearningcited by 1,061
  8. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  9. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  10. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 538
  11. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 369
  12. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
10 more
  1. 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
  2. 2022Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLPcited by 102
  3. 2025HaluMem: Evaluating Hallucinations in Memory Systems of Agentscited by 54
  4. 2025CIMemories: A Compositional Benchmark for Contextual Integrity of Persistent Memory in LLMscited by 26
  5. 2026REMem: Reasoning with Episodic Memory in Language Agentcited by 23
  6. 2026Evaluating Long-Horizon Memory for Multi-Party Collaborative Dialoguescited by 22
  7. 2026PersistBench: When Should Long-Term Memories Be Forgotten by LLMs?cited by 21
  8. 2026RealMem: Benchmarking LLMs in Real-World Memory-Driven Interactioncited by 20
  9. 2026CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agentscited by 14
  10. 2025OrgAccess: A Benchmark for Role Based Access Control in Organization Scale LLMscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundary
  2. 2026DyadMem: A Long-Term Memory Benchmark of How Agents Work with Users
  3. 2026AIM: A Privacy-Aware Interoperable Memory Framework for Multi-Agent Multi-User LLM Systems
  4. 2026MemArchitect: A Policy Driven Memory Governance Layer
  5. 2026Evaluating Memory Structure in LLM Agents
  6. 2026Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the Stability and Safety Governed Memory (SSGM) Framework
  7. 2026PLACEMEM: Toward a Compute-Aware Memory Plane for Lifelong Agents
  8. 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception