GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Memory benchmarks for LLM agents largely assume single-user settings, leaving shared assistants for hospitals, workplaces, campuses, and households understudied. In these deployments, multiple principals write to a common memory pool and query it under different roles, scopes, and relationships, so memory quality requires governance as well as recall. We introduce GateMem, a benchmark for multi-principal shared-memory agents. GateMem jointly evaluates utility for legitimate long-horizon requests with state updates, access control across contextual authorization boundaries, and agent-facing active forgetting after explicit deletion requests. It spans medical, office, education, and household domains, with long-form multi-party episodes, incremental memory injection, hidden checkpoints, structured judging, and leak-target annotations. Across diverse baselines and backbone models, no method simultaneously achieves strong utility, robust access control, and reliable forgetting. Long-context prompting often yields the best governance score at high token cost, while retrieval-based and external-memory methods reduce cost yet still leak unauthorized or deleted information. These results show current memory agents remain far from reliable shared institutional deployment.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 33 of its 41 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
33 of 41 references.
Closest ancestors · 11
Same direction, newest first
- 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents21 Apr
- 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications26 Feb
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks18 Feb
- 2026Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agents13 Jan
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions7 Jul
- 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents20 Jun
- 2025Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Control23 May
- 2025LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners17 May
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
Other references · 22
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2019Machine Unlearningcited by 1,061
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 538
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agentscited by 369
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
10 more
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
- 2022Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLPcited by 102
- 2025HaluMem: Evaluating Hallucinations in Memory Systems of Agentscited by 54
- 2025CIMemories: A Compositional Benchmark for Contextual Integrity of Persistent Memory in LLMscited by 26
- 2026REMem: Reasoning with Episodic Memory in Language Agentcited by 23
- 2026Evaluating Long-Horizon Memory for Multi-Party Collaborative Dialoguescited by 22
- 2026PersistBench: When Should Long-Term Memories Be Forgotten by LLMs?cited by 21
- 2026RealMem: Benchmarking LLMs in Real-World Memory-Driven Interactioncited by 20
- 2026CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agentscited by 14
- 2025OrgAccess: A Benchmark for Role Based Access Control in Organization Scale LLMscited by 8
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 19
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memorycited by 15
- 2026Agent Memory Is a Surface for Endogenous Authorization Launderingcited by 5
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
- 2026ResidualAuth: What Authorization State Must Language Agents Preserve under Revocable Delegation?cited by 2
- 2026Beyond Corrected Memory: Execution Consistency in Multi-Agent Systemscited by 2
- 2026A Benchmark and Diagnostic Study of Epistemic Admission in Shared Agent Memorycited by 1
- 2026CoMemBench: Benchmarking Collaborative Memory Boundaries across Multi-Agent Workflow Topologiescited by 1
- 2026Whose record is this? Diagnosing and authorizing record use in personalized multimodal modelscited by 0
- 2026Audience-Bound Persistent Memory: Authorization Across the Memory Lifecyclecited by 0
- 2026Knowing the Store: What a Memory Backend Must Write Down Before an Agent Can Read Itcited by 0
- 2026Lineage-Aware Memory Governance: A Derivation-Gated Framework for Privacy-Preserving Column-Level Access Control in Enterprise AI Agentscited by 0
- 2026Beyond Corrected Memory: Execution Consistency in Multi-Agent Systems6 Oct 2026
- 2026The Right Memory in the Wrong Context: Verifying Retrieval Admissibility in Long-Term Agent Memory5 Oct 2026
- 2026Lineage-Aware Memory Governance: A Derivation-Gated Framework for Privacy-Preserving Column-Level Access Control in Enterprise AI Agents5 Oct 2026
- 2026Knowing the Store: What a Memory Backend Must Write Down Before an Agent Can Read It3 Oct 2026
- 2026Audience-Bound Persistent Memory: Authorization Across the Memory Lifecycle28 Sep 2026
- 2026CoMemBench: Benchmarking Collaborative Memory Boundaries across Multi-Agent Workflow Topologies26 Sep 2026
- 2026A Benchmark and Diagnostic Study of Epistemic Admission in Shared Agent Memory25 Sep 2026
- 2026ResidualAuth: What Authorization State Must Language Agents Preserve under Revocable Delegation?8 Sep 2026
- 2026Whose record is this? Diagnosing and authorizing record use in personalized multimodal models4 Sep 2026
- 2026Agent Memory Is a Surface for Endogenous Authorization Laundering1 Sep 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memory27 Jul 2026
1 more
- 2026Self-Improvements in Modern Agentic Systems: A Survey14 Jul 2026
- 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 19
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memorycited by 15
- 2026Agent Memory Is a Surface for Endogenous Authorization Launderingcited by 5
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligencecited by 3
- 2026Beyond Corrected Memory: Execution Consistency in Multi-Agent Systemscited by 2
- 2026Knowing the Store: What a Memory Backend Must Write Down Before an Agent Can Read Itcited by 0
- 2026Lineage-Aware Memory Governance: A Derivation-Gated Framework for Privacy-Preserving Column-Level Access Control in Enterprise AI Agentscited by 0
- 2026Beyond Corrected Memory: Execution Consistency in Multi-Agent Systems6 Oct 2026
- 2026Lineage-Aware Memory Governance: A Derivation-Gated Framework for Privacy-Preserving Column-Level Access Control in Enterprise AI Agents5 Oct 2026
- 2026Knowing the Store: What a Memory Backend Must Write Down Before an Agent Can Read It3 Oct 2026
- 2026Agent Memory Is a Surface for Endogenous Authorization Laundering1 Sep 2026
- 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence21 Aug 2026
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memory27 Jul 2026
- 2026Self-Improvements in Modern Agentic Systems: A Survey14 Jul 2026
- 2026ResidualAuth: What Authorization State Must Language Agents Preserve under Revocable Delegation?cited by 2
- 2026A Benchmark and Diagnostic Study of Epistemic Admission in Shared Agent Memorycited by 1
- 2026CoMemBench: Benchmarking Collaborative Memory Boundaries across Multi-Agent Workflow Topologiescited by 1
- 2026Whose record is this? Diagnosing and authorizing record use in personalized multimodal modelscited by 0
- 2026Audience-Bound Persistent Memory: Authorization Across the Memory Lifecyclecited by 0
- 2026The Right Memory in the Wrong Context: Verifying Retrieval Admissibility in Long-Term Agent Memorycited by 0
- 2026The Right Memory in the Wrong Context: Verifying Retrieval Admissibility in Long-Term Agent Memory5 Oct 2026
- 2026Audience-Bound Persistent Memory: Authorization Across the Memory Lifecycle28 Sep 2026
- 2026CoMemBench: Benchmarking Collaborative Memory Boundaries across Multi-Agent Workflow Topologies26 Sep 2026
- 2026A Benchmark and Diagnostic Study of Epistemic Admission in Shared Agent Memory25 Sep 2026
- 2026ResidualAuth: What Authorization State Must Language Agents Preserve under Revocable Delegation?8 Sep 2026
- 2026Whose record is this? Diagnosing and authorizing record use in personalized multimodal models4 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundary
- 2026DyadMem: A Long-Term Memory Benchmark of How Agents Work with Users
- 2026AIM: A Privacy-Aware Interoperable Memory Framework for Multi-Agent Multi-User LLM Systems
- 2026MemArchitect: A Policy Driven Memory Governance Layer
- 2026Evaluating Memory Structure in LLM Agents
- 2026Governing Evolving Memory in LLM Agents: Risks, Mechanisms, and the Stability and Safety Governed Memory (SSGM) Framework
- 2026PLACEMEM: Toward a Compute-Aware Memory Plane for Lifelong Agents
- 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception