ConsistencyGate: Preventing Memory Contamination in LLM Agents via Self-Consistency Admission Control
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
LLM agents that operate over many turns accumulate facts in an external memory store and reuse them as premises for downstream reasoning. A hallucinated fact written at one step therefore persists as a false premise for every subsequent step, a failure mode we call memory contamination. Existing memory management addresses retrieval and capacity but not write-time correctness; this admission problem cannot be solved by utility- or recency-based criteria, and uncontrolled contamination compounds across long trajectories. We propose ConsistencyGate, a write-time admission gate that, before committing a candidate fact m extracted from context c, queries the LLM K times for a soft support score and admits m only when the average exceeds a threshold. The mechanism is model-agnostic, requires no fine-tuning, and reduces to a single forward pass in a log-probability variant for latency-sensitive deployments. To measure the effect on natural data, we construct two real-conversation benchmarks (LoCoMo-Contam and MSC-Contam) by planting controlled single-detail corruptions in long-term conversations from LoCoMo and MSC, and complement them with a structured synthetic corpus (MemContam) that isolates a near-oracle upper bound. Across four LLM backbones, ConsistencyGate reduces contamination on every benchmark relative to a write-everything baseline, with the cost concentrated on facts that are stated only implicitly in the source context. We release all three benchmarks together with the gate implementation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 24 of its 28 references that are in the map. First posted on arXiv 25 Jul 2026.
Builds on
24 of 28 references.
References · 24
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
12 more
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2024Corrective Retrieval Augmented Generationcited by 187
- 2023ChatDB: Augmenting LLMs with Databases as Their Symbolic Memorycited by 136
- 2023Agents: An Open-source Framework for Autonomous Language Agentscited by 116
- 2026Adaptive Memory Admission Control for LLM Agentscited by 19
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Stored Is Not Supported: Typed Provenance and Assertion Guardrails for Persistent AI Agentscited by 0
- 2026A Benchmark and Diagnostic Study of Epistemic Admission in Shared Agent Memorycited by 0
- 2026Memory Is a Derivation: The Distributed-Evidence Paradox in Long-Term Agentscited by 0
- 2026EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignmentcited by 0
- 2026EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignment29 Sep 2026
- 2026Memory Is a Derivation: The Distributed-Evidence Paradox in Long-Term Agents28 Sep 2026
- 2026A Benchmark and Diagnostic Study of Epistemic Admission in Shared Agent Memory25 Sep 2026
- 2026Stored Is Not Supported: Typed Provenance and Assertion Guardrails for Persistent AI Agents2 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?
- 2026Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings
- 2026A-TMA: Decoupling State-Aware Memory Failures in Long-Term Agent Memory
- 2026Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents
- 2026Persistent Memory in Multi-Agent LLM Inference: What It Costs, What It Buys, and When You Can Tell
- 2026Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full History
- 2026Multi-Agent Debate with Memory Masking
- 2026APDMem: Agent-Controlled Progressive Disclosure for Query-Adaptive Long-Term Memory