An Interpretable Memory Decision Controller for LLM Agents Based on Three-Signal Complementarity: Decoupling Confidence and Consistency
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Memory systems for large language models have focused predominantly on efficient retrieval, whereas the decision of whether retrieved memories should be trusted has received comparatively little attention. When the memory store contains conflicting positions, standard retrieval-augmented generation (RAG) blindly injects memories and amplifies hallucinations: in models susceptible to memory injection, the RAG hallucination rate under conflicting memories is markedly higher than that of a memory-free baseline. Inspired by memory signaling mechanisms in the prefrontal cortex, we propose the Memory Decision Layer (MDL), a zero-parameter memory decision controller situated between the retrieval and generation stages. Its core is a three-signal complementary encoder that fuses relevance, reliability, and task risk through QR-based orthogonal subspace projection and a meta-working-memory signal into an interpretable decision representation that quantifies the trustworthiness of retrieved memories. Building on this encoder, MDL explicitly decouples confidence from consistency and introduces risk inversion and explicit abstention. Evaluations on mainstream large language models and multiple open-source datasets show that MDL reduces the hallucination rate under conflicting memories by about 56.04% in general scenarios and approaches zero hallucination in high-risk scenarios. The controller is fully white-box: it relies purely on geometric operations, requires no trained parameters, and adds only about 0.14 ms per decision -- roughly 50x faster than the embedding-retrieval step that precedes it and four to five orders of magnitude faster than an LLM self-evaluation call.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 26 of its 31 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
26 of 31 references.
Closest ancestors · 2
Same direction, newest first
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
Other references · 24
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
12 more
- 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
- 2024Knowledge Conflicts for LLMs: A Surveycited by 274
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
- 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 272
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
- 2024Corrective Retrieval Augmented Generationcited by 187
- 2023How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questionscited by 82
- 2024ConflictBank: A Benchmark for Evaluating the Influence of Knowledge Conflicts in LLMcited by 73
- 2024Larimar: Large Language Models with Episodic Memory Controlcited by 53
- 2024RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedbackcited by 46
- 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correctioncited by 42
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Decoding Memories: An Efficient Pipeline for Self-Consistency Hallucination Detection
- 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
- 2025Train for Truth, Keep the Skills: Binary Retrieval-Augmented Reward Mitigates Hallucinations
- 2025Thinking, Faithful and Stable: Mitigating Hallucinations in LLMs
- 2026MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucination
- 2026MemGuard: Preventing Memory Contamination in Long-Term Memory-Augmented Large Language Models
- 2026Alleviating Hallucination in Reasoning Tasks with Training-Free Uncertainty-Guided Steering
- 2024RAGged Edges: The Double-Edged Sword of Retrieval-Augmented Chatbots