D2ACCI: A Dual-Loop Diagnostic Protocol for Evidence-Preserving Agent Memory
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Memory is a key capability of LLM agents. Persistent memory extends this across sessions---enabling recall, revision, and personalization. Yet its multi-stage pipeline (ingestion, retrieval, filtering, generation) makes failures difficult to localize: end-to-end evaluation reveals that an error occurred, but not which stage caused it. Existing evaluations often report aggregate performance without paired statistical comparisons, slice-level non-regression checks, or stage-level diagnostic traces. We propose D2ACCI (Diagnostic-Driven Artifact-based Closed-loop Controlled Iteration), a dual-loop protocol whose outer diagnostic gate promotes, feature-flags, or rejects memory interventions based on paired evidence, protected-slice monitoring, and trace-level localizability. We further introduce DCR, a graded observability metric that measures whether failures remain localizable, and D2ACCI-Eval, a reusable artifact for gate replay. We instantiate the protocol in MemStack and evaluate on three public benchmarks, achieving 93.59% on LoCoMo, 90.93% on LongMemEval, and 57.20% on PersonaMem-V2. Five paired ablations show that supplement extraction, session-memory retrieval, and Forget Guard yield statistically significant gains (+1.9 to +3.7pp, all p ≤ .003). In contrast, BM25/RRF is retained as a monitored feature flag---a distinction invisible to aggregate-only evaluation. A diagnostic audit shows enriched traces substantially improve root-cause agreement over result-only relabeling. Diagnostic artifacts reach 98--100% DCR@3 versus 0% for results-only logs. These results establish that robust memory-system iteration demands traceable, statistically grounded, and regression-aware evidence---exactly the gap D2ACCI fills.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 15 of its 36 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
15 of 36 references.
Closest ancestors · 5
Same direction, newest first
- 2026MemMachine: A Ground-Truth-Preserving Memory System for Personalized AI Agents6 Apr
- 2026Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoning13 Feb
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agents2 Feb
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memory20 Jan
Other references · 10
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 129
- 2026EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoningcited by 54
- 2026Explore with Long-term Memory: A Benchmark and Multimodal LLM-based Reinforcement Learning Framework for Embodied Explorationcited by 13
- 2026Mem2Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillationcited by 12
- 2026Do Self-Evolving Agents Forget? Capability Degradation and Preservation in Lifelong LLM Agent Adaptationcited by 6
- 2026From Passive Retrieval to Active Memory Navigation: Learning to Use Memory as a Structured Action Spacecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance
- 2026EvalMem: An Operation-Level Diagnostic Framework for Long-Term Memory Systems
- 2026Stop When Memory Suffices: Evidence-Conditioned Progressive Execution for LLM Agents
- 2026MemSecBench: Tracking Agent Memory Poisoning from Persistence to Consequence and Repair
- 2026When Correct Memory Goes Wrong: Fuzzing Persistent Memory Use in LLM Agents
- 2026MemRiskBench: Trace-Aware Risk-Preserving Evaluation for Long-Horizon LLM Agents
- 2026MemTX: Transactional Belief Commit for Stateful Agent Memory
- 2026Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agents