mlsanityData to 14 Oct 2026

ATANT: An Evaluation Framework for AI Continuity

arXiv 2604.06710 ↗First posted 8 Apr 2026cs.AI cs.IRcited by 3

Not on the map. Why?

Abstract (arXiv)

We present ATANT (Automated Test for Acceptance of Narrative Truth), an open evaluation framework for measuring continuity in AI systems: the ability to persist, update, disambiguate, and reconstruct meaningful context across time. While the AI industry has produced memory components (RAG pipelines, vector databases, long context windows, profile layers), no published framework formally defines or measures whether these components produce genuine continuity. We define continuity as a system property with 7 required properties, introduce a 10-checkpoint evaluation methodology that operates without an LLM in the evaluation loop, and present a narrative test corpus of 250 stories comprising 1,835 verification questions across 6 life domains. We evaluate a reference implementation across 5 test suite iterations, progressing from 58% (legacy architecture) to 100% in isolated mode (250 stories) and 100% in 50-story cumulative mode, with 96% at 250-story cumulative scale. The cumulative result is the primary measure: when 250 distinct life narratives coexist in the same database, the system must retrieve the correct fact for the correct context without cross-contamination. ATANT is system-agnostic, model-independent, and designed as a sequenced methodology for building and validating continuity systems. The framework specification, example stories, and evaluation protocol are available at https://github.com/Kenotic-Labs/ATANT. The full 250-story corpus will be released incrementally.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 7 of its 7 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

7 of 7 references.

References · 7

  1. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  2. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  3. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  4. 2025MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systemscited by 61
  5. 2025Beyond a Million Tokens: Benchmarking and Enhancing Long-Term Memory in LLMscited by 60
  6. 2025The Narrative Continuity Test: A Conceptual Framework for Evaluating Identity Persistence in AI Systemscited by 3
  7. 2026Continuum Memory Architectures for Long-Horizon LLM Agentscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?
  2. 2026Eywa: Provenance-Grounded Long-Term Memory for AI Agents
  3. 2026EVAR: Evidence-Validated Hypothesis Admission for Budget-Aware Narrative Reasoning
  4. 2026Can LLM Agents Stick to the Script? A Benchmark for Long-Horizon Consistency in Interactive Narratives
  5. 2026AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications
  6. 2026Narrative World Model: Narratology-Grounded Writer Memory for Long-Form Fiction
  7. 2026Intermediate Artifacts as First-Class Citizens: A Data Model for Durable Intermediate Artifacts in Agentic Systems
  8. 2026The Missing Knowledge Layer in Cognitive Architectures for AI Agents