Mnemon: Raw Records, Fast Judgments, Slow Thoughts
On the map: LLM reasoning → Reasoning benchmarks and evaluation also fits: Test-time compute and efficient thinking
Abstract (arXiv)
Long-term memory lets an LLM assistant use a history it can no longer reread, and most memory systems build it by rewriting conversations into facts, graphs or typed memories at write time. We argue that the work of memory divides, as thinking does, into two systems. Most of it is fast System 1 work: many small, independent yes/no judgments about records, such as whether a record is needed or no longer current, which a decision model makes by the dozen in a third of a second. Only a little is slow System 2 work: writing a few search queries, naming what the reply needs and composing the answer, which an LLM does well but slowly. We present Mnemon, a memory agent built on this division. It keeps conversations as raw, dated records; an LLM (System 2) plans searches over them, a decision model, Jev (System 1), judges what the searches return, and rules with explicit budgets turn the judgments into a small View for an unchanged answering model. A background pass consolidates each record once into topic timelines, value histories and standing instructions linked to the records, so that questions about a whole conversation reach evidence their own searches miss. Because nothing is decided about a record when it is written, the same agent can read any store that returns dated records. With gpt-4.1-mini answering, as in a public re-evaluation of 14 systems, Mnemon scores 91.7% on LoCoMo, the highest among them, and 83.8% on LongMemEval-S, from under 4k tokens of context per question, with the lowest effective cost index on LoCoMo. With a reasoning model answering, it reaches 92.2% on LoCoMo and 94.4% on LongMemEval-S, the latter on par with the best published results. From 100K to 10M tokens of history on BEAM, its cost per question grows by a factor of 1.11. On the same records, Jev separates gold evidence better than two LLMs and is 3-11 times faster.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 40 of its 60 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
40 of 60 references.
Closest ancestors · 1
Same direction, newest first
Other references · 39
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2019Passage Re-ranking with BERTcited by 645
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 400
27 more
- 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 360
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 265
- 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 180
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 173
- 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Taskscited by 168
- 2025Memory OS of AI Agentcited by 150
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 149
- 2025MemOS: A Memory OS for AI Systemcited by 138
- 2020Thinking Fast and Slow in AIcited by 70
- 2025Beyond a Million Tokens: Benchmarking and Enhancing Long-Term Memory in LLMscited by 60
- 2025HaluMem: Evaluating Hallucinations in Memory Systems of Agentscited by 54
- 2026EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoningcited by 54
- 2025Hindsight is 20/20: Building Agent Memory that Retains, Recalls, and Reflectscited by 44
- 2025A Simple Yet Strong Baseline for Long-Term Conversational Memory of LLM Agentscited by 21
- 2025Pre-Storage Reasoning for Episodic Memory: Shifting Inference Burden to Memory for Personalized Dialoguecited by 18
- 2026MemMachine: A Ground-Truth-Preserving Memory System for Personalized AI Agentscited by 16
- 2026Jev-Mem: System-One-Controlled Agentic Memory for Efficient AI Agentscited by 14
- 2026Memori: A Persistent Memory Layer for Efficient, Context-Aware LLM Agentscited by 12
- 2026SwiftMem: Fast Agentic Memory via Query-aware Indexingcited by 5
- 2026SmartSearch: How Ranking Beats Structure for Conversational Memory Retrievalcited by 5
- 2026D-Mem: A Dual-Process Memory System for LLM Agentscited by 5
- 2026HyMem: Hybrid Memory Architecture with Dynamic Retrieval Schedulingcited by 4
- 2026H-Mem: A Novel Memory Mechanism for Evolving and Retrieving Agent Memory via a Hybrid Structurecited by 4
- 2026LeanMem: Simple and Efficient Long-Term Memory for LLM Agentscited by 4
- 2026Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full Historycited by 3
- 2026LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidationcited by 3
- 2026Memory Beyond Recall: A Dual-Process Cognitive Memory System for Self-Evolving LLM Agentscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026JevGPT: Thinking Fast and Slow in Autonomous Researchcited by 0
- 2026Jev-ToM: Evaluating Theory of Mind in Typed Decision Modelscited by 0
- 2026Jev-ToM: Evaluating Theory of Mind in Typed Decision Models13 Oct 2026
- 2026JevGPT: Thinking Fast and Slow in Autonomous Research13 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating Memory Structure in LLM Agents
- 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
- 2024On the Structural Memory of LLM Agents
- 2026Can Agents Forget When Asked? A Benchmark for Memory Unlearning in LLM Agents
- 2025Memory in Large Language Models: Mechanisms, Evaluation and Evolution
- 2026APDMem: Agent-Controlled Progressive Disclosure for Query-Adaptive Long-Term Memory
- 2026REAL: A Reasoning-Enhanced Graph Framework for Long-Term Memory Management of LLMs