mlsanityData to 14 Oct 2026

MemCode: Discrete Semantic Representations for Long-Term Agent Memory

arXiv 2610.19472 ↗First posted 14 Oct 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Long-term memory remains a fundamental bottleneck for large language model (LLM) agents across sessions. Existing systems typically adopt a write-then-retrieve paradigm, storing context-dependent dialogue fragments and retrieving them via nearest-neighbor search in a continuous embedding space. This design yields unstable access units and systematically misses logically related but lexically distant evidence. We propose MemCode, a long-term agent memory framework that couples retrieval-oriented writing with discrete associative retrieval. MemCode rewrites dialogue into self-contained atomic memory units (AMUs), maps AMUs into a learnable codebook with isomorphic semantic quantization (ISQ), and uses codebook co-occurrence topology as a retrieval path complementary to vector search. For long-term memory stores, MemCode separates online atomic writes from asynchronous offline consolidation. On LongMemEval-S and LoCoMo with GPT-4o-mini and Qwen3-30B-A3B-Instruct-2507 backbones, MemCode achieves the best overall accuracy while keeping per-dialogue memory construction within roughly 40~130 seconds, making it 3~21 times faster than LightMem and over an order of magnitude faster than A-MEM and MemoryOS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 33 of its 42 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

33 of 42 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Memory OS of AI Agent30 May
  2. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
  3. 2025A-MEM: Agentic Memory for LLM Agents17 Feb
  4. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb

Other references · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  8. 2017Neural Discrete Representation Learningcited by 4,712
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  10. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  11. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  12. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
17 more
  1. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  3. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  4. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  5. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  6. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  7. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 916
  8. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  9. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  10. 2022High Fidelity Neural Audio Compressioncited by 687
  11. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
  12. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
  13. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
  14. 2017End-to-end Neural Coreference Resolutioncited by 241
  15. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
  16. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 180
  17. 2023MEMORY-VQ: Compression for Tractable Internet-Scale Memorycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemFit: Efficient Long-Term Agentic Memory
  2. 2026MemMachine: A Ground-Truth-Preserving Memory System for Personalized AI Agents
  3. 2026MemRefine: LLM-Guided Compression for Long-Term Agent Memory
  4. 2026Beyond Dialogue Time: Temporal Semantic Memory for Personalized LLM Agents
  5. 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents
  6. 2026Mandol: An Agglomerative Agent Memory System for Long-Term Conversations
  7. 2026DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory
  8. 2026MGRetrieval: Memory-Guided Reflective Retrieval for Long-Term Dialogue Agents