mlsanityData to 14 Oct 2026

MemOS: A Memory OS for AI System

arXiv 2507.03724 ↗First posted 4 Jul 2025cs.CLcited by 138

On the map: Retrieval-augmented generation → Generation and context integration

Abstract (arXiv)

Large Language Models (LLMs) have become an essential infrastructure for Artificial General Intelligence (AGI), yet their lack of well-defined memory management systems hinders the development of long-context reasoning, continual personalization, and knowledge consistency.Existing models mainly rely on static parameters and short-lived contextual states, limiting their ability to track user preferences or update knowledge over extended periods.While Retrieval-Augmented Generation (RAG) introduces external knowledge in plain text, it remains a stateless workaround without lifecycle control or integration with persistent representations.Recent work has modeled the training and inference cost of LLMs from a memory hierarchy perspective, showing that introducing an explicit memory layer between parameter memory and external retrieval can substantially reduce these costs by externalizing specific knowledge. Beyond computational efficiency, LLMs face broader challenges arising from how information is distributed over time and context, requiring systems capable of managing heterogeneous knowledge spanning different temporal scales and sources. To address this challenge, we propose MemOS, a memory operating system that treats memory as a manageable system resource. It unifies the representation, scheduling, and evolution of plaintext, activation-based, and parameter-level memories, enabling cost-efficient storage and retrieval. As the basic unit, a MemCube encapsulates both memory content and metadata such as provenance and versioning. MemCubes can be composed, migrated, and fused over time, enabling flexible transitions between memory types and bridging retrieval with parameter-based learning. MemOS establishes a memory-centric system framework that brings controllability, plasticity, and evolvability to LLMs, laying the foundation for continual learning and personalized modeling.

Key facts. Cited by 138 papers in the map (data through 14 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 82 of its 99 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

82 of 99 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Models20 Feb
  2. 2024Memory3: Language Modeling with Explicit Memory1 Jul
  3. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models23 May

Other references · 79

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  8. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  9. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  10. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  11. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  12. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
38 more
  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  3. 2023A Survey of Large Language Modelscited by 2,576
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  5. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  6. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  7. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  8. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  9. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  10. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  11. 2022Mass-Editing Memory in a Transformercited by 1,001
  12. 2023Steering Language Models With Activation Engineeringcited by 922
  13. 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
  14. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  15. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 800
  16. 2023Large Language Modelscited by 780
  17. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  18. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
  19. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  20. 2024KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantizationcited by 591
  21. 2021Editing Factual Knowledge in Language Modelscited by 553
  22. 2024Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inferencecited by 501
  23. 2021Fast Model Editing at Scalecited by 498
  24. 2022Memory-Based Model Editing at Scalecited by 447
  25. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 400
  26. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 372
  27. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 354
  28. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 333
  29. 2024Titans: Learning to Memorize at Test Timecited by 328
  30. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  31. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 271
  32. 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 246
  33. 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 245
  34. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
  35. 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 225
  36. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
  37. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
  38. 2024Improving Instruction-Following in Language Models through Activation Steeringcited by 160

50 most cited of 79 All 79 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 23; 2026: 115.

138 papers.

Sort:

By area:

  1. 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 141
  2. 2025Memp: Exploring Agent Procedural Memorycited by 103
  3. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
  4. 2025HaluMem: Evaluating Hallucinations in Memory Systems of Agentscited by 54
  5. 2026EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoningcited by 54
  6. 2026MAGMA: A Multi-Graph based Agentic Memory Architecture for AI Agentscited by 52
  7. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 50
  8. 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
  9. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 44
  10. 2025Look Back to Reason Forward: Revisitable Memory for Long-Context LLM Agentscited by 38
  11. 2025O-Mem: Omni Memory System for Personalized, Long Horizon, Self-Evolving Agentscited by 32
  12. 2025LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarioscited by 26
38 more
  1. 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scalingcited by 23
  2. 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 19
  3. 2025Sculptor: Empowering LLMs with Cognitive Agency via Active Context Managementcited by 18
  4. 2025Context Engineering 2.0: The Context of Context Engineeringcited by 18
  5. 2025From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memorycited by 17
  6. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspectivecited by 17
  7. 2026Toward Efficient Agents: Memory, Tool learning, and Planningcited by 16
  8. 2026MemMachine: A Ground-Truth-Preserving Memory System for Personalized AI Agentscited by 16
  9. 2025PaperArena: An Evaluation Benchmark for Tool-Augmented Agentic Reasoning on Scientific Literaturecited by 15
  10. 2025ENGRAM: Effective, Lightweight Memory Orchestration for Conversational Agentscited by 15
  11. 2026AtomMem : Learnable Dynamic Agentic Memory with Atomic Memory Operationcited by 15
  12. 2026MemOCR: Layout-Aware Visual Memory for Efficient Long-Horizon Reasoningcited by 15
  13. 2025TeleMem: Building Long-Term and Multimodal Memory for Agentic AIcited by 14
  14. 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 14
  15. 2026PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environmentscited by 14
  16. 2026Evaluating Memory Structure in LLM Agentscited by 12
  17. 2026Beyond Similarity: Trustworthy Memory Search for Personal AI Agentscited by 12
  18. 2026Choosing How to Remember: Adaptive Memory Structures for LLM Agentscited by 11
  19. 2026PersonaVLM: Long-Term Personalized Multimodal LLMscited by 11
  20. 2026Belief Memory: Agent Memory Under Partial Observabilitycited by 11
  21. 2026AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignmentcited by 10
  22. 2026Auto-Dreamer: Learning Offline Memory Consolidation for Language Agentscited by 10
  23. 2025MemWeaver: A Hierarchical Memory from Textual Interactive Behaviors for Personalized Generationcited by 9
  24. 2026StreamMeCo: Long-Term Agent Memory Compression for Efficient Streaming Video Understandingcited by 9
  25. 2026Mnemis: Dual-Route Retrieval on Hierarchical Graphs for Long-Term LLM Memorycited by 8
  26. 2025RGMem: Renormalization Group-inspired Memory Evolution for Language Agentscited by 7
  27. 2026When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agentscited by 7
  28. 2026Safety in Embodied AI: A Survey of Risks, Attacks, and Defensescited by 7
  29. 2026MemReranker: Reasoning-Aware Reranking for Agent Memory Retrievalcited by 7
  30. 2026MemPrivacy: Privacy-Preserving Personalized Memory Management for Edge-Cloud Agentscited by 7
  31. 2026Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agentscited by 7
  32. 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversationscited by 7
  33. 2026Metis: Memory Foundation Modelcited by 7
  34. 2025Meta-R1: Empowering Large Reasoning Models with Metacognitioncited by 6
  35. 2025Automating Structural Engineering Workflows with Large Language Model Agentscited by 6
  36. 2025The Cognitive Bandwidth Bottleneck: Shifting Long-Horizon Agent from Planning with Actions to Planning with Schemascited by 5
  37. 2025Smarter Together: Creating Agentic Communities of Practice through Shared Experiential Learningcited by 5
  38. 2026Agentic Recommender System with Hierarchical Belief-State Memorycited by 5

50 most cited of 138 All 138 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models
  2. 2024AI-native Memory: A Pathway from LLMs Towards AGI
  3. 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentation
  4. 2026Continuum Memory Architectures for Long-Horizon LLM Agents
  5. 2026TA-Mem: Tool-Augmented Autonomous Memory Retrieval for LLM in Long-Term Conversational QA
  6. 2025REIS: A High-Performance and Energy-Efficient Retrieval System with In-Storage Processing
  7. 2025Tuning LLMs by RAG Principles: Towards LLM-native Memory
  8. 2026Chain-of-Memory: Lightweight Memory Construction with Dynamic Evolution for LLM Agents