mlsanityData to 7 Oct 2026

SCM: Enhancing Large Language Model with Self-Controlled Memory Framework

arXiv 2304.13343 ↗First posted 26 Apr 2023cs.CLcited by 98

Not on the map. Why?

Cited by 61 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Large Language Models (LLMs) are constrained by their inability to process lengthy inputs, resulting in the loss of critical historical information. To address this limitation, in this paper, we propose the Self-Controlled Memory (SCM) framework to enhance the ability of LLMs to maintain long-term memory and recall relevant information. Our SCM framework comprises three key components: an LLM-based agent serving as the backbone of the framework, a memory stream storing agent memories, and a memory controller updating memories and determining when and how to utilize memories from memory stream. Additionally, the proposed SCM is able to process ultra-long texts without any modification or fine-tuning, which can integrate with any instruction following LLMs in a plug-and-play paradigm. Furthermore, we annotate a dataset to evaluate the effectiveness of SCM for handling lengthy inputs. The annotated dataset covers three tasks: long-term dialogues, book summarization, and meeting summarization. Experimental results demonstrate that our method achieves better retrieval recall and generates more informative responses compared to competitive baselines in long-term dialogues. (https://github.com/wbbeyourself/SCM4LLMs)

Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 26 Apr 2023.

Builds on

22 of 39 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2017Proximal Policy Optimization Algorithmscited by 14,441
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  9. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  10. 2020Longformer: The Long-Document Transformercited by 3,362
  11. 2020Learning to summarize from human feedbackcited by 2,562
  12. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
10 more
  1. 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
  2. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,085
  3. 2021Recursively Summarizing Books with Human Feedbackcited by 287
  4. 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
  5. 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 64
  6. 2022Investigating Efficiently Extending Transformers for Long Input Summarizationcited by 43
  7. 2021Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Taskcited by 34
  8. 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbationcited by 28
  9. 2022HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarizationcited by 22
  10. 2023HanoiT: Enhancing Context-aware Translation via Selective Contextcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 11; 2025: 38; 2026: 44.

98 papers.

Sort:

By area:

  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  3. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  4. 2025Memory in the Age of AI Agentscited by 285
  5. 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Modelscited by 232
  6. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 163
  7. 2025Memory OS of AI Agentcited by 140
  8. 2026SimpleMem: Efficient Lifelong Memory for LLM Agentscited by 140
  9. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  10. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  11. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  12. 2024A Survey on Large Language Model-Based Game Agentscited by 106
38 more
  1. 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
  2. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
  3. 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agentscited by 82
  4. 2024LV-Eval: A Balanced Long-Context Benchmark with 5 Length Levels Up to 256Kcited by 80
  5. 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memorycited by 64
  6. 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agentscited by 60
  7. 2025Mem-α: Learning Memory Construction via Reinforcement Learningcited by 49
  8. 2025Context as a Tool: Context Management for Long-Horizon SWE-Agentscited by 38
  9. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topicscited by 36
  10. 2024MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memorycited by 35
  11. 2025Position: Episodic Memory is the Missing Piece for Long-Term LLM Agentscited by 35
  12. 2024The What, Why, and How of Context Length Extension Techniques in Large Language Models -- A Detailed Surveycited by 32
  13. 2026Mem2ActBench: A Benchmark for Evaluating Long-Term Memory Utilization in Task-Oriented Autonomous Agentscited by 30
  14. 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memorycited by 27
  15. 2024Emotional RAG: Enhancing Role-Playing Agents through Emotional Retrievalcited by 26
  16. 2025TReMu: Towards Neuro-Symbolic Temporal Reasoning for LLM-Agents with Memory in Multi-Session Dialoguescited by 25
  17. 2025Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Frameworkcited by 25
  18. 2025CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehensioncited by 23
  19. 2025Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit Reasoningcited by 21
  20. 2024IDEA: Enhancing the Rule Learning Ability of Large Language Model Agent through Induction, Deduction, and Abductioncited by 20
  21. 2025Preference-Aware Memory Update for Long-Term LLM Agentscited by 19
  22. 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skillscited by 19
  23. 2025MemEngine: A Unified and Modular Library for Developing Advanced Memory of LLM-based Agentscited by 17
  24. 2025MemR3: Memory Retrieval via Reflective Reasoning for LLM Agentscited by 17
  25. 2026Self-Improvements in Modern Agentic Systems: A Surveycited by 17
  26. 2026Learning Personalized Agents from Human Feedbackcited by 16
  27. 2026From Lossy to Verified: A Provenance-Aware Tiered Memory for Agentscited by 16
  28. 2025MemoTime: Memory-Augmented Temporal Knowledge Graph Enhanced Large Language Model Reasoningcited by 14
  29. 2024Towards LifeSpan Cognitive Systemscited by 13
  30. 2026MemBuilder: Reinforcing LLMs for Long-Term Memory Construction via Attributed Dense Rewardscited by 13
  31. 2026AtomMem : Learnable Dynamic Agentic Memory with Atomic Memory Operationcited by 13
  32. 2026AdaMem: Adaptive User-Centric Memory for Long-Horizon Dialogue Agentscited by 11
  33. 2026EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agentscited by 11
  34. 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactionscited by 11
  35. 2025LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systemscited by 10
  36. 2026PrivGemo: Privacy-Preserving Dual-Tower Graph Retrieval for Empowering LLM Reasoning with Memory Augmentationcited by 9
  37. 2025CarMem: Enhancing Long-Term Memory in LLM Voice Assistants through Category-Boundingcited by 8
  38. 2026Fine-Mem: Fine-Grained Feedback Alignment for Long-Horizon Memory Managementcited by 8

50 most cited of 98 All 98 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024On the Structural Memory of LLM Agents
  2. 2026MemFit: Efficient Long-Term Agentic Memory
  3. 2026Lightweight LLM Agent Memory with Small Language Models
  4. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
  5. 2025Memory in Large Language Models: Mechanisms, Evaluation and Evolution
  6. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
  7. 2026MemRefine: LLM-Guided Compression for Long-Term Agent Memory
  8. 2026Talking to Yourself: Defying Forgetting in Large Language Models