mlsanityData to 7 Oct 2026

Self-evolving Agents with reflective and memory-augmented abilities

arXiv 2409.00872 ↗First posted 1 Sep 2024cs.CLcited by 52

On the map: LLM agents and tool use → Agent memory systems

also in 1 more
Abstract (arXiv)

Large language models (LLMs) have made significant advances in the field of natural language processing, but they still face challenges such as continuous decision-making. In this research, we propose a novel framework by integrating iterative feedback, reflective mechanisms, and a memory optimization mechanism based on the Ebbinghaus forgetting curve, it significantly enhances the agents' capabilities in handling multi-tasking and long-span information.

Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 24 of its 46 references that are in the map. First posted on arXiv 1 Sep 2024.

Builds on

24 of 46 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  6. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  7. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  8. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  9. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  10. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  11. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  12. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
12 more
  1. 2019Compressive Transformers for Long-Range Sequence Modellingcited by 699
  2. 2022Large Language Models Can Self-Improvecited by 656
  3. 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 346
  4. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  5. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
  6. 2019Stochastic Beams and Where to Find Them: The Gumbel-Top-k Trick for Sampling Sequences Without Replacementcited by 205
  7. 2024Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizingcited by 123
  8. 2020MuTual: A Dataset for Multi-Turn Dialogue Reasoningcited by 114
  9. 2023LongCoder: A Long-Range Pre-trained Language Model for Code Completioncited by 110
  10. 2024CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Modelscited by 26
  11. 2024Dense Passage Retrieval: Is it Retrieving?cited by 12
  12. 2023Long-form Question Answering: An Iterative Planning-Retrieval-Generation Approachcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 24; 2026: 27.

52 papers.

Sort:

By area:

  1. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
  2. 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
  3. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  4. 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 119
  5. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 112
  6. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behaviorcited by 95
  7. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
  8. 2025A Survey on the Optimization of Large Language Model-based Agentscited by 45
  9. 2026Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injectionscited by 44
  10. 2025SCORE: Story Coherence and Retrieval Enhancement for AI Narrativescited by 42
  11. 2024AI PERSONA: Towards Life-long Personalization of LLMscited by 30
  12. 2025Learning on the Job: An Experience-Driven Self-Evolving Agent for Long-Horizon Taskscited by 22
38 more
  1. 2026ReCreate: Reasoning and Creating Domain Agents Driven by Experiencecited by 22
  2. 2025Coarse-to-Fine Grounded Memory for LLM Agent Planningcited by 16
  3. 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compressioncited by 12
  4. 2025ForgetMe: Evaluating Selective Forgetting in Generative Modelscited by 11
  5. 2025Alita-G: Self-Evolving Generative Agent for Agent Generationcited by 10
  6. 2025Memory-Augmented Transformers: A Systematic Review from Neuroscience Principles to Enhanced Model Architecturescited by 9
  7. 2025ID-RAG: Identity Retrieval-Augmented Generation for Long-Horizon Persona Coherence in Generative Agentscited by 7
  8. 2026Your Agents Are Aging Too: Agent Lifespan Engineering for Deployed Systemscited by 7
  9. 2026SEARL: Joint Optimization of Policy and Tool Graph Memory for Self-Evolving Agentscited by 6
  10. 2025Meta-Policy Reflexion: Reusable Reflective Memory and Rule Admissibility for Resource-Efficient LLM Agentcited by 5
  11. 2026PathWise: Planning through World Model for Automated Heuristic Design via Self-Evolving LLMscited by 5
  12. 2026ADAM: A Systematic Data Extraction Attack on Agent Memory via Adaptive Queryingcited by 5
  13. 2026From History to State: Constant-Context Skill Learning for LLM Agentscited by 5
  14. 2026Your Code Agent Can Grow Alongside You with Structured Memorycited by 4
  15. 2026AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecyclecited by 4
  16. 2026PreAct: Computer-Using Agents that Get Faster on Repeated Taskscited by 4
  17. 2025CubeBench: Diagnosing Interactive, Long-Horizon Spatial Reasoning Under Partial Observationscited by 3
  18. 2026Time is Not a Label: Continuous Phase Rotation for Temporal Knowledge Graphs and Agentic Memorycited by 3
  19. 2026Swarm Skills: A Portable, Self-Evolving Multi-Agent System Specification for Coordination Engineeringcited by 3
  20. 2026Self-evolving LLM agents with in-distribution Optimizationcited by 3
  21. 2026SKILL.nb: Selective Formalization and Gated Execution for Durable Agent Workflowscited by 3
  22. 2025HASHIRU: Hierarchical Agent System for Hybrid Intelligent Resource Utilizationcited by 2
  23. 2025Beyond Parameters: Exploring Virtual Logic Depth for Scaling Lawscited by 2
  24. 2026Self-evolving Embodied AIcited by 2
  25. 2026PsychAgent: An Experience-Driven Lifelong Learning Agent for Self-Evolving Psychological Counselorcited by 2
  26. 2026Towards Self-Improving Error Diagnosis in Multi-Agent Systemscited by 2
  27. 2026Environment-Grounded Automated Prompt Optimization for LLM Game Agentscited by 2
  28. 2025LoRALib: A Standardized Benchmark for Evaluating LoRA-MoE Methodscited by 1
  29. 2025Multi-dimensional Data Analysis and Applications Basing on LLM Agents and Knowledge Graph Interactionscited by 1
  30. 2026VLM-DEWM: Dynamic External World Model for Verifiable and Resilient Vision-Language Planning in Manufacturingcited by 1
  31. 2026From Threat Intelligence to Firewall Rules: Semantic Relations in Hybrid AI Agent and Expert System Architecturescited by 1
  32. 2026OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillationcited by 1
  33. 2026Evolutionary Intelligence for Scientific Discovery: From Evolutionary Computation to Cumulative Discovery Systemscited by 1
  34. 2026Keep It InMind: Benchmarking the Implicit-Association Blind Spot in Agent Memorycited by 1
  35. 2025Multi-Modal Machine Learning Framework for Predicting Early Recurrence of Brain Tumors Using MRI and Clinical Biomarkerscited by 0
  36. 2025A Multimodal Deep Learning Framework for Early Diagnosis of Liver Cancer via Optimized BiLSTM-AM-VMD Architecturecited by 0
  37. 2025Study on Supply Chain Finance Decision-Making Model and Enterprise Economic Performance Prediction Based on Deep Reinforcement Learningcited by 0
  38. 2026MemReread: Enhancing Agentic Long-Context Reasoning via Memory-Guided Rereadingcited by 0

50 most cited of 52 All 52 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025MARS: Memory-Enhanced Agents with Reflective Self-improvement
  2. 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
  3. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
  4. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
  5. 2026Self-Consolidation for Self-Evolving Agents
  6. 2026AdMem: Advanced Memory for Task-solving Agents
  7. 2024A Survey on the Memory Mechanism of Large Language Model based Agents
  8. 2023Large Language Models Are Semi-Parametric Reinforcement Learning Agents