mlsanityData to 14 Oct 2026

Knowledge-Centric Self-Improvement

arXiv 2607.19592 ↗First posted 21 Jul 2026cs.AI cs.CL cs.LGcited by 2

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

Self-improving AI systems typically treat the agent as the object that improves, by optimizing prompts, workflows, harnesses, or even the agent's own code. This agent-centric view can make improvements expensive to maintain and difficult to transfer, because gains become tied to a particular agent design, task distribution, or adaptation run. We study a complementary paradigm: knowledge-centric self-improvement, in which agents remain generic and disposable while the persistent object is a curated knowledge base that agents can leverage for future tasks. We conduct controlled case studies to operationalize this idea via a simple protocol. Agents attempt one task, then contribute evidence-grounded insights to a shared knowledge base via task-level and cross-task forums, followed by knowledge distillation. Because self-improvement is contained in the knowledge rather than the agent, improvement can be more inspectable, transferable, and portable. Across abstract reasoning, coding, and terminal benchmarks, this protocol improves solve rates while reducing dollar cost relative to agent-centric baselines. The resulting distilled knowledge also transfers to held-out tasks and across LLM families, indicating that the improvement is not merely an LLM- or run-specific behavior. These results support a new view of self-improving agentic systems: progress can be driven primarily by the curated persistent knowledge. Code is available at https://github.com/recursive-knowledge/KSI.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 42 of its 68 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

42 of 68 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
  2. 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine24 Oct
  3. 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle17 Oct
  4. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models6 Oct
  5. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents29 May
  6. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvement12 Feb

Other references · 36

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  5. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  6. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  7. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  8. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  9. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  10. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 867
  11. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  12. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
24 more
  1. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  2. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  3. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  4. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  5. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
  6. 2024Automated Design of Agentic Systemscited by 407
  7. 2024Agent Workflow Memorycited by 383
  8. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  9. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  10. 2024Evolutionary Optimization of Model Merging Recipescited by 208
  11. 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 192
  12. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 129
  13. 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
  14. 2025Memp: Exploring Agent Procedural Memorycited by 103
  15. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 95
  16. 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 94
  17. 2024Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Modelscited by 91
  18. 2024AutoGuide: Automated Generation and Selection of Context-Aware Guidelines for Large Language Model Agentscited by 74
  19. 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
  20. 2025CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimizationcited by 44
  21. 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaborationcited by 28
  22. 2025Nature-Inspired Population-Based Evolution of Large Language Modelscited by 15
  23. 2025Evolving Prompts In-Context: An Open-ended, Self-replicating Perspectivecited by 8
  24. 2026ARC-AGI-2 Technical Reportcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agent Plasticity: Measuring Self-Improvement Through Experience
  2. 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops
  3. 2026Recursive self-improvement of AI research agents
  4. 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
  5. 2026Self-Improvements in Modern Agentic Systems: A Survey
  6. 2026Hierarchical Self-Improvement: A Framework for Task-Specific Evolvable Agent Harnesses
  7. 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness
  8. 2026RSIGym: A Flexible Environment for Recursive Self-Improvement