mlsanityData to 14 Oct 2026

Principles that Guide, Actions that Inform: Agent Evolution via Knowledge Abstraction

arXiv 2610.06964 ↗First posted 3 Oct 2026cs.AI cs.LGcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Reinforcement learning for LLM agents

Abstract (arXiv)

Large language model (LLM) agents have demonstrated strong capabilities in interactive environments, yet their ability to continually evolve from experience remains limited. Although fine-tuning enables adaptation, its dependence on parameter access and high computational costs restrict its flexibility, especially for large-scale and closed-source LLMs. External memory offers an alternative by allowing agents to accumulate experience without modifying model parameters. However, existing methods mainly focus on experience representation and organization, while the acquired knowledge remains tightly coupled with specific tasks and contexts, limiting generalization. A key challenge is how to transform concrete interactions into abstract and reusable knowledge that guides future decisions beyond individual experiences. To address this challenge, we propose SAGA (underlineSelf-evolving underlineAgents through Experience-underlineGrounded underlineAbstraction), a framework for experience-grounded knowledge abstraction and utilization in LLM agents. SAGA progressively transforms interaction trajectories into episodic descriptions, reusable procedures, and principles with explicit applicability conditions, while maintaining links to execution evidence. Retrieved principles are instantiated into task-specific guidance and used to refine candidate actions through corrective feedback and resampling. This creates an execution--abstraction feedback loop, where accumulated knowledge guides future interactions and new experiences continuously update hierarchical memory. Experiments on ScienceWorld and ALFWorld demonstrate improved task performance, with ablation studies highlighting the importance of contextual instantiation and action regulation for leveraging principle-level knowledge.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 30 references that are in the map. First posted on arXiv 3 Oct 2026.

Builds on

28 of 30 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Evolving-RL: End-to-End Optimization of Experience-Driven Self-Evolving Capability within Agents11 May
  2. 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning25 May
  3. 2024AutoGuide: Automated Generation and Selection of Context-Aware Guidelines for Large Language Model Agents13 Mar
  4. 2023ExpeL: LLM Agents Are Experiential Learners20 Aug

Other references · 24

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  7. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  8. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  9. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  10. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  11. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  12. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
12 more
  1. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 400
  2. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
  3. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
  4. 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 284
  5. 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
  6. 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 129
  7. 2025Memento: Fine-tuning LLM Agents without Fine-tuning LLMscited by 127
  8. 2025Remember Me, Refine Me: A Dynamic Procedural Memory Framework for Experience-Driven Agent Evolutioncited by 73
  9. 2024Towards Lifelong Learning of Large Language Models: A Surveycited by 64
  10. 2026Experience Compression Spectrum: Unifying Memory, Skills, and Rules in LLM Agentscited by 17
  11. 2026StraTA: Incentivizing Agentic Reinforcement Learning with Strategic Trajectory Abstractioncited by 4
  12. 2026CoEvo-Mem: Co-Evolving Retrieval Policy and Memory Bank for LLM Agentscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents
  2. 2026Unified Context Evolution for LLM Agents
  3. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
  4. 2025MemEvolve: Meta-Evolution of Agent Memory Systems
  5. 2026MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution
  6. 2025Learn as Individuals, Evolve as a Team: Multi-agent LLMs Adaptation in Embodied Environments
  7. 2026OdysseyArena: Benchmarking Large Language Models For Long-Horizon, Active and Inductive Interactions
  8. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering