SkillMentor: LLM Agent Self-Evolution via Learning Blind-Spot Diagnosis
On the map: LLM agents and tool use → Agent skill learning and evolution
Abstract (arXiv)
Agent self-evolution has primarily focused on learning how to act, while overlooking an equally important capability: learning to discover what an agent does not know. Existing approaches typically assume that failure discovery is given, focusing on how to repair failures once they are identified. We ask whether blind-spot diagnosis itself can be learned. We thus study diagnosis as an agent capability separate from execution, and exclude two alternative sources of progress: executor adaptation and human supervision. Under these constraints, performance cannot improve through executor updates or annotated examples, forcing all improvements to originate from the learned diagnostic capability. We propose SkillMentor, which trains a Mentor policy via reinforcement learning to generate diagnostic tasks, identify recurrent failure modes, and curate them into reusable corrective skills. Across AppWorld and BFCLv3, SkillMentor improves executor performance by an average of 44.2%. These results suggest that blind-spot diagnosis is a learnable capability, enabling self-evolution without updating executor weights or relying on human-curated data.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 27 of its 29 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
27 of 29 references.
Closest ancestors · 9
Same direction, newest first
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skills22 May
- 2026SkillOS: Learning Skill Curation for Self-Evolving Agents7 May
- 2026SKILL0: In-Context Agentic Reinforcement Learning for Skill Internalization2 Apr
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verification2 Apr
- 2026Dynamic Dual-Granularity Skill Bank for Agentic RL30 Mar
- 2026ARISE: Agent Reasoning with Intrinsic Skill Evolution in Hierarchical Reinforcement Learning17 Mar
- 2026EvoSkill: Automated Skill Discovery for Multi-Agent Systems3 Mar
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning9 Feb
- 2025Reinforcement Learning for Self-Improving Agent with Skill Library18 Dec
Other references · 18
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 177
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
- 2025Alita: Generalist Agent Enabling Scalable Agentic Reasoning with Minimal Predefinition and Maximal Self-Evolutioncited by 114
- 2026MemRL: Self-Evolving Agents via Runtime Reinforcement Learning on Episodic Memorycited by 113
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 105
- 2025AgentEvolver: Towards Efficient Self-Evolving Agent Systemcited by 77
6 more
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Taskscited by 72
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
- 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 48
- 2024StreamBench: Towards Benchmarking Continuous Improvement of Language Agentscited by 44
- 2026Tool-R0: Self-Evolving LLM Agents for Tool-Learning from Zero Datacited by 31
- 2026Learning to Build the Environment: Self-Evolving Reasoning RL via Verifiable Environment Synthesiscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026BenchTrace: A Benchmark for Testing Reflection Ability and Controlled Evolution in LLM Agents
- 2026SkillHEX: Improving Agent Skills via Hypothesis-Driven Autonomous Exploration and Exploitation
- 2026EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer
- 2026SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent
- 2026VERSE: Verified Self-Evolving Optimizer for Agent Harnesses
- 2026ANCHOR: An External LLM-Driven Supervisory Module Facilitating Healthy Evolution in Self-Evolving Systems
- 2026SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time