mlsanityData to 7 Oct 2026

SkillOpt-Lite: Better and Faster Agent Self-evolution via One Line of Vibe

arXiv 2607.03451 ↗First posted 3 Jul 2026cs.SE cs.AI cs.LGcited by 18

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

While skill optimization for autonomous agents has gained traction, existing methods rely on complex pipelines. This leaves a fundamental question unaddressed: What constitutes a minimal viable pipeline for skill optimization, where every component is justified by theory or empirical necessity? We formalize skill optimization via Zeroth-Order (ZO) optimization, mapping classical counterparts (central difference, trust regions) to recent literature. Noting that unlike blind numerical perturbations in classical ZO, skill trajectories serve as interpretable debugging feedback. Grounded in Claude Code philosophy and PAC learning, we establish three principles for convergence and generalization: file-system-based trajectory exploration, consensus attribute mining, and independent validation gating. Eliminating redundancies, we propose SkillOpt-Lite. It accelerates convergence and outperforms full SkillOpt: improving LiveMath by +8.8 points on GPT-5.5 and +25.4 points on GPT-5.4-nano, allowing the nano model to surpass standard GPT-5.4 optimized by SkillOpt. Finally, we integrate our framework into production coding agents like VSCode Copilot, enabling developers to evolve agent skills via one line of vibe. Because our framework treats all agent components simply as standard editable code, this minimal pipeline naturally generalizes to full harness optimization (HarnessOpt). On SpreadsheetBench, HarnessOpt enables GPT-5.4-nano to achieve 0.7758 accuracy, outperforming the larger GPT-5.5 running standard pipelines (0.7620). Code is available at https://github.com/EvolvingLMMs-Lab/SkillOpt-Lite.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 20 of its 29 references that are in the map. First posted on arXiv 3 Jul 2026.

Builds on

20 of 29 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents11 Jun
  2. 2026SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories31 May
  3. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skills22 May
  4. 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Support9 Apr
  5. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills26 Mar

Other references · 15

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  4. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  5. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  6. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  7. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 221
  8. 2020A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learningcited by 160
  9. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
  10. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
  11. 2026Self-Harness: Harnesses That Improve Themselvescited by 79
  12. 2026Code as Agent Harnesscited by 40
3 more
  1. 2026OfficeQA Pro: An Enterprise Benchmark for End-to-End Grounded Reasoningcited by 37
  2. 2026LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligencecited by 31
  3. 2026SoftSkill: Behavioral Compression for Contextual Adaptationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 18.

18 papers.

Sort:

By area:

  1. 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Modelcited by 8
  2. 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Roundscited by 3
  3. 2026Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?cited by 3
  4. 2026Agentic ESOpt: Fine-Tuning Long-Horizon LLM Agents with Minimal GPU Requirementscited by 2
  5. 2026Rethinking Self-Evolution: A Constrained Exploration-Exploitation Process for Mitigating Skill Overfittingcited by 1
  6. 2026Self-Evolving Code-with-Image Reasoningcited by 1
  7. 2026Skill Training with Corruption and Reconstruction Loopcited by 0
  8. 2026VeriSkill: A Self-Evolution Framework for Program Verification Skillscited by 0
  9. 2026Branch2Skill: Efficient Skill Evolution Through Reasoning Treescited by 0
  10. 2026RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolutioncited by 0
  11. 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agentscited by 0
  12. 2026VideoResearcher: Self-Improving Tool Design for Long-Video Understandingcited by 0
6 more
  1. 2026SkillVine: Agent Skill Evolution via Branching Explorationcited by 0
  2. 2026Certified Long-Horizon Code Agent Evolution via Validation-Gated Skill Optimizationcited by 0
  3. 2026SkillFocus: Evolving Agent Skills via Capability Decompositioncited by 0
  4. 2026Mara Chain: Rethinking Failure as a Stepping Stone for AI System Auto-Evolutioncited by 0
  5. 2026SkillCome: Group Contrast Skill Optimization with Dual Memorycited by 0
  6. 2026SkillSpec: Consensus-Gated Agent Skill Evolution via Representation Specializationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Agent Skill Evaluation and Evolution: Frameworks and Benchmarks
  2. 2026SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent
  3. 2026SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization
  4. 2026SkillGrad: Optimizing Agent Skills Like Gradient Descent
  5. 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
  6. 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skills
  7. 2026SkillForge: Co-Evolving Skills and Agents via Dynamic Skill Lifecycles
  8. 2026SkillAdam: Stable and Efficient Skill Evolution for Agents