From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolution
Not on the map. Why?
Abstract (arXiv)
This beta technical report asks how reusable experience should be represented so that it can function as effective test-time control and as a substrate for iterative evolution. We study this question in 4.590 controlled trials across 45 scientific code-solving scenarios. We find that documentation-oriented Skill packages provide unstable control: their useful signal is sparse, and expanding a compact experience object into a fuller documentation package often fails to help and can degrade the overall average. We further show that representation itself is a first-order factor. A compact Gene representation yields the strongest overall average, remains competitive under substantial structural perturbations, and outperforms matched-budget Skill fragments, while reattaching documentation-oriented material usually weakens rather than improves it. Beyond one-shot control, we show that Gene is also a better carrier for iterative experience accumulation: attached failure history is more effective in Gene than in Skill or freeform text, editable structure matters beyond content alone, and failure information is most useful when distilled into compact warnings rather than naively appended. On CritPt, gene-evolved systems improve over their paired base models from 9.1% to 18.57% and from 17.7% to 27.14%. These results suggest that the core problem in experience reuse is not how to supply more experience, but how to encode experience as a compact, control-oriented, evolution-ready object.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 20 of its 24 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
20 of 24 references.
References · 20
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 105
8 more
- 2025Memp: Exploring Agent Procedural Memorycited by 88
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 81
- 2026Memento-Skills: Let Agents Design Agentscited by 56
- 2026Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents?cited by 19
- 2025Probing the Critical Point (CritPt) of AI Reasoning: a Frontier Physics Research Benchmarkcited by 16
- 2026TAME: A Trustworthy Test-Time Evolution of Agent Memory with Systematic Benchmarkingcited by 7
- 2026UMEM: Unified Memory Extraction and Management Framework for Generalizable Memorycited by 7
- 2026CoWork-X: Experience-Optimized Co-Evolution for Multi-Agent Collaboration Systemcited by 1
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolutioncited by 18
- 2026Library Drift: Diagnosing and Fixing a Silent Failure Mode in Self-Evolving LLM Skill Librariescited by 10
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemscited by 9
- 2026Ratchet: How Reliable Must an LLM Judge Be to Retire a Skill?cited by 3
- 2026Living-Harness Is an Interactive-Agent Evolvercited by 2
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Networkcited by 1
- 2026Who Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agentscited by 1
- 2026LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Taskscited by 0
- 2026Who Verifies the Verifier? Co-Evolving Inspectable Graders with Self-Improving Agentscited by 0
- 2026Who Verifies the Verifier? Co-Evolving Inspectable Graders with Self-Improving Agents8 Oct 2026
- 2026LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks24 Aug 2026
- 2026Living-Harness Is an Interactive-Agent Evolver29 Jul 2026
- 2026Who Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agents14 Jul 2026
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Network25 May 2026
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems21 May 2026
- 2026Ratchet: How Reliable Must an LLM Judge Be to Retire a Skill?21 May 2026
- 2026Library Drift: Diagnosing and Fixing a Silent Failure Mode in Self-Evolving LLM Skill Libraries19 May 2026
- 2026SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolution18 May 2026