mlsanityData to 7 Oct 2026

From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolution

arXiv 2604.15097 ↗First posted 16 Apr 2026cs.SE cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

This beta technical report asks how reusable experience should be represented so that it can function as effective test-time control and as a substrate for iterative evolution. We study this question in 4.590 controlled trials across 45 scientific code-solving scenarios. We find that documentation-oriented Skill packages provide unstable control: their useful signal is sparse, and expanding a compact experience object into a fuller documentation package often fails to help and can degrade the overall average. We further show that representation itself is a first-order factor. A compact Gene representation yields the strongest overall average, remains competitive under substantial structural perturbations, and outperforms matched-budget Skill fragments, while reattaching documentation-oriented material usually weakens rather than improves it. Beyond one-shot control, we show that Gene is also a better carrier for iterative experience accumulation: attached failure history is more effective in Gene than in Skill or freeform text, editable structure matters beyond content alone, and failure information is most useful when distilled into compact warnings rather than naively appended. On CritPt, gene-evolved systems improve over their paired base models from 9.1% to 18.57% and from 17.7% to 27.14%. These results suggest that the core problem in experience reuse is not how to supply more experience, but how to encode experience as a compact, control-oriented, evolution-ready object.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 20 of its 24 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

20 of 24 references.

References · 20

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  5. 2023Teaching Large Language Models to Self-Debugcited by 963
  6. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  7. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  8. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  9. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
  10. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  11. 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
  12. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 105
8 more
  1. 2025Memp: Exploring Agent Procedural Memorycited by 88
  2. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 81
  3. 2026Memento-Skills: Let Agents Design Agentscited by 56
  4. 2026Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents?cited by 19
  5. 2025Probing the Critical Point (CritPt) of AI Reasoning: a Frontier Physics Research Benchmarkcited by 16
  6. 2026TAME: A Trustworthy Test-Time Evolution of Agent Memory with Systematic Benchmarkingcited by 7
  7. 2026UMEM: Unified Memory Extraction and Management Framework for Generalizable Memorycited by 7
  8. 2026CoWork-X: Experience-Optimized Co-Evolution for Multi-Agent Collaboration Systemcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.