mlsanityData to 14 Oct 2026

Self-Evolving Agent Harness

arXiv 2610.18813 ↗First posted 13 Oct 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Harness self-evolution revises an agent's software scaffolding, including prompts, memory, workflows, and executable components, while keeping model weights fixed. We formalize a feedback-driven process in which accepted revisions persist across runs. The framework separates update targets from proposal and admission mechanisms. It distinguishes changes to interpreted state from revisions to tools and code, repository-level control logic, and plugin composition. We characterize search through evolutionary optimization and examine its reliability through continual PAC-learning. Under explicit assumptions, the analysis yields an expected generalization bound, a retention bound conditional on historical regression budgets, and a high-probability admission rule using fresh, independent validation data. We examine how persistent harness revisions affect knowledge sharing and organizational workflows, with implications for scientific reliability, physical safety, and institutional accountability. Cases from prior work illustrate model--harness co-design, distributed execution, and plugin reuse. Reliable deployment requires continual validation as task distributions and evaluators change, with independent safeguards for learning, runtime privileges, and consequential actions. We provide a comprehensive 66-page discussion of related work, theory, algorithms, evaluation, applications, and the broader impact of Harness RSI, together with continuously updated code and supplementary materials, at https://github.com/zgcagi/Harness-RSI.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 65 of its 84 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

65 of 84 references.

References · 65

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  4. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  5. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  6. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  7. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  8. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
  9. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
  10. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  11. 2024Automated Design of Agentic Systemscited by 407
  12. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
38 more
  1. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
  2. 2024Agent Workflow Memorycited by 383
  3. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  4. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  5. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
  6. 2024Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judgecited by 204
  7. 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 187
  8. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
  9. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
  10. 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectoriescited by 108
  11. 2026Self-Harness: Harnesses That Improve Themselvescited by 107
  12. 2021Algorithmic Monoculture and Social Welfarecited by 100
  13. 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 95
  14. 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluationcited by 92
  15. 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 91
  16. 2015Generalization in Adaptive Data Analysis and Holdout Reusecited by 83
  17. 2015The Ladder: A Reliable Leaderboard for Machine Learning Competitionscited by 69
  18. 2025MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agentscited by 62
  19. 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 62
  20. 2023Large Language Models Empowered Autonomous Edge AI for Connected Intelligencecited by 56
  21. 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 53
  22. 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discoverycited by 52
  23. 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
  24. 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Supportcited by 48
  25. 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 47
  26. 2026Towards Verifiably Safe Tool Use for LLM Agentscited by 36
  27. 2025PolySkill: Learning Generalizable Skills Through Polymorphic Abstractioncited by 27
  28. 2024Spontaneous Reward Hacking in Iterative Self-Refinementcited by 26
  29. 2026SkillOpt-Lite: Better and Faster Agent Self-evolution via One Line of Vibecited by 20
  30. 2022Memory Bounds for Continual Learningcited by 19
  31. 2026HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnessescited by 17
  32. 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolutioncited by 14
  33. 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemscited by 13
  34. 2026DarwinX: Evolving Agent Harnesses Through Natural Selectioncited by 13
  35. 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnessescited by 13
  36. 2026LiveMedBench: A Contamination-Free Medical Benchmark for LLMs with Automated Rubric Evaluationcited by 12
  37. 2026ModularRSI: Modular and Generalizable Recursive Harness Self-Improvementcited by 9
  38. 2026How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Taskscited by 8

50 most cited of 65 All 65 (JSON)

Built on by

Not cited yet.