Self-Evolving Agent Harness
Not on the map. Why?
Abstract (arXiv)
Harness self-evolution revises an agent's software scaffolding, including prompts, memory, workflows, and executable components, while keeping model weights fixed. We formalize a feedback-driven process in which accepted revisions persist across runs. The framework separates update targets from proposal and admission mechanisms. It distinguishes changes to interpreted state from revisions to tools and code, repository-level control logic, and plugin composition. We characterize search through evolutionary optimization and examine its reliability through continual PAC-learning. Under explicit assumptions, the analysis yields an expected generalization bound, a retention bound conditional on historical regression budgets, and a high-probability admission rule using fresh, independent validation data. We examine how persistent harness revisions affect knowledge sharing and organizational workflows, with implications for scientific reliability, physical safety, and institutional accountability. Cases from prior work illustrate model--harness co-design, distributed execution, and plugin reuse. Reliable deployment requires continual validation as task distributions and evaluators change, with independent safeguards for learning, runtime privileges, and consequential actions. We provide a comprehensive 66-page discussion of related work, theory, algorithms, evaluation, applications, and the broader impact of Harness RSI, together with continuously updated code and supplementary materials, at https://github.com/zgcagi/Harness-RSI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 65 of its 84 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
65 of 84 references.
References · 65
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2024AFlow: Automating Agentic Workflow Generationcited by 432
- 2024Automated Design of Agentic Systemscited by 407
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
38 more
- 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 384
- 2024Agent Workflow Memorycited by 383
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
- 2024Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judgecited by 204
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 187
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 148
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
- 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectoriescited by 108
- 2026Self-Harness: Harnesses That Improve Themselvescited by 107
- 2021Algorithmic Monoculture and Social Welfarecited by 100
- 2025MemEvolve: Meta-Evolution of Agent Memory Systemscited by 95
- 2025Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluationcited by 92
- 2022Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?cited by 91
- 2015Generalization in Adaptive Data Analysis and Holdout Reusecited by 83
- 2015The Ladder: A Reliable Leaderboard for Machine Learning Competitionscited by 69
- 2025MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agentscited by 62
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 62
- 2023Large Language Models Empowered Autonomous Edge AI for Connected Intelligencecited by 56
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machinecited by 53
- 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discoverycited by 52
- 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
- 2026SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Supportcited by 48
- 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 47
- 2026Towards Verifiably Safe Tool Use for LLM Agentscited by 36
- 2025PolySkill: Learning Generalizable Skills Through Polymorphic Abstractioncited by 27
- 2024Spontaneous Reward Hacking in Iterative Self-Refinementcited by 26
- 2026SkillOpt-Lite: Better and Faster Agent Self-evolution via One Line of Vibecited by 20
- 2022Memory Bounds for Continual Learningcited by 19
- 2026HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnessescited by 17
- 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolutioncited by 14
- 2026MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemscited by 13
- 2026DarwinX: Evolving Agent Harnesses Through Natural Selectioncited by 13
- 2026RRSI: Regularized Recursive Self-Improvement of Agent Harnessescited by 13
- 2026LiveMedBench: A Contamination-Free Medical Benchmark for LLMs with Automated Rubric Evaluationcited by 12
- 2026ModularRSI: Modular and Generalizable Recursive Harness Self-Improvementcited by 9
- 2026How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Taskscited by 8
50 most cited of 65 All 65 (JSON)
Built on by
Not cited yet.