Turbo Harness: Instance-Adaptive Harness Optimization
Not on the map. Why?
Abstract (arXiv)
Automating the search for effective harnesses is an important step toward enabling agents to recursively self-improve. Existing harness optimizations typically produce a single global harness that is applied uniformly across task instances. However, a harness that works well on average may not be optimal for every instance. We introduce Turbo Harness, a framework that can adapt a globally optimized harness to each instance by reusing information generated during the original optimization process. Specifically, Turbo Harness recycles artifacts produced during a completed global harness optimization run, and summarizes them into a structured playbook. We train a harness editor to leverage this prior optimization experience to generate instance-specific patches to the global harness. At inference time, the editor uses the instance and the playbook to construct a tailored harness in which the execution model operates. Through numerical experiments, we show that Turbo Harness consistently outperforms existing harness optimization baselines across seven benchmarks spanning interactive agent tasks, software engineering, and long-horizon terminal tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
40 of 47 references.
References · 40
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
28 more
- 2023Large Language Models as Optimizerscited by 864
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
- 2024TextGrad: Automatic "Differentiation" via Textcited by 273
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
- 2026Self-Harness: Harnesses That Improve Themselvescited by 107
- 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
- 2025A Systematic Survey of Automatic Prompt Optimization Techniquescited by 63
- 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
- 2025A Survey of Automatic Prompt Engineering: An Optimization Perspectivecited by 41
- 2026Recursive Harness Self-Improvementcited by 32
- 2025How to Train Your Advisor: Steering Black-Box LLMs with Advisor Modelscited by 24
- 2026AI Harness Engineering: A Runtime Substrate for Foundation-Model Software Agentscited by 20
- 2026Evolving Agents in the Dark: Retrospective Harness Optimization via Self-Preferencecited by 19
- 2026MemoHarness: Agent Harnesses That Learn from Experiencecited by 16
- 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectoriescited by 16
- 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 16
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 15
- 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Taskscited by 13
- 2026SWE-Bench Mobile: Can Large Language Model Agents Develop Industry-Level Mobile Applications?cited by 12
- 2026HARBOR: Automated Harness Optimizationcited by 11
- 2026HarnessOpt-Bench: Evaluating LLMs at Harness Optimizationcited by 9
- 2026AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Designcited by 9
- 2026StructAgent: Harness Long-horizon Digital Agents with Unified Causal Structurecited by 7
Built on by
Not cited yet.