mlsanityData to 14 Oct 2026

Turbo Harness: Instance-Adaptive Harness Optimization

arXiv 2609.40330 ↗First posted 30 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Automating the search for effective harnesses is an important step toward enabling agents to recursively self-improve. Existing harness optimizations typically produce a single global harness that is applied uniformly across task instances. However, a harness that works well on average may not be optimal for every instance. We introduce Turbo Harness, a framework that can adapt a globally optimized harness to each instance by reusing information generated during the original optimization process. Specifically, Turbo Harness recycles artifacts produced during a completed global harness optimization run, and summarizes them into a structured playbook. We train a harness editor to leverage this prior optimization experience to generate instance-specific patches to the global harness. At inference time, the editor uses the instance and the playbook to construct a tailored harness in which the execution model operates. Through numerical experiments, we show that Turbo Harness consistently outperforms existing harness optimization baselines across seven benchmarks spanning interactive agent tasks, software engineering, and long-horizon terminal tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

40 of 47 references.

References · 40

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  7. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  8. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  9. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  10. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  11. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  12. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
28 more
  1. 2023Large Language Models as Optimizerscited by 864
  2. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
  3. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
  4. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
  5. 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
  6. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 309
  7. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 285
  8. 2024TextGrad: Automatic "Differentiation" via Textcited by 273
  9. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 142
  10. 2026Self-Harness: Harnesses That Improve Themselvescited by 107
  11. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
  12. 2025A Systematic Survey of Automatic Prompt Optimization Techniquescited by 63
  13. 2026Meta Context Engineering via Agentic Skill Evolutioncited by 49
  14. 2025A Survey of Automatic Prompt Engineering: An Optimization Perspectivecited by 41
  15. 2026Recursive Harness Self-Improvementcited by 32
  16. 2025How to Train Your Advisor: Steering Black-Box LLMs with Advisor Modelscited by 24
  17. 2026AI Harness Engineering: A Runtime Substrate for Foundation-Model Software Agentscited by 20
  18. 2026Evolving Agents in the Dark: Retrospective Harness Optimization via Self-Preferencecited by 19
  19. 2026MemoHarness: Agent Harnesses That Learn from Experiencecited by 16
  20. 2026Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectoriescited by 16
  21. 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 16
  22. 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 15
  23. 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Taskscited by 13
  24. 2026SWE-Bench Mobile: Can Large Language Model Agents Develop Industry-Level Mobile Applications?cited by 12
  25. 2026HARBOR: Automated Harness Optimizationcited by 11
  26. 2026HarnessOpt-Bench: Evaluating LLMs at Harness Optimizationcited by 9
  27. 2026AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Designcited by 9
  28. 2026StructAgent: Harness Long-horizon Digital Agents with Unified Causal Structurecited by 7

Built on by

Not cited yet.