Co-Harness: Co-Evolving Harnesses and Model Weights for LLM Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Post-training agents for automated AI research requires optimizing not only model parameters, but also the runtime harness that shapes how research trajectories are generated, evaluated, and learned from. Existing pipelines typically train models under a fixed harness, including prompts, tools, skills, middleware, and memory, while leaving the data-generating process outside the optimization objective. This creates a mismatch between model updates and the static scaffolding that determines trajectory quality. We introduce Co-Harness, a framework that jointly optimizes the agent harness and model parameters during post-training. Co-Harness alternates between harness optimization and model optimization. An LLM-based HarnessCritic analyzes failed trajectories, identifies harness-level failure modes, and proposes validated local updates. The model is then fine-tuned on high-quality trajectories generated by the improved harness, distilling effective scaffolding into model parameters. A 200+ hour autonomous case study further shows that Co-Harness can recover from system crashes, improve inference efficiency, and discover ensemble strategies without human intervention. These results suggest that joint harness and model optimization is an effective way to improve agents beyond fixed-harness post-training.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 16 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
11 of 16 references.
Closest ancestors · 1
Same direction, newest first
- 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses28 Apr
Other references · 10
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
- 2024Automated Design of Agentic Systemscited by 360
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
- 2025ToRL: Scaling Tool-Integrated RLcited by 166
- 2026Harnessing Agentic Evolutioncited by 8
Built on by
Citing papers per year: 2026: 16.
16 papers.
Sort:
By area:
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 9
- 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Failscited by 3
- 2026Harness-Zero: Harness Distillation via Agent-as-Harnesscited by 3
- 2026Aspire: Can Models Self-Evolve from Vague Goals?cited by 2
- 2026Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Developmentcited by 1
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 1
- 2026EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnessescited by 0
- 2026A Responsive Present, a Shared Past, a Social Other: Teens' Overreliance on Companion AI Chatbotscited by 0
- 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoningcited by 0
- 2026EvoIn: Bridging Evolution and Internalization for Agent Fine-Tuningcited by 0
- 2026VACE: Validation-Gated Alternating Co-Evolution of Agent Models and Harnessescited by 0
- 2026Mixture of Self-Improving Branches For Agent Harness Optimizationcited by 0
4 more
- 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimizationcited by 0
- 2026CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolutioncited by 0
- 2026Harness Evolution Hits a Ceiling: When Weight Training Should Begincited by 0
- 2026A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimizationcited by 0
- 2026A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimization8 Oct 2026
- 2026Harness Evolution Hits a Ceiling: When Weight Training Should Begin8 Oct 2026
- 2026CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution7 Oct 2026
- 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization1 Oct 2026
- 2026Mixture of Self-Improving Branches For Agent Harness Optimization29 Sep 2026
- 2026VACE: Validation-Gated Alternating Co-Evolution of Agent Models and Harnesses29 Sep 2026
- 2026EvoIn: Bridging Evolution and Internalization for Agent Fine-Tuning28 Sep 2026
- 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoning26 Sep 2026
- 2026Harness-Zero: Harness Distillation via Agent-as-Harness21 Sep 2026
- 2026A Responsive Present, a Shared Past, a Social Other: Teens' Overreliance on Companion AI Chatbots13 Sep 2026
- 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails8 Sep 2026
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness8 Sep 2026
4 more
- 2026Aspire: Can Models Self-Evolve from Vague Goals?31 Aug 2026
- 2026EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnesses28 Aug 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces24 Aug 2026
- 2026Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Development13 Aug 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 9
- 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Failscited by 3
- 2026Harness-Zero: Harness Distillation via Agent-as-Harnesscited by 3
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 1
- 2026EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnessescited by 0
- 2026VACE: Validation-Gated Alternating Co-Evolution of Agent Models and Harnessescited by 0
- 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimizationcited by 0
- 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization1 Oct 2026
- 2026VACE: Validation-Gated Alternating Co-Evolution of Agent Models and Harnesses29 Sep 2026
- 2026Harness-Zero: Harness Distillation via Agent-as-Harness21 Sep 2026
- 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails8 Sep 2026
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness8 Sep 2026
- 2026EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnesses28 Aug 2026
- 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces24 Aug 2026
- 2026Aspire: Can Models Self-Evolve from Vague Goals?cited by 2
- 2026Aspire: Can Models Self-Evolve from Vague Goals?31 Aug 2026
- 2026Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Developmentcited by 1
- 2026A Responsive Present, a Shared Past, a Social Other: Teens' Overreliance on Companion AI Chatbotscited by 0
- 2026EvoIn: Bridging Evolution and Internalization for Agent Fine-Tuningcited by 0
- 2026Mixture of Self-Improving Branches For Agent Harness Optimizationcited by 0
- 2026CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolutioncited by 0
- 2026Harness Evolution Hits a Ceiling: When Weight Training Should Begincited by 0
- 2026A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimizationcited by 0
- 2026A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimization8 Oct 2026
- 2026Harness Evolution Hits a Ceiling: When Weight Training Should Begin8 Oct 2026
- 2026CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution7 Oct 2026
- 2026Mixture of Self-Improving Branches For Agent Harness Optimization29 Sep 2026
- 2026EvoIn: Bridging Evolution and Internalization for Agent Fine-Tuning28 Sep 2026
- 2026A Responsive Present, a Shared Past, a Social Other: Teens' Overreliance on Companion AI Chatbots13 Sep 2026
- 2026Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Development13 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026HarnessOpt-Bench: Evaluating LLMs at Harness Optimization
- 2026LiteEvo: Automated, Cost-Efficient Harness Evolution for Generalization to Unseen Tasks
- 2026Self-Harness: Harnesses That Improve Themselves
- 2026Rethinking the Evaluation of Harness Evolution for Agents
- 2026Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents
- 2026Recursive Harness Self-Improvement
- 2026The Interplay of Harness Design and Post-Training in LLM Agents
- 2026HarnessBridge: Learnable Bidirectional Controller for LLM Agent Harness