mlsanityData to 7 Oct 2026

Co-Harness: Co-Evolving Harnesses and Model Weights for LLM Agents

arXiv 2607.22688 ↗First posted 17 Jul 2026cs.AI cs.CLcited by 16

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Post-training agents for automated AI research requires optimizing not only model parameters, but also the runtime harness that shapes how research trajectories are generated, evaluated, and learned from. Existing pipelines typically train models under a fixed harness, including prompts, tools, skills, middleware, and memory, while leaving the data-generating process outside the optimization objective. This creates a mismatch between model updates and the static scaffolding that determines trajectory quality. We introduce Co-Harness, a framework that jointly optimizes the agent harness and model parameters during post-training. Co-Harness alternates between harness optimization and model optimization. An LLM-based HarnessCritic analyzes failed trajectories, identifies harness-level failure modes, and proposes validated local updates. The model is then fine-tuned on high-quality trajectories generated by the improved harness, distilling effective scaffolding into model parameters. A 200+ hour autonomous case study further shows that Co-Harness can recover from system crashes, improve inference efficiency, and discover ensemble strategies without human intervention. These results suggest that joint harness and model optimization is an effective way to improve agents beyond fixed-harness post-training.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 16 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

11 of 16 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses28 Apr

Other references · 10

  1. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  2. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  3. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  4. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 377
  5. 2024Automated Design of Agentic Systemscited by 360
  6. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  7. 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 270
  8. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  9. 2025ToRL: Scaling Tool-Integrated RLcited by 166
  10. 2026Harnessing Agentic Evolutioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

  1. 2026AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Tracescited by 9
  2. 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Failscited by 3
  3. 2026Harness-Zero: Harness Distillation via Agent-as-Harnesscited by 3
  4. 2026Aspire: Can Models Self-Evolve from Vague Goals?cited by 2
  5. 2026Beyond Final Scores: A Systematic Evaluation of Agents for Long-Horizon AI Research and Developmentcited by 1
  6. 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 1
  7. 2026EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnessescited by 0
  8. 2026A Responsive Present, a Shared Past, a Social Other: Teens' Overreliance on Companion AI Chatbotscited by 0
  9. 2026RLHarness: Co-evolving Procedural Skills with Reinforcement Learning for Long-horizon Multimodal Reasoningcited by 0
  10. 2026EvoIn: Bridging Evolution and Internalization for Agent Fine-Tuningcited by 0
  11. 2026VACE: Validation-Gated Alternating Co-Evolution of Agent Models and Harnessescited by 0
  12. 2026Mixture of Self-Improving Branches For Agent Harness Optimizationcited by 0
4 more
  1. 2026ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimizationcited by 0
  2. 2026CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolutioncited by 0
  3. 2026Harness Evolution Hits a Ceiling: When Weight Training Should Begincited by 0
  4. 2026A Closer Look at Agentic BBO: Benchmarking LLM Agents for Black-Box Optimizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026HarnessOpt-Bench: Evaluating LLMs at Harness Optimization
  2. 2026LiteEvo: Automated, Cost-Efficient Harness Evolution for Generalization to Unseen Tasks
  3. 2026Self-Harness: Harnesses That Improve Themselves
  4. 2026Rethinking the Evaluation of Harness Evolution for Agents
  5. 2026Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents
  6. 2026Recursive Harness Self-Improvement
  7. 2026The Interplay of Harness Design and Post-Training in LLM Agents
  8. 2026HarnessBridge: Learnable Bidirectional Controller for LLM Agent Harness