mlsanityData to 7 Oct 2026

Harness-Zero: Harness Distillation via Agent-as-Harness

arXiv 2609.24974 ↗First posted 21 Sep 2026cs.AI cs.CL cs.NEcited by 3

On the map: LLM agents and tool use → Reinforcement learning for LLM agents also fits: Agent skill learning and evolution

Abstract (arXiv)

Agent harnesses, the external systems that mediate model-environment interaction, can substantially improve agent performance, but their gains remain tied to the harness at deployment. Because the best harness varies across domains, instances, and models, a general-purpose agent must either settle for a suboptimal shared harness or route among an ever-growing set of specialized ones. We therefore study agent harness distillation: using a domain- or instance-optimized harness as training-time guidance and transferring the behaviors it induces into model weights, so that its gains survive under a single fixed target harness. The challenge is that the two harnesses differ in action space and available information, so guidance from the optimized harness cannot serve directly as supervision for the target one. We introduce Harness-Zero, which enables harness distillation through agent-as-harness. Guided by the optimized harness, a harnessing agent corrects student responses before execution in the target harness's action space, turning harness guidance into training demonstrations. Fine-tuning on the resulting trajectories internalizes harness-induced behavior into the model, so the specialized harness can be removed at deployment. Our experiments spanning knowledge work, tool use, and science domains show that: (1) For frontier LLMs using the same evolved harness, agent-as-harness outperforms code-as-harness. (2) With the specialized harness removed at deployment, Harness-Zero improves the base model's macro-average task success from 23.3% to 44.3%, even exceeding the 41.7% it reaches with that harness still attached. (3) Harness-Zero recovers harness-induced behaviors absent from the base model, with 82.3% average recovery across 28 patterns in the three domains.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 42 of its 80 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

42 of 80 references.

References · 42

  1. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  2. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  3. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  4. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  5. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  6. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  7. 2024Automated Design of Agentic Systemscited by 360
  8. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
  9. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  10. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
  11. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  12. 2026Towards End-to-End Automation of AI Researchcited by 150
30 more
  1. 2024Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systemscited by 129
  2. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
  3. 2017Predicting Organic Reaction Outcomes with Weisfeiler-Lehman Networkcited by 102
  4. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
  5. 2026Self-Harness: Harnesses That Improve Themselvescited by 79
  6. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 68
  7. 2026Natural-Language Agent Harnessescited by 54
  8. 2026Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflowscited by 44
  9. 2026Meta Context Engineering via Agentic Skill Evolutioncited by 42
  10. 2026Code as Agent Harnesscited by 40
  11. 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 37
  12. 2026Continual Harness: Online Adaptation for Self-Improving Foundation Agentscited by 30
  13. 2026Qwen-AgentWorld: Language World Models for General Agentscited by 22
  14. 2026HarnessForge: Joint Harness and Policy Evolution for Adaptive Agent Systemscited by 20
  15. 2026SIA: Self Improving AI with Harness & Weight Updatescited by 18
  16. 2026Co-Harness: Co-Evolving Harnesses and Model Weights for LLM Agentscited by 16
  17. 2026HarnessBank: Semantic Gene-Bank Search with Gated Verification for Agent-Harness Self-Evolutioncited by 11
  18. 2026Harness-Aware Self-Evolving: Co-Evolving Model Weights, Harness, and Task Solutionscited by 10
  19. 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 10
  20. 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Taskscited by 9
  21. 2026WHALE: A Simple Recipe for Joint Harness-Weight Optimizationcited by 9
  22. 2026Prime Agent: A Self-Improving RLM Harnesscited by 8
  23. 2026SafeEvolve: Harness-Policy Co-Evolution from Agent Experience for Safety Alignmentcited by 6
  24. 2026Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoningcited by 5
  25. 2026AI4AI at Test-Time: Strong-to-Weak Capability Transfer via Harnessescited by 5
  26. 2026From LLM Inference to Agentic Workloads: Characterization and Implications for Serving Systemscited by 5
  27. 2026Harness-of-Harness: Multi-Day Autonomous Software Development with Continual Improvementcited by 2
  28. 2026Task-Aware Harness Provisioning for LLM Agents in Mission-Critical Infrastructure Operationscited by 1
  29. 2026Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluationcited by 1
  30. 2026What Does Multi-Harness RL Learn? Credit Assignment and Portability in Coding Agentscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses
  2. 2026Recursive Harness Distillation across Agents for Robot Manipulation
  3. 2026Adapting the Interface, Not the Model: Runtime Harness Adaptation for Deterministic LLM Agents
  4. 2026Co-Evolving Harnesses and Models: On-Policy Correction Helps Weaker Models Catch Up Where Imitation Fails
  5. 2026CHART: A Harness-Rotation Curriculum for Harness-Robust Search Agents
  6. 2026HarnessBridge: Learnable Bidirectional Controller for LLM Agent Harness
  7. 2026Harness-Aware Distillation for Small Language Model Agents
  8. 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable