mlsanityData to 7 Oct 2026

CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution

arXiv 2610.10426 ↗First posted 7 Oct 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Terminal-agent capability depends jointly on model weights and the runtime harness that formats prompts, binds tools, and handles error recovery. Existing harness-model co-evolution approaches improve both components, yet often treat trajectories produced during harness search as an undifferentiated replay buffer. This practice overlooks that a trajectory's value for model training depends on the harness under which it was generated. To systematically analyze this interface, we establish an alternating co-evolution framework that decouples harness search and policy training through component-wise promotion decisions. Within this framework, we introduce CoTrace, a harness-aware data recipe that explicitly governs trajectory routing, provenance matching, and curriculum refresh. Under CoTrace, recurring execution failures guide harness synthesis, while policy training is strictly conditioned on verified rollouts matched to the adopted runtime for supervised fine-tuning (SFT) or fresh online interactions for reinforcement learning (RL). On the Tmax promotion split, CoTrace advances Qwen3.5-9B from 78 to 88 solved tasks under supervised fine-tuning while an online reinforcement variant reaches 90. Specifically, a compact harness-matched corpus produces steady model gains at substantially lower compute than much larger corpora pooled across sibling harnesses. Furthermore, evaluations on Terminal-Bench 2.1 and SWE-bench Lite show that out-of-distribution transfer depends fundamentally on harness compatibility, where maintaining consistency between training and evaluation runtimes prevents procedural execution breakdowns observed under foreign scaffolds.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 53 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

49 of 53 references.

References · 49

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  5. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  7. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  8. 2023LIMA: Less Is More for Alignmentcited by 1,080
  9. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  10. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  11. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  12. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
37 more
  1. 2023Large Language Models as Optimizerscited by 830
  2. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  3. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  4. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  5. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  6. 2023Reinforced Self-Training (ReST) for Language Modelingcited by 486
  7. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
  8. 2015Illuminating search spaces by mapping elitescited by 406
  9. 2024Automated Design of Agentic Systemscited by 360
  10. 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 325
  11. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 319
  12. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
  13. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
  14. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
  15. 2024TextGrad: Automatic "Differentiation" via Textcited by 250
  16. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  17. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
  18. 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 243
  19. 2024A Survey on Data Selection for Language Modelscited by 230
  20. 2020Prioritized Level Replaycited by 190
  21. 2024Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Datacited by 184
  22. 2026Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnessescited by 119
  23. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 97
  24. 2026Self-Harness: Harnesses That Improve Themselvescited by 79
  25. 2024Data Shapley in One Training Runcited by 76
  26. 2024Quantifying Variance in Evaluation Benchmarkscited by 52
  27. 2026HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundrycited by 37
  28. 2026Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharingcited by 32
  29. 2026Rethinking the Trust Region in LLM Reinforcement Learningcited by 32
  30. 2026Tmax: A simple recipe for terminal agentscited by 24
  31. 2026Co-Harness: Co-Evolving Harnesses and Model Weights for LLM Agentscited by 16
  32. 2026Harness-Aware Self-Evolving: Co-Evolving Model Weights, Harness, and Task Solutionscited by 10
  33. 2026EvoTrainer: Co-Evolving LLM Policies and Training Harnesses for Autonomous Agentic Reinforcement Learningcited by 9
  34. 2026The Interplay of Harness Design and Post-Training in LLM Agentscited by 8
  35. 2026Better Harnesses, Smaller Models: Building 90% Cheaper Agents via Automated Harness Adaptationcited by 7
  36. 2026OpenSage: Self-programming Agent Generation Enginecited by 4
  37. 2026LemonHarness Technical Reportcited by 2

Built on by

Not cited yet.