mlsanityData to 7 Oct 2026

What Makes Interaction Trajectories Effective for Training Terminal Agents?

arXiv 2606.03461 ↗First posted 2 Jun 2026cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Stronger code agents are commonly assumed to be superior teachers for post-training, yet this assumption remains poorly disentangled from task difficulty, harness design, and student capacity. We investigate this pedagogical link using Terminal-Lego, a scalable pipeline that transforms multi-domain real-world issues into environment-verified agentic tasks. Surprisingly, standalone performance does not dictate teaching efficacy: while Claude Opus 4.6 achieves higher scores on Terminal-Bench 2.0, students fine-tuned on trajectories from DeepSeek-V3.2, a lower-scoring agent, exhibit significantly stronger generalization. We attribute this "pedagogical paradox" to Environment-Grounded Supervision (EGS): trajectories that explicitly expose inspect-act-verify behaviors through harness-visible interactions allow students to internalize robust problem-solving routines rather than fragile action sequences. Scaling analysis reveals exceptional data efficiency: with only 15.3k Terminal-Lego trajectories, for example, Qwen3-32B achieves a 24.3% score on Terminal-Bench 2.0, rivaling previous SOTA performance established with over 30x the data volume. Our results suggest that the frontier of agent post-training lies beyond mere outcome-matching, shifting the focus toward "Harness Engineering", where the systematic design of environment-grounded interaction structures serves as the primary catalyst for reproducible and generalizable agentic intelligence.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

16 of 24 references.

References · 16

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  4. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  5. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  6. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  7. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
  8. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
  9. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
  10. 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
  11. 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 34
  12. 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 30
4 more
  1. 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 30
  2. 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environmentscited by 27
  3. 2026TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agentscited by 24
  4. 2026CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversioncited by 20

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TrajLong: Co-Designing Agentic and Long-Context Supervision for Mid-Training
  2. 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills
  3. 2026Grounded Skill Synthesis from Code at Scale for Agentic Intelligence
  4. 2026Agent trajectories as programs: fingerprinting and programming coding-agent behavior
  5. 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training
  6. 2026Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models
  7. 2025Student-Centered Distillation Narrows the Agentic Gap Between Small and Large LLMs
  8. 2026From Scoring to Acting: Outcome-Verified Comparative Self-Distillation for LLM Agents