What Makes Interaction Trajectories Effective for Training Terminal Agents?
Not on the map. Why?
Abstract (arXiv)
Stronger code agents are commonly assumed to be superior teachers for post-training, yet this assumption remains poorly disentangled from task difficulty, harness design, and student capacity. We investigate this pedagogical link using Terminal-Lego, a scalable pipeline that transforms multi-domain real-world issues into environment-verified agentic tasks. Surprisingly, standalone performance does not dictate teaching efficacy: while Claude Opus 4.6 achieves higher scores on Terminal-Bench 2.0, students fine-tuned on trajectories from DeepSeek-V3.2, a lower-scoring agent, exhibit significantly stronger generalization. We attribute this "pedagogical paradox" to Environment-Grounded Supervision (EGS): trajectories that explicitly expose inspect-act-verify behaviors through harness-visible interactions allow students to internalize robust problem-solving routines rather than fragile action sequences. Scaling analysis reveals exceptional data efficiency: with only 15.3k Terminal-Lego trajectories, for example, Qwen3-32B achieves a 24.3% score on Terminal-Bench 2.0, rivaling previous SOTA performance established with over 30x the data volume. Our results suggest that the frontier of agent post-training lies beyond mere outcome-matching, shifting the focus toward "Harness Engineering", where the systematic design of environment-grounded interaction structures serves as the primary catalyst for reproducible and generalizable agentic intelligence.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
16 of 24 references.
References · 16
- 2025Qwen3 Technical Reportcited by 8,195
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
- 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
- 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 34
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 30
4 more
- 2026SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolvingcited by 30
- 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environmentscited by 27
- 2026TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agentscited by 24
- 2026CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversioncited by 20
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Taskscited by 5
- 2026FACET: Preserving Source Intent and Executable State in Terminal Task Synthesiscited by 3
- 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environmentscited by 3
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 1
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 0
- 2026MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvementcited by 0
- 2026MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement8 Oct 2026
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness8 Sep 2026
- 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments3 Sep 2026
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments20 Aug 2026
- 2026FACET: Preserving Source Intent and Executable State in Terminal Task Synthesis19 Aug 2026
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Tasks6 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026TrajLong: Co-Designing Agentic and Long-Context Supervision for Mid-Training
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills
- 2026Grounded Skill Synthesis from Code at Scale for Agentic Intelligence
- 2026Agent trajectories as programs: fingerprinting and programming coding-agent behavior
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training
- 2026Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models
- 2025Student-Centered Distillation Narrows the Agentic Gap Between Small and Large LLMs
- 2026From Scoring to Acting: Outcome-Verified Comparative Self-Distillation for LLM Agents