mlsanityData to 14 Oct 2026

Scaling Agentic Data for Long-Horizon Terminal Intelligence

arXiv 2610.13166 ↗First posted 9 Oct 2026cs.CLcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Agent skill learning and evolution

Abstract (arXiv)

Terminal agents are moving beyond local operations toward completing real-world professional tasks. Short trajectories can demonstrate commands and tool calls, but they do not fully show how agents accumulate evidence through exploration, use it to inform judgments, continually adjust strategies based on feedback, and turn intermediate results into final deliverables. High-quality long-horizon trajectories capture these agentic behavioral patterns and their connections within a single problem-solving process, providing richer experience for sustained autonomous work. However, environment synthesis may complete or simplify the key work underlying these patterns in advance and thus remove the need for exploration, implementation, and verification that the agent was meant to perform. To address this, we introduce TerminalHorizon, a fully automated data synthesis engine for long-horizon terminal agents. Starting from real-world professional work, it uses independent execution to identify key work omitted during construction and uses the resulting evidence to guide environment reconstruction. To extend these patterns across stages, it progressively expands tasks under the same goal, introducing new requirements that build on prior results and call for further exploration and improvement. Using this engine, we construct 1.5K task environments and perform supervised fine-tuning of Qwen3.5-27B on the resulting dataset to obtain TerminalHorizon-27B. We achieve substantial performance gains on all 12 benchmarks spanning coding-agent tasks, agentic tasks in real-world production settings, and general reasoning. Multiple RSI case studies, each with a 12-hour research budget, further demonstrate the model's ability to continue experimenting beyond an initial solution, improve its methods based on feedback, and retain effective improvements in its final deliverables.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 39 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

36 of 39 references.

Closest ancestors · 10

Same direction, newest first

  1. 2026LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks3 Aug
  2. 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training30 Jul
  3. 2026OpenThoughts-Agent: Data Recipes for Agentic Models23 Jun
  4. 2026Tmax: A simple recipe for terminal agents22 Jun
  5. 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agents22 Jun
  6. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr
  7. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning10 Feb
  8. 2026TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agents6 Feb
  9. 2025ReAcTree: Hierarchical LLM Agent Trees with Control Flow for Long-Horizon Task Planning4 Nov
  10. 2025VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications30 Sep

Other references · 26

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2023Let's Verify Step by Stepcited by 3,789
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  5. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  6. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
  7. 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 103
  8. 2024KOR-Bench: Benchmarking Language Models on Knowledge-Orthogonal Reasoning Taskscited by 70
  9. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  10. 2026ProgramBench: Can Language Models Rebuild Programs From Scratch?cited by 59
  11. 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 43
  12. 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environmentscited by 33
14 more
  1. 2026Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Gradingcited by 31
  2. 2026CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversioncited by 23
  3. 2026SWE-Marathon: Can Agents Autonomously Complete Ultra-Long-Horizon Software Work?cited by 23
  4. 2026Toward Scalable Terminal Task Synthesis via Skill Graphscited by 22
  5. 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 20
  6. 2026Recursive Synthesis for Long-Horizon Terminal Taskscited by 19
  7. 2026AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks?cited by 13
  8. 2026What Makes Interaction Trajectories Effective for Training Terminal Agents?cited by 9
  9. 2026FACET: Preserving Source Intent and Executable State in Terminal Task Synthesiscited by 9
  10. 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Taskscited by 8
  11. 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environmentscited by 8
  12. 2026SaaSBench: Exploring the Boundaries of Coding Agents in Long-Horizon Enterprise SaaS Engineeringcited by 4
  13. 2026OneDayAgent: Towards a Long-Horizon Harness for Autonomous Agentscited by 4
  14. 2026Multi-Agent Computer Usecited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Long-Horizon-Terminal-Bench 2.0: Automating Diverse Task Construction and Measuring Sustained Agent Progress
  2. 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments
  3. 2026Endless Terminals: Scaling RL Environments for Terminal Agents
  4. 2026Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards
  5. 2025UltraHorizon: Benchmarking Agent Capabilities in Ultra Long-Horizon Scenarios
  6. 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compression
  7. 2026WorkBorne: Discovering Agentic Tasks from Real-World Artifact Transitions
  8. 2026AutoEnvScaling: Automating the Data Flywheel with Terminal Agents