Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environments
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Training agentic models for terminal-based tasks critically depends on high-quality terminal trajectories that capture realistic long-horizon interactions across diverse domains. However, constructing such data at scale remains challenging due to two key requirements: textbfExecutability, since each instance requires a suitable and often distinct Docker environment; and textbfVerifiability, because heterogeneous task outputs preclude unified, standardized verification. To address these challenges, we propose TerminalTraj, a scalable pipeline that (i) filters high-quality repositories to construct Dockerized execution environments, (ii) generates Docker-aligned task instances, and (iii) synthesizes agent trajectories with executable validation code. Using TerminalTraj, we curate 32K Docker images and generate 50,733 verified terminal trajectories across eight domains. Models trained on this data with the Qwen2.5-Coder backbone achieve consistent performance improvements on TerminalBench (TB), with gains of up to 20% on TB~1.0 and 10% on TB~2.0 over their respective backbones. Notably, TerminalTraj-32B achieves strong performance among models with fewer than 100B parameters, reaching 35.30% on TB~1.0 and 22.00% on TB~2.0, and demonstrates improved test-time scaling behavior. All code and data are available at https://github.com/Wusiwei0410/TerminalTraj.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 35 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
23 of 35 references.
Closest ancestors · 5
Same direction, newest first
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents26 May
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 18
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 540
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
6 more
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
- 2024A Comparative Study on Reasoning Patterns of OpenAI's o1 Modelcited by 62
- 2025Scaling Test-time Compute for LLM Agentscited by 59
- 2025SWE-Mirror: Scaling Issue-Resolving Datasets by Mirroring Issues Across Repositoriescited by 30
- 2025BugPilot: Complex Bug Generation for Efficient Learning of SWE Skillscited by 28
- 2025Nex-N1: Agentic Models Trained via a Unified Ecosystem for Large-Scale Environment Constructioncited by 17
Built on by
Citing papers per year: 2026: 27.
27 papers.
Sort:
By area:
- 2026Toward Scalable Terminal Task Synthesis via Skill Graphscited by 16
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 13
- 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compressioncited by 12
- 2026TerminalWorld: Benchmarking Agents on Real-World Terminal Taskscited by 10
- 2026Recursive Synthesis for Long-Horizon Terminal Taskscited by 8
- 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agentscited by 7
- 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agentscited by 7
- 2026What Makes Interaction Trajectories Effective for Training Terminal Agents?cited by 6
- 2026CodeScaler: Scaling Code LLM Training and Test-Time Inference via Reward Modelscited by 5
- 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Executioncited by 5
- 2026SETA: Scaling Environments for Terminal Agentscited by 5
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Taskscited by 5
15 more
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMscited by 4
- 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environmentscited by 3
- 2026Envs-FORGE: Frontier-Optimized Reward-Grounded Environment Synthesis for Agent RLcited by 2
- 2026Environment Evolution for Terminal Agentscited by 2
- 2026ModularRSI: Modular and Generalizable Recursive Harness Self-Improvementcited by 2
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Trainingcited by 1
- 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modelingcited by 1
- 2026Learning Generalizable Behaviors for Terminal Agentscited by 1
- 2026T1: Terminal Agent Reinforcement Learning for Long-Horizon Taskscited by 1
- 2026Binocular Gaze Estimation with Single Camera and Single Light Sourcecited by 0
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 0
- 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMscited by 0
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solvingcited by 0
- 2026Can Terminal Agents Trust Their Own Verification? Diagnosing and Improving Self-Verificationcited by 0
- 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesiscited by 0
- 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis30 Sep 2026
- 2026Can Terminal Agents Trust Their Own Verification? Diagnosing and Improving Self-Verification30 Sep 2026
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solving23 Sep 2026
- 2026ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement14 Sep 2026
- 2026GTA: Graph Theory Agent and Benchmark for Algorithmic Graph Reasoning with LLMs10 Sep 2026
- 2026T1: Terminal Agent Reinforcement Learning for Long-Horizon Tasks10 Sep 2026
- 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments3 Sep 2026
- 2026Environment Evolution for Terminal Agents3 Sep 2026
- 2026Learning Generalizable Behaviors for Terminal Agents23 Aug 2026
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments20 Aug 2026
- 2026Envs-FORGE: Frontier-Optimized Reward-Grounded Environment Synthesis for Agent RL14 Aug 2026
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Tasks6 Aug 2026
15 more
- 2026Recursive Synthesis for Long-Horizon Terminal Tasks5 Aug 2026
- 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling5 Aug 2026
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training30 Jul 2026
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMs15 Jul 2026
- 2026SETA: Scaling Environments for Terminal Agents12 Jul 2026
- 2026Binocular Gaze Estimation with Single Camera and Single Light Source6 Jul 2026
- 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agents22 Jun 2026
- 2026What Makes Interaction Trajectories Effective for Training Terminal Agents?2 Jun 2026
- 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents28 May 2026
- 2026TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks21 May 2026
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills20 May 2026
- 2026Toward Scalable Terminal Task Synthesis via Skill Graphs28 Apr 2026
- 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compression21 Apr 2026
- 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Execution20 Apr 2026
- 2026CodeScaler: Scaling Code LLM Training and Test-Time Inference via Reward Models4 Feb 2026
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 13
- 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agentscited by 7
- 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Executioncited by 5
- 2026SETA: Scaling Environments for Terminal Agentscited by 5
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMscited by 4
- 2026Environment Evolution for Terminal Agentscited by 2
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Trainingcited by 1
- 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modelingcited by 1
- 2026Learning Generalizable Behaviors for Terminal Agentscited by 1
- 2026T1: Terminal Agent Reinforcement Learning for Long-Horizon Taskscited by 1
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 0
- 2026T1: Terminal Agent Reinforcement Learning for Long-Horizon Tasks10 Sep 2026
- 2026Environment Evolution for Terminal Agents3 Sep 2026
- 2026Learning Generalizable Behaviors for Terminal Agents23 Aug 2026
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments20 Aug 2026
- 2026OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling5 Aug 2026
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training30 Jul 2026
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMs15 Jul 2026
- 2026SETA: Scaling Environments for Terminal Agents12 Jul 2026
- 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agents22 Jun 2026
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills20 May 2026
- 2026HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Execution20 Apr 2026
- 2026Toward Scalable Terminal Task Synthesis via Skill Graphscited by 16
- 2026TerminalWorld: Benchmarking Agents on Real-World Terminal Taskscited by 10
- 2026Recursive Synthesis for Long-Horizon Terminal Taskscited by 8
- 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agentscited by 7
- 2026What Makes Interaction Trajectories Effective for Training Terminal Agents?cited by 6
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Taskscited by 5
- 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environmentscited by 3
- 2026Envs-FORGE: Frontier-Optimized Reward-Grounded Environment Synthesis for Agent RLcited by 2
- 2026Binocular Gaze Estimation with Single Camera and Single Light Sourcecited by 0
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solvingcited by 0
- 2026Can Terminal Agents Trust Their Own Verification? Diagnosing and Improving Self-Verificationcited by 0
- 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesiscited by 0
- 2026GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis30 Sep 2026
- 2026Can Terminal Agents Trust Their Own Verification? Diagnosing and Improving Self-Verification30 Sep 2026
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solving23 Sep 2026
- 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments3 Sep 2026
- 2026Envs-FORGE: Frontier-Optimized Reward-Grounded Environment Synthesis for Agent RL14 Aug 2026
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Tasks6 Aug 2026
- 2026Recursive Synthesis for Long-Horizon Terminal Tasks5 Aug 2026
- 2026Binocular Gaze Estimation with Single Camera and Single Light Source6 Jul 2026
- 2026What Makes Interaction Trajectories Effective for Training Terminal Agents?2 Jun 2026
- 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents28 May 2026
- 2026TerminalWorld: Benchmarking Agents on Real-World Terminal Tasks21 May 2026
- 2026Toward Scalable Terminal Task Synthesis via Skill Graphs28 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026DockSmith: Scaling Reliable Coding Environments via an Agentic Docker Builder
- 2026TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agents
- 2026Endless Terminals: Scaling RL Environments for Terminal Agents
- 2026CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversion
- 2026FACET: Preserving Source Intent and Executable State in Terminal Task Synthesis
- 2026Dockerless: Environment-Free Program Verifier for Coding Agents
- 2026DynSTEER: Dynamic Stage-wise Trajectory Evaluation and Execution-time Review for Agents
- 2026Mid-Harness: Scaling Actions Between Model and Harness for Terminal Agents