Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Training terminal agents at scale requires diverse, verifiable terminal tasks and high-quality interaction trajectories, yet acquiring such data remains a significant challenge. Existing synthesis methods face two key limitations: (1) weak reliability caused by the disconnect between task generation and real execution, and (2) limited diversity and scalability due to dependence on existing repositories. We propose Meta-Task, a framework that redefines terminal task synthesis as a Terminal-Bench-format task itself: an agent operates within a real container environment to iteratively generate, execute, and verify tasks, so that synthesized components are checked for internal consistency and executability within the generation loop itself. Building upon this, we decouple the target task requirements along multiple dimensions, introduce a multi-phase mechanism that dynamically designs novel task specifications before producing the actual tasks, and incorporate optional external material support to enhance diversity and realism. We additionally apply LLM-as-Judge filtering to ensure the quality of the final training data. Experiments on Terminal-Bench 2.0 show that fine-tuning on only 3,221 Meta-Task synthesized trajectories achieves 22.5% and 31.8% Avg Pass@1 for Qwen3-14B and Qwen3-32B respectively, outperforming concurrent approaches with significantly less training data.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 22 of its 35 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
22 of 35 references.
Closest ancestors · 3
Same direction, newest first
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr
- 2026TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agents6 Feb
- 2026Computer Environments Elicit General Agentic Intelligence in LLMs22 Jan
Other references · 19
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
- 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 229
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
- 2018NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating Systemcited by 97
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 91
- 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 83
- 2026Endless Terminals: Scaling RL Environments for Terminal Agentscited by 43
- 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 34
7 more
- 2025SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositoriescited by 27
- 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environmentscited by 27
- 2026CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversioncited by 20
- 2026Building Effective AI Coding Agents for the Terminal: Scaffolding, Harness, Context Engineering, and Lessons Learnedcited by 18
- 2026SWE-Universe: Scale Real-World Verifiable Environments to Millionscited by 16
- 2026Toward Scalable Terminal Task Synthesis via Skill Graphscited by 16
- 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compressioncited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills
- 2026Recursive Synthesis for Long-Horizon Terminal Tasks
- 2026FACET: Preserving Source Intent and Executable State in Terminal Task Synthesis
- 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents
- 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agents
- 2026DIVE: Scaling Diversity in Agentic Task Synthesis for Generalizable Tool Use
- 2026SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation
- 2025TaskCraft: Automated Generation of Agentic Tasks