Recursive Synthesis for Long-Horizon Terminal Tasks
Not on the map. Why?
Abstract (arXiv)
High-quality long-horizon training data for terminal agents is expensive to produce, often costing hundreds to thousands of dollars per task, because each task must keep the instruction, environment, reference solution, and verifier mutually consistent. Human authoring does not scale, and direct generation with large language models (LLMs) often breaks these dependencies. We present Recursive Synthetic Terminal Tasks (RST), a recursive verified synthesis framework for constructing long-horizon terminal-agent tasks at scale. Starting from verified seed tasks, RST extends the reference solution, realigns the verifier and instruction to the new workflow, validates the result in a fresh sandbox, and reuses accepted tasks as seeds for subsequent rounds. Across fifteen recursive rounds, RST produces 37,484 synthesized terminal-agent tasks at roughly 0.05 per task. Task difficulty increases substantially over rounds: the median reference solution grows from 67 to 374 lines, the median number of executed commands grows from 40 to 244, and DeepSeek-V4-Pro pass@4 drops from 90% at R1 to 2.5% at R15. To demonstrate training utility, we collect rejection-sampled Qwen3.5 trajectories on the synthesized tasks and use them for supervised fine-tuning. Fine-tuning on these trajectories improves Qwen3.5-27B and Qwen3.5-122B-A10B by up to 10 points on Terminal-Bench 2, Terminal-Bench Hard, and Long-Horizon Terminal Bench, while agentic PPO lifts Qwen3.5-27B to 49.44%, 32.00%, and 22.07% on the three benchmarks, corresponding to relative gains of 20.0%, 41.2%, and 21.9% over the base model. Moreover, after 15 rounds, the recursion shows no ceiling: synthesis yield and validation rates remain stable as difficulty keeps climbing, indicating that the process can continue well beyond the scale reported here.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 47 of its 58 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
47 of 58 references.
References · 47
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2024Self-Rewarding Language Modelscited by 654
- 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 325
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
35 more
- 2024V-STaR: Training Verifiers for Self-Taught Reasonerscited by 214
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
- 2025Measuring AI Ability to Complete Long Software Taskscited by 142
- 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 95
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
- 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Modelcited by 56
- 2025Self-Challenging Language Model Agentscited by 56
- 2024Self-Consistency Preference Optimizationcited by 50
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 46
- 2025A Survey on the Optimization of Large Language Model-based Agentscited by 45
- 2026Endless Terminals: Scaling RL Environments for Terminal Agentscited by 43
- 2025VisPlay: Self-Evolving Vision-Language Models from Imagescited by 42
- 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 34
- 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Userscited by 32
- 2025SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositoriescited by 27
- 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environmentscited by 27
- 2026InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Trainingcited by 26
- 2026TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agentscited by 24
- 2026Tmax: A simple recipe for terminal agentscited by 24
- 2026ScaleEnv: Scaling Environment Synthesis from Scratch for Generalist Interactive Tool-Use Agent Trainingcited by 23
- 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 20
- 2026Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Gradingcited by 20
- 2026SWE-Marathon: Can Agents Autonomously Complete Ultra-Long-Horizon Software Work?cited by 19
- 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Trainingcited by 17
- 2026MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Datacited by 16
- 2025Training Versatile Coding Agents in Synthetic Environmentscited by 13
- 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compressioncited by 12
- 2026Autodata: An agentic data scientist to create high quality synthetic datacited by 12
- 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editablecited by 12
- 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agentscited by 7
- 2025Towards Self-Evolving Benchmarks: Synthesizing Agent Trajectories via Test-Time Exploration under Validate-by-Reproduce Paradigmcited by 5
- 2026Less is Enough: Synthesizing Diverse Data in LLM Feature Space with Sparse Autoencoderscited by 5
- 2026Stale but Stable: Staleness-Adaptive Trust Regions for Stabilizing Asynchronous Reinforcement Learningcited by 5
- 2026BenchEvolver: Frontier Task Synthesis via Solution-Centric Evolutioncited by 3
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Dream-RSI: Recursive Self-Improvement through Evolving Worldscited by 9
- 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environmentscited by 3
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesiscited by 3
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 2
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 2
- 2026Learning Generalizable Behaviors for Terminal Agentscited by 1
- 2026T1: Terminal Agent Reinforcement Learning for Long-Horizon Taskscited by 1
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environmentscited by 0
- 2026Dream-RSI: Recursive Self-Improvement through Evolving Worlds14 Sep 2026
- 2026T1: Terminal Agent Reinforcement Learning for Long-Horizon Tasks10 Sep 2026
- 2026FrogNano: Training a 4B Coding Agent via Online Task Synthesis7 Sep 2026
- 2026Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments3 Sep 2026
- 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence31 Aug 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026Learning Generalizable Behaviors for Terminal Agents23 Aug 2026
- 2026Terminal Agents: A Survey of AI Agents in Command-Line Environments20 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills
- 2026FACET: Preserving Source Intent and Executable State in Terminal Task Synthesis
- 2026Toward Scalable Terminal Task Synthesis via Skill Graphs
- 2026SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation
- 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agents
- 2026SETA: Scaling Environments for Terminal Agents
- 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents