mlsanityData to 7 Oct 2026

Recursive Synthesis for Long-Horizon Terminal Tasks

arXiv 2608.05466 ↗First posted 5 Aug 2026cs.AI cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

High-quality long-horizon training data for terminal agents is expensive to produce, often costing hundreds to thousands of dollars per task, because each task must keep the instruction, environment, reference solution, and verifier mutually consistent. Human authoring does not scale, and direct generation with large language models (LLMs) often breaks these dependencies. We present Recursive Synthetic Terminal Tasks (RST), a recursive verified synthesis framework for constructing long-horizon terminal-agent tasks at scale. Starting from verified seed tasks, RST extends the reference solution, realigns the verifier and instruction to the new workflow, validates the result in a fresh sandbox, and reuses accepted tasks as seeds for subsequent rounds. Across fifteen recursive rounds, RST produces 37,484 synthesized terminal-agent tasks at roughly 0.05 per task. Task difficulty increases substantially over rounds: the median reference solution grows from 67 to 374 lines, the median number of executed commands grows from 40 to 244, and DeepSeek-V4-Pro pass@4 drops from 90% at R1 to 2.5% at R15. To demonstrate training utility, we collect rejection-sampled Qwen3.5 trajectories on the synthesized tasks and use them for supervised fine-tuning. Fine-tuning on these trajectories improves Qwen3.5-27B and Qwen3.5-122B-A10B by up to 10 points on Terminal-Bench 2, Terminal-Bench Hard, and Long-Horizon Terminal Bench, while agentic PPO lifts Qwen3.5-27B to 49.44%, 32.00%, and 22.07% on the three benchmarks, corresponding to relative gains of 20.0%, 41.2%, and 21.9% over the base model. Moreover, after 15 rounds, the recursion shows no ceiling: synthesis yield and validation rates remain stable as difficulty keeps climbing, indicating that the process can continue well beyond the scale reported here.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 47 of its 58 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

47 of 58 references.

References · 47

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  3. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  4. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  5. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  6. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  7. 2024Self-Rewarding Language Modelscited by 654
  8. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
  9. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  10. 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 325
  11. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
  12. 2024Training Software Engineering Agents and Verifiers with SWE-Gymcited by 300
35 more
  1. 2024V-STaR: Training Verifiers for Self-Taught Reasonerscited by 214
  2. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  3. 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
  4. 2025Measuring AI Ability to Complete Long Software Taskscited by 142
  5. 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 95
  6. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoningcited by 68
  7. 2025WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Modelcited by 56
  8. 2025Self-Challenging Language Model Agentscited by 56
  9. 2024Self-Consistency Preference Optimizationcited by 50
  10. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 46
  11. 2025A Survey on the Optimization of Large Language Model-based Agentscited by 45
  12. 2026Endless Terminals: Scaling RL Environments for Terminal Agentscited by 43
  13. 2025VisPlay: Self-Evolving Vision-Language Models from Imagescited by 42
  14. 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 34
  15. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Userscited by 32
  16. 2025SWE-Bench++: A Framework for the Scalable Generation of Software Engineering Benchmarks from Open-Source Repositoriescited by 27
  17. 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environmentscited by 27
  18. 2026InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent Trainingcited by 26
  19. 2026TermiGen: High-Fidelity Environment and Robust Trajectory Synthesis for Terminal Agentscited by 24
  20. 2026Tmax: A simple recipe for terminal agentscited by 24
  21. 2026ScaleEnv: Scaling Environment Synthesis from Scratch for Generalist Interactive Tool-Use Agent Trainingcited by 23
  22. 2026AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State Machinescited by 20
  23. 2026Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Gradingcited by 20
  24. 2026SWE-Marathon: Can Agents Autonomously Complete Ultra-Long-Horizon Software Work?cited by 19
  25. 2025LLMs as Scalable, General-Purpose Simulators For Evolving Digital Agent Trainingcited by 17
  26. 2026MM-Zero: Self-Evolving Multi-Model Vision Language Models From Zero Datacited by 16
  27. 2025Training Versatile Coding Agents in Synthetic Environmentscited by 13
  28. 2026A Self-Evolving Framework for Efficient Terminal Agents via Observational Context Compressioncited by 12
  29. 2026Autodata: An agentic data scientist to create high quality synthetic datacited by 12
  30. 2026Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editablecited by 12
  31. 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agentscited by 7
  32. 2025Towards Self-Evolving Benchmarks: Synthesizing Agent Trajectories via Test-Time Exploration under Validate-by-Reproduce Paradigmcited by 5
  33. 2026Less is Enough: Synthesizing Diverse Data in LLM Feature Space with Sparse Autoencoderscited by 5
  34. 2026Stale but Stable: Staleness-Adaptive Trust Regions for Stabilizing Asynchronous Reinforcement Learningcited by 5
  35. 2026BenchEvolver: Frontier Task Synthesis via Solution-Centric Evolutioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training
  2. 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills
  3. 2026FACET: Preserving Source Intent and Executable State in Terminal Task Synthesis
  4. 2026Toward Scalable Terminal Task Synthesis via Skill Graphs
  5. 2026SKT: Skill-Use Training at Scale via Verified Synthetic Data Generation
  6. 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agents
  7. 2026SETA: Scaling Environments for Terminal Agents
  8. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents