mlsanityData to 7 Oct 2026

NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMs

arXiv 2607.14186 ↗First posted 15 Jul 2026cs.SE cs.AI cs.LGcited by 4

On the map: LLM agents and tool use → Agent skill learning and evolution

Abstract (arXiv)

Scaling executable agent training data for LLM post-training is bottlenecked by substrate-bound methods that tie task generation to predefined tools, repositories, or skill graphs: expanding coverage requires manual substrate engineering, each new domain demands a bespoke pipeline, and the resulting task distributions often reflect substrate biases rather than real-world demand. We introduce NexForge, a requirement-driven framework that takes high-level capability requirements as input and synthesizes diverse, executable agent tasks and expert trajectories for SFT. NexForge first investigates real-world demand to construct scenarios and task profiles, then performs distribution-aware compilation to generate task directives. For each directive, NexForge automatically retrieves or constructs the required files, dependencies, and runtime configurations, and finally collects expert rollouts to produce training trajectories. Without domain-specific infrastructure, NexForge produces 3.6K terminal and 2K office tasks, improving Qwen3.5-35B-A3B Base from 22.5% to 52.0% on Terminal-Bench 2.0 and from 813 to 1338 Elo on GDPval; scaling further to 43.2K terminal tasks yields 58.4%, on par with Claude Opus 4.6 equipped with Claude Code. Scaled further, NexForge-synthesized data contributes to the training of Nex-N2, a family of publicly available agent models that lift Qwen3.5-397B-A17B to 75.3% on Terminal-Bench 2.1 and to 1585 Elo on GDPval---achieving state-of-the-art open-source performance and surpassing several frontier proprietary systems. Nex-N2 models are available at https://nex.sii.edu.cn/.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 23 of its 32 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

23 of 32 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills20 May

Other references · 22

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  3. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  4. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  5. 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
  6. 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
  7. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 142
  8. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 140
  9. 2024Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Modelscited by 99
  10. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 51
  11. 2025TaskCraft: Automated Generation of Agentic Taskscited by 46
  12. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 41
10 more
  1. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 35
  2. 2026On Data Engineering for Scaling LLM Terminal Capabilitiescited by 34
  3. 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environmentscited by 27
  4. 2026Toward Scalable Terminal Task Synthesis via Skill Graphscited by 16
  5. 2026DIVE: Scaling Diversity in Agentic Task Synthesis for Generalizable Tool Usecited by 9
  6. 2026Task-Aware LLM Routing with Multi-Level Task-Profile-Guided Data Synthesis for Cold-Start Scenarioscited by 8
  7. 2026OpenThoughts-Agent: Data Recipes for Agentic Modelscited by 8
  8. 2026LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agentscited by 7
  9. 2026CLI-Universe: Towards Verifiable Task Synthesis Engine for Terminal Agentscited by 7
  10. 2026Benchmark Everything Everywhere All at Oncecited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generation
  2. 2026SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents
  3. 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale
  4. 2026GraSP: Graph-Structured Skill Compositions for LLM Agents
  5. 2026A Framework for Evaluating Agentic Skills at Scale
  6. 2026SkillsInjector: Dynamic Skill Context Construction for LLM Agents
  7. 2026SkillFocus: Evolving Agent Skills via Capability Decomposition
  8. 2026A Lightweight Modular Framework for Constructing Autonomous Agents Driven by Large Language Models: Design, Implementation, and Applications in AgentForge