AgentFrontier: Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
Training large language model agents on tasks at the frontier of their capabilities is key to unlocking advanced reasoning. We introduce a data synthesis approach inspired by the educational theory of the Zone of Proximal Development (ZPD), which defines this frontier as tasks an LLM cannot solve alone but can master with guidance. To operationalize this, we present the AgentFrontier Engine, an automated pipeline that synthesizes high-quality, multidisciplinary data situated precisely within the LLM's ZPD. This engine supports both continued pre-training with knowledge-intensive data and targeted post-training on complex reasoning tasks. From the same framework, we derive the ZPD Exam, a dynamic and automated benchmark designed to evaluate agent capabilities on these frontier tasks. We train AgentFrontier-30B-A3B model on our synthesized data, which achieves state-of-the-art results on demanding benchmarks like Humanity's Last Exam, even surpassing some leading proprietary agents. Our work demonstrates that a ZPD-guided approach to data synthesis offers a scalable and effective path toward building more capable LLM agents.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 47 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
36 of 47 references.
Closest ancestors · 3
Same direction, newest first
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
- 2025TaskCraft: Automated Generation of Agentic Tasks11 Jun
- 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environments18 Jan
Other references · 33
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
21 more
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2025Humanity's Last Examcited by 491
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
- 2024Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Datasetcited by 160
- 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 121
- 2024Knowledge Fusion of Large Language Modelscited by 115
- 2025NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questionscited by 84
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 68
- 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoningcited by 59
- 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 50
- 2024JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Modelscited by 45
- 2024Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verificationcited by 45
- 2025R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluationcited by 34
- 2024DataGen: Unified Synthetic Dataset Generation via Large Language Modelscited by 23
- 2025Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems?cited by 15
- 2024Montessori-Instruct: Generate Influential Training Data Tailored for Student Learningcited by 13
- 2025How to Get Your LLM to Generate Challenging Problems for Evaluationcited by 11
Built on by
Citing papers per year: 2025: 2; 2026: 12.
14 papers.
Sort:
By area:
- 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scalingcited by 23
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Taskscited by 8
- 2025SciAgent: A Unified Multi-Agent System for Generalistic Scientific Reasoningcited by 7
- 2026Learning with Challenges: Adaptive Difficulty-Aware Data Generation for Mobile GUI Agent Trainingcited by 4
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 3
- 2026RAGShaper: Eliciting Sophisticated Agentic RAG Skills via Automated Data Synthesiscited by 1
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoningcited by 1
- 2026CuSearch: Curriculum Rollout Sampling via Search Depth for Agentic RAGcited by 1
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Designcited by 1
- 2026Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chainscited by 0
- 2026Tracking the Moving Frontier: Long-Short Term Advantage Estimatorcited by 0
- 2026Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards13 Oct 2026
- 2026BoundaryEvo: Data-Model Co-Evolution at the Capability Boundary for Long-Chain Reasoning Distillation9 Oct 2026
- 2026Tracking the Moving Frontier: Long-Short Term Advantage Estimator6 Sep 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design10 Aug 2026
- 2026CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Tasks6 Aug 2026
- 2026Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains20 Jul 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026CuSearch: Curriculum Rollout Sampling via Search Depth for Agentic RAG12 May 2026
- 2026Learning with Challenges: Adaptive Difficulty-Aware Data Generation for Mobile GUI Agent Training30 Jan 2026
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning23 Jan 2026
- 2026RAGShaper: Eliciting Sophisticated Agentic RAG Skills via Automated Data Synthesis13 Jan 2026
- 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scalingcited by 23
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Learning with Challenges: Adaptive Difficulty-Aware Data Generation for Mobile GUI Agent Trainingcited by 4
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agentscited by 3
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Designcited by 1
- 2026Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewardscited by 0
- 2026Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards13 Oct 2026
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents27 Aug 2026
- 2026Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design10 Aug 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Learning with Challenges: Adaptive Difficulty-Aware Data Generation for Mobile GUI Agent Training30 Jan 2026
- 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scaling10 Nov 2025
- 2025SciAgent: A Unified Multi-Agent System for Generalistic Scientific Reasoningcited by 7
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoningcited by 1
- 2026Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chainscited by 0
- 2026BoundaryEvo: Data-Model Co-Evolution at the Capability Boundary for Long-Chain Reasoning Distillationcited by 0
- 2026BoundaryEvo: Data-Model Co-Evolution at the Capability Boundary for Long-Chain Reasoning Distillation9 Oct 2026
- 2026Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains20 Jul 2026
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning23 Jan 2026
- 2025SciAgent: A Unified Multi-Agent System for Generalistic Scientific Reasoning11 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training
- 2024AgentQuest: A Modular Benchmark Framework to Measure Progress and Improve LLM Agents
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
- 2024Enhancing the General Agent Capabilities of Low-Parameter LLMs through Tuning and Multi-Branch Reasoning
- 2023AgentBench: Evaluating LLMs as Agents
- 2026Exploring Autonomous Agentic Data Engineering for Model Specialization
- 2025Distilling LLM Agent into Small Models with Retrieval and Code Tools
- 2026AgentArk: Distilling Multi-Agent Intelligence into a Single LLM Agent