mlsanityData to 14 Oct 2026

AgentFrontier: Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis

arXiv 2510.24695 ↗First posted 28 Oct 2025cs.CLcited by 14

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

also in 1 more
Abstract (arXiv)

Training large language model agents on tasks at the frontier of their capabilities is key to unlocking advanced reasoning. We introduce a data synthesis approach inspired by the educational theory of the Zone of Proximal Development (ZPD), which defines this frontier as tasks an LLM cannot solve alone but can master with guidance. To operationalize this, we present the AgentFrontier Engine, an automated pipeline that synthesizes high-quality, multidisciplinary data situated precisely within the LLM's ZPD. This engine supports both continued pre-training with knowledge-intensive data and targeted post-training on complex reasoning tasks. From the same framework, we derive the ZPD Exam, a dynamic and automated benchmark designed to evaluate agent capabilities on these frontier tasks. We train AgentFrontier-30B-A3B model on our synthesized data, which achieves state-of-the-art results on demanding benchmarks like Humanity's Last Exam, even surpassing some leading proprietary agents. Our work demonstrates that a ZPD-guided approach to data synthesis offers a scalable and effective path toward building more capable LLM agents.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 47 references that are in the map. First posted on arXiv 28 Oct 2025.

Builds on

36 of 47 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
  2. 2025TaskCraft: Automated Generation of Agentic Tasks11 Jun
  3. 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environments18 Jan

Other references · 33

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  7. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  8. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  9. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  10. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  11. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  12. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
21 more
  1. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  2. 2025Humanity's Last Examcited by 491
  3. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 433
  4. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  5. 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 229
  6. 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 188
  7. 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
  8. 2024Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Datasetcited by 160
  9. 2025WebShaper: Agentically Data Synthesizing via Information-Seeking Formalizationcited by 121
  10. 2024Knowledge Fusion of Large Language Modelscited by 115
  11. 2025NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questionscited by 84
  12. 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 68
  13. 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoningcited by 59
  14. 2025SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyondcited by 50
  15. 2024JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Modelscited by 45
  16. 2024Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verificationcited by 45
  17. 2025R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluationcited by 34
  18. 2024DataGen: Unified Synthetic Dataset Generation via Large Language Modelscited by 23
  19. 2025Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems?cited by 15
  20. 2024Montessori-Instruct: Generate Influential Training Data Tailored for Student Learningcited by 13
  21. 2025How to Get Your LLM to Generate Challenging Problems for Evaluationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 12.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Hephaestus: Improving Fundamental Agent Capabilities of Large Language Models through Continual Pre-Training
  2. 2024AgentQuest: A Modular Benchmark Framework to Measure Progress and Improve LLM Agents
  3. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
  4. 2024Enhancing the General Agent Capabilities of Low-Parameter LLMs through Tuning and Multi-Branch Reasoning
  5. 2023AgentBench: Evaluating LLMs as Agents
  6. 2026Exploring Autonomous Agentic Data Engineering for Model Specialization
  7. 2025Distilling LLM Agent into Small Models with Retrieval and Code Tools
  8. 2026AgentArk: Distilling Multi-Agent Intelligence into a Single LLM Agent