Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
We introduce Agents-A1, a 35B Mixture-of-Experts Agentic Model that reaches trillion-parameter-level performance by scaling the agent horizon. We investigate agent-horizon scaling from two perspectives: scaling long-horizon trajectories and scaling heterogeneous agent abilities. To support this goal, we build a long-horizon knowledge-action infrastructure that connects external knowledge, actions, observations, and verifier outcomes, producing agentic trajectories with an average length of 45K tokens. Based on this, we train Agents-A1 with a three-stage recipe. First, we perform full-domain supervised fine-tuning to align the base model with broad agentic behaviors. Second, we train domain-level teacher models to capture specialized expertise in each domain. Third, we propose a multi-teacher domain-routed on-policy distillation with salient vocabulary alignment to improve knowledge transfer efficiency across different domains, unifying six heterogeneous domains into one deployable student model. Agents-A1 achieves strong and broad performance for long-horizon agent benchmarks. Compared with 1T-parameter model such as Kimi-K2.6 and DeepSeek-V4-pro, Agents-A1 achieves leading results on SEAL-0 (56.4), IFBench (80.6), HiPhO (46.4), FrontierScience-Olympiad (79.0), and MolBench-Bind (56.8), and remains highly competitive on SciCode (44.3), HLE (47.6) and BrowseComp (75.5). We hope this work provides the community with a practical path for scaling the horizon using a 35B agent that can reach or match the performance of 1T models on long-horizon tasks.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 29 of its 41 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
29 of 41 references.
Closest ancestors · 1
Same direction, newest first
- 2025VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications30 Sep
Other references · 28
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
- 2015Policy Distillationcited by 414
16 more
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
- 2025Generalizing Verifiable Instruction Followingcited by 178
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
- 2026Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixescited by 122
- 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 118
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 87
- 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 65
- 2025MLE-Dojo: Interactive Environments for Empowering LLM Agents in Machine Learning Engineeringcited by 38
- 2026MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discoverycited by 20
- 2025HiPhO: How Far Are (M)LLMs from Humans in the Latest High School Physics Olympiad Benchmark?cited by 18
- 2025MatTools: Benchmarking Large Language Models for Materials Science Toolscited by 11
- 2026Towards Long-horizon Agentic Multimodal Searchcited by 9
- 2026PAPO: Stabilizing Rubric Integration Training via Decoupled Advantage Normalizationcited by 8
- 2026MolClaw: An Autonomous Agent with Hierarchical Skills for Drug Molecule Evaluation, Screening, and Optimizationcited by 6
- 2026Agents-K1: Towards Agent-native Knowledge Orchestrationcited by 3
Built on by
Citing papers per year: 2026: 16.
16 papers.
Sort:
By area:
- 2026Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillationcited by 12
- 2026The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic Distillationcited by 3
- 2026Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-workcited by 3
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 1
- 2026Proxy OPD: On-Policy Distillation with Transferable Relative Proxy Updatecited by 0
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applicationscited by 0
- 2026GraphRareBench: An Auditable Graph-Evidence Benchmark for Phenotype-Driven Rare-Disease Diagnosiscited by 0
- 2026SeekBrain: An Autonomous Multi-Agent System for Accelerating Neuroscience Discoverycited by 0
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0
- 2026Iris: Climbing to the Search Frontiercited by 0
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solvingcited by 0
- 2026CompoWorld: Compositional Environment Scaling for General Agentscited by 0
4 more
- 2026WorkGenesis: Building the Worlds That Teach Agents to Workcited by 0
- 2026How Much of a Harness Does a Strong Agent Need for Autonomous ML Engineering?cited by 0
- 2026From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillationcited by 0
- 2026SAIL: Scientific Agentic Intelligence via a Science-Aware Loopcited by 0
- 2026SAIL: Scientific Agentic Intelligence via a Science-Aware Loop8 Oct 2026
- 2026From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation1 Oct 2026
- 2026How Much of a Harness Does a Strong Agent Need for Autonomous ML Engineering?30 Sep 2026
- 2026WorkGenesis: Building the Worlds That Teach Agents to Work30 Sep 2026
- 2026CompoWorld: Compositional Environment Scaling for General Agents27 Sep 2026
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solving23 Sep 2026
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness8 Sep 2026
- 2026Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-work4 Sep 2026
- 2026Iris: Climbing to the Search Frontier3 Sep 2026
- 2026Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation19 Aug 2026
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Models17 Aug 2026
- 2026SeekBrain: An Autonomous Multi-Agent System for Accelerating Neuroscience Discovery31 Jul 2026
4 more
- 2026GraphRareBench: An Auditable Graph-Evidence Benchmark for Phenotype-Driven Rare-Disease Diagnosis27 Jul 2026
- 2026The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic Distillation27 Jul 2026
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applications25 Jul 2026
- 2026Proxy OPD: On-Policy Distillation with Transferable Relative Proxy Update13 Jul 2026
- 2026Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-workcited by 3
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harnesscited by 1
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applicationscited by 0
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0
- 2026WorkGenesis: Building the Worlds That Teach Agents to Workcited by 0
- 2026How Much of a Harness Does a Strong Agent Need for Autonomous ML Engineering?cited by 0
- 2026How Much of a Harness Does a Strong Agent Need for Autonomous ML Engineering?30 Sep 2026
- 2026WorkGenesis: Building the Worlds That Teach Agents to Work30 Sep 2026
- 2026NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness8 Sep 2026
- 2026Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-work4 Sep 2026
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Models17 Aug 2026
- 2026AgentOmnia: Scaling Agentic Models for Full-Scenario Applications25 Jul 2026
- 2026Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillationcited by 12
- 2026Proxy OPD: On-Policy Distillation with Transferable Relative Proxy Updatecited by 0
- 2026GraphRareBench: An Auditable Graph-Evidence Benchmark for Phenotype-Driven Rare-Disease Diagnosiscited by 0
- 2026SeekBrain: An Autonomous Multi-Agent System for Accelerating Neuroscience Discoverycited by 0
- 2026Iris: Climbing to the Search Frontiercited by 0
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solvingcited by 0
- 2026CompoWorld: Compositional Environment Scaling for General Agentscited by 0
- 2026From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillationcited by 0
- 2026SAIL: Scientific Agentic Intelligence via a Science-Aware Loopcited by 0
- 2026SAIL: Scientific Agentic Intelligence via a Science-Aware Loop8 Oct 2026
- 2026From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation1 Oct 2026
- 2026CompoWorld: Compositional Environment Scaling for General Agents27 Sep 2026
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solving23 Sep 2026
- 2026Iris: Climbing to the Search Frontier3 Sep 2026
- 2026Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation19 Aug 2026
- 2026SeekBrain: An Autonomous Multi-Agent System for Accelerating Neuroscience Discovery31 Jul 2026
- 2026GraphRareBench: An Auditable Graph-Evidence Benchmark for Phenotype-Driven Rare-Disease Diagnosis27 Jul 2026
- 2026Proxy OPD: On-Policy Distillation with Transferable Relative Proxy Update13 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Towards a Science of Scaling Agent Systems
- 2026Scaling Laws for Educational AI Agents
- 2025AgentDistill: Training-Free Agent Distillation with Generalizable MCP Boxes
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence
- 2026ASTER: Agentic Scaling with Tool-integrated Extended Reasoning
- 2025Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligence
- 2025Structured Agent Distillation for Large Language Model
- 2025Klear-AgentForge: Forging Agentic Intelligence through Posttraining Scaling