mlsanityData to 7 Oct 2026

Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent

arXiv 2606.30616 ↗First posted 29 Jun 2026cs.CLcited by 16

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

also in 1 more
Abstract (arXiv)

We introduce Agents-A1, a 35B Mixture-of-Experts Agentic Model that reaches trillion-parameter-level performance by scaling the agent horizon. We investigate agent-horizon scaling from two perspectives: scaling long-horizon trajectories and scaling heterogeneous agent abilities. To support this goal, we build a long-horizon knowledge-action infrastructure that connects external knowledge, actions, observations, and verifier outcomes, producing agentic trajectories with an average length of 45K tokens. Based on this, we train Agents-A1 with a three-stage recipe. First, we perform full-domain supervised fine-tuning to align the base model with broad agentic behaviors. Second, we train domain-level teacher models to capture specialized expertise in each domain. Third, we propose a multi-teacher domain-routed on-policy distillation with salient vocabulary alignment to improve knowledge transfer efficiency across different domains, unifying six heterogeneous domains into one deployable student model. Agents-A1 achieves strong and broad performance for long-horizon agent benchmarks. Compared with 1T-parameter model such as Kimi-K2.6 and DeepSeek-V4-pro, Agents-A1 achieves leading results on SEAL-0 (56.4), IFBench (80.6), HiPhO (46.4), FrontierScience-Olympiad (79.0), and MolBench-Bind (56.8), and remains highly competitive on SciCode (44.3), HLE (47.6) and BrowseComp (75.5). We hope this work provides the community with a practical path for scaling the horizon using a 35B agent that can reach or match the performance of 1T models on long-horizon tasks.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 29 of its 41 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

29 of 41 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications30 Sep

Other references · 28

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  3. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  4. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  5. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  6. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  7. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
  8. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  9. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
  10. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  11. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
  12. 2015Policy Distillationcited by 414
16 more
  1. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
  2. 2025Generalizing Verifiable Instruction Followingcited by 178
  3. 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
  4. 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
  5. 2026Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixescited by 122
  6. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 118
  7. 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 87
  8. 2025SealQA: Raising the Bar for Reasoning in Search-Augmented Language Modelscited by 65
  9. 2025MLE-Dojo: Interactive Environments for Empowering LLM Agents in Machine Learning Engineeringcited by 38
  10. 2026MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discoverycited by 20
  11. 2025HiPhO: How Far Are (M)LLMs from Humans in the Latest High School Physics Olympiad Benchmark?cited by 18
  12. 2025MatTools: Benchmarking Large Language Models for Materials Science Toolscited by 11
  13. 2026Towards Long-horizon Agentic Multimodal Searchcited by 9
  14. 2026PAPO: Stabilizing Rubric Integration Training via Decoupled Advantage Normalizationcited by 8
  15. 2026MolClaw: An Autonomous Agent with Hierarchical Skills for Drug Molecule Evaluation, Screening, and Optimizationcited by 6
  16. 2026Agents-K1: Towards Agent-native Knowledge Orchestrationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards a Science of Scaling Agent Systems
  2. 2026Scaling Laws for Educational AI Agents
  3. 2025AgentDistill: Training-Free Agent Distillation with Generalizable MCP Boxes
  4. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence
  5. 2026ASTER: Agentic Scaling with Tool-integrated Extended Reasoning
  6. 2025Single-Agent Scaling Fails Multi-Agent Intelligence: Towards Foundation Models with Native Multi-Agent Intelligence
  7. 2025Structured Agent Distillation for Large Language Model
  8. 2025Klear-AgentForge: Forging Agentic Intelligence through Posttraining Scaling