Sakana Fugu Technical Report
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The capabilities of frontier Large Language Models (LLMs) continue to advance, with different providers increasingly specializing in distinct domains. This raises a natural next objective: how to combine the individual specializations of various LLMs into a collectively intelligent system. To this end, we report the development of Sakana Fugu, a family of orchestrator models that harness and amplify the capabilities of an LLM agent team. Fugu models are themselves language models trained to understand user queries and dynamically devise agentic scaffolds to solve them. Through these adaptive scaffolds, Fugu accesses performance beyond any individual LLM agent, achieving state-of-the-art results compared to other publicly accessible models across a range of challenging tasks, including SWE-Bench Pro, Terminal Bench, LiveCodeBench, GPQA-Diamond, Humanity's Last Exam, and CharXiv Reasoning. We release two models: Fugu, which balances performance with latency for everyday use, and Fugu-Ultra, which prioritizes answer quality on the hardest problems. We describe our training paradigm, which encompasses large-scale fine-tuning, evolutionary algorithms, and reinforcement learning approaches, along with the infrastructure and core design principles that turn these methods into a production system. We hope this report encourages further research into multi-agent systems and dynamic, query-adaptive agentic scaffolds as a path toward the next frontier of AI capabilities, accessed through collective intelligence.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 40 of its 66 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
40 of 66 references.
Closest ancestors · 5
Same direction, newest first
- 2025Learning to Orchestrate Agents in Natural Language with the Conductor4 Dec
- 2025Multi-Agent Collaboration via Evolving Orchestration26 May
- 2025MasRouter: Learning to Route LLMs for Multi-Agent Systems16 Feb
- 2024Automated Design of Agentic Systems15 Aug
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
Other references · 35
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
23 more
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
- 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 243
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
- 2024Tool Learning with Large Language Models: A Surveycited by 223
- 2021Revisiting Model Stitching to Compare Neural Representationscited by 209
- 2024Evolutionary Optimization of Model Merging Recipescited by 208
- 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
- 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
- 2024Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queriescited by 88
- 2024RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Modelscited by 88
- 2025Sequential Diagnosis with Language Modelscited by 60
- 2025LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?cited by 55
- 2021Collective Intelligence for Deep Learning: A Survey of Recent Developmentscited by 34
- 2024Smoothie: Label Free Language Model Routingcited by 31
- 2025Transformer-Squared: Self-adaptive LLMscited by 16
- 2025TRINITY: An Evolved LLM Coordinatorcited by 5
- 2026Retrieval Augmented Conversational Recommendation with Reinforcement Learningcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Recursive Harness Self-Improvementcited by 32
- 2026Recursive Self-Improvement through Multi-Agent Self-Supervisioncited by 1
- 2026Evaluating SageMath-Augmented LLM Agents for Computational and Experimental Mathematicscited by 0
- 2026Multi-Agent Debate and Visual Information Extraction for SeePhys Pro: A 1st-Place Technical Report from ICML 2026 AI4Math Track 3 Challengecited by 0
- 2026Recursive Self-Improvement through Multi-Agent Self-Supervision8 Oct 2026
- 2026Multi-Agent Debate and Visual Information Extraction for SeePhys Pro: A 1st-Place Technical Report from ICML 2026 AI4Math Track 3 Challenge24 Jul 2026
- 2026Recursive Harness Self-Improvement17 Jul 2026
- 2026Evaluating SageMath-Augmented LLM Agents for Computational and Experimental Mathematics7 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges
- 2024LLMArena: Assessing Capabilities of Large Language Models in Dynamic Multi-Agent Environments
- 2024MMAU: A Holistic Benchmark of Agent Capabilities Across Diverse Domains
- 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineer
- 2026OpenSeeker-v2: Pushing the Limits of Search Agents with Informative and High-Difficulty Trajectories
- 2023The Rise and Potential of Large Language Model Based Agents: A Survey
- 2024Offline Training of Language Model Agents with Functions as Learnable Weights
- 2026A Scoping Review of Large Language Model-Based Pedagogical Agents