AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoning
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Recent progress on long-horizon agentic tasks has been driven largely by scaling up individual agents through stronger models, better tools, and more effective scaffolding. In contrast, much less is understood about scaling out: whether multiple peer agents, all targeting the same task, can become an additional source of capability without relying on explicit role specialization or workflow orchestration. We study this question and propose AgentFugue, a collective reasoning framework built around a shared reasoning hub. As peer agents explore the same task in parallel, the hub records concise notes on what each agent has established, attempted, or ruled out, and enables each agent to selectively access what other agents have discovered in a form useful for its current search. This design turns otherwise isolated trajectories into a connected ecology of reusable intermediate reasoning without requiring centralized planning. We instantiate the hub as a plug-in communication layer, trained with supervised fine-tuning and end-to-end reinforcement learning. Across the challenging long-horizon settings we study, AgentFugue improves over strong baselines. Our results suggest that collective reasoning can turn scaling out peer agent systems into a distinct source of capability gains, rather than merely a way of spending more compute.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 55 of its 63 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
55 of 63 references.
Closest ancestors · 8
Same direction, newest first
- 2026Agentic Aggregation for Parallel Scaling of Long-Horizon Agentic Tasks13 Apr
- 2024Scaling Large Language Model-based Multi-Agent Collaboration11 Jun
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2024More Agents Is All You Need3 Feb
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration3 Oct
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 47
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
35 more
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2025s1: Simple test-time scalingcited by 1,311
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
- 2024AFlow: Automating Agentic Workflow Generationcited by 395
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 320
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
- 2025Memory in the Age of AI Agentscited by 285
- 2025DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environmentscited by 268
- 2025WebSailor: Navigating Super-human Reasoning for Web Agentcited by 218
- 2025WebDancer: Towards Autonomous Information Seeking Agencycited by 180
- 2024FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Researchcited by 165
- 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 163
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
- 2025ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarizationcited by 132
- 2025AgentFold: Long-Horizon Web Agents with Proactive Context Managementcited by 95
- 2025WideSearch: Benchmarking Agentic Broad Info-Seekingcited by 66
- 2025WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agentscited by 66
- 2025The Majority is not always right: RL training for solution aggregationcited by 46
- 2025Learning to Reason Across Parallel Samples for LLM Reasoningcited by 32
- 2026Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoningcited by 17
- 2025ParallelMuse: Agentic Parallel Thinking for Deep Information Seekingcited by 14
- 2026MemoBrain: Executive Memory as an Agentic Brain for Reasoningcited by 12
- 2026AgentSwing: Adaptive Parallel Context Management Routing for Long-Horizon Web Agentscited by 9
- 2026MemSifter: Offloading LLM Memory Retrieval via Outcome-Driven Proxy Reasoningcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
- 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs
- 2025SwarmSys: Decentralized Swarm-Inspired Agents for Scalable and Adaptive Reasoning
- 2025Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning
- 2026Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- 2025Towards a Science of Scaling Agent Systems
- 2026Learning to Share: Selective Memory for Efficient Parallel Agentic Systems
- 2025Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMs