SwarmSys: Decentralized Swarm-Inspired Agents for Scalable and Adaptive Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Large language model (LLM) agents have shown remarkable reasoning abilities. However, existing multi-agent frameworks often rely on fixed roles or centralized control, limiting scalability and adaptability in long-horizon reasoning. We introduce SwarmSys, a closed-loop framework for distributed multi-agent reasoning inspired by swarm intelligence. Coordination in SwarmSys emerges through iterative interactions among three specialized roles, Explorers, Workers, and Validators, that continuously cycle through exploration, exploitation, and validation. To enable scalable and adaptive collaboration, we integrate adaptive agent and event profiles, embedding-based probabilistic matching, and a pheromone-inspired reinforcement mechanism, supporting dynamic task allocation and self-organizing convergence without global supervision. Across symbolic reasoning, research synthesis, and scientific programming tasks, SwarmSys consistently outperforms baselines, improving both accuracy and reasoning stability. These findings highlight swarm-inspired coordination as a promising paradigm for scalable, robust, and adaptive multi-agent reasoning, suggesting that coordination scaling may rival model scaling in advancing LLM intelligence.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 25 of its 30 references that are in the map. First posted on arXiv 11 Oct 2025.
Builds on
25 of 30 references.
Closest ancestors · 2
Same direction, newest first
- 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May
Other references · 23
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2024GPT-4o System Cardcited by 4,467
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Modelscited by 277
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 236
11 more
- 2023Evaluating the Performance of Large Language Models on GAOKAO Benchmarkcited by 182
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
- 2025Deep Research Agents: A Systematic Examination And Roadmapcited by 122
- 2024AgentScope: A Flexible yet Robust Multi-Agent Platformcited by 120
- 2024Language Agents as Optimizable Graphscited by 81
- 2025Robin: A multi-agent system for automating scientific discoverycited by 57
- 2025AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agentscited by 49
- 2024LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaborationcited by 38
- 2024AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systemscited by 20
- 2025SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligencecited by 17
- 2025MedMMV: A Controllable Multimodal Multi-Agent Framework for Reliable and Verifiable Clinical Reasoningcited by 8
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Harnessing LLM Agents with Skill Programscited by 7
- 2026Weak-Link Optimization for Multi-Agent Reasoning and Collaborationcited by 1
- 2026When Does Memory Help Multi-Trajectory Inference for Tool-Use LLM Agents?cited by 1
- 2026Reinforcement Learning of Communication in a Mesh of Small Language Modelscited by 0
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarmscited by 0
- 2026Waggle: Learning One Anonymous Local Law for Self-Organizing LLM Swarms28 Sep 2026
- 2026Reinforcement Learning of Communication in a Mesh of Small Language Models24 Sep 2026
- 2026When Does Memory Help Multi-Trajectory Inference for Tool-Use LLM Agents?27 May 2026
- 2026Harnessing LLM Agents with Skill Programs18 May 2026
- 2026Weak-Link Optimization for Multi-Agent Reasoning and Collaboration17 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Benchmarking LLMs' Swarm intelligence
- 2025Swarm Intelligence Enhanced Reasoning: A Density-Driven Framework for LLM-Based Multi-Agent Optimization
- 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs
- 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
- 2025The Society of HiveMind: Multi-Agent Optimization of Foundation Model Swarms to Unlock the Potential of Collective Intelligence
- 2026Orchestrating Intelligence: Confidence-Aware Routing for Efficient Multi-Agent Collaboration across Multi-Scale Models
- 2025Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMs
- 2026AgentPSO: Evolving Agent Reasoning Skill via Multi-agent Particle Swarm Optimization