Brain-Inspired Graph Multi-Agent Systems for LLM Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of language tasks, yet complex multi-step reasoning remains a fundamental challenge. While Large Reasoning Models (LRMs) equipped with extended chain-of-thought mechanisms demonstrate improved performance over standard LLMs, both model types still suffer from accuracy collapse on sufficiently complex tasks, suggesting that scaling model-level reasoning alone is insufficient. Inspired by the global workspace theory of human cognition, we propose Brain-Inspired Graph Multi-Agent Systems (BIGMAS), in which specialized LLM agents are organized as nodes in a dynamically constructed directed graph and coordinate exclusively through a centralized shared workspace. A problem-adaptive GraphDesigner constructs task-specific agent topologies, while a global Orchestrator leverages the complete shared state for routing decisions, overcoming the local-view bottleneck of reactive approaches. Experiments on Game24, Six Fives, and Tower of London across six frontier LLMs demonstrate that BIGMAS consistently improves reasoning performance for both standard LLMs and LRMs, outperforming existing multi-agent baselines including ReAct and Tree of Thoughts, showing that multi-agent architectural design provides complementary gains orthogonal to model-level reasoning enhancements.
Key facts. Cited by 6 papers in the map (data through 13 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 52 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
20 of 52 references.
Closest ancestors · 3
Same direction, newest first
- 2025Beyond ReAct: A Planner-Centric Framework for Complex Tool-Augmented LLM Reasoning13 Nov
- 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Review28 Apr
- 2024OpenAI o1 System Card21 Dec
Other references · 17
- 2021Training Verifiers to Solve Math Word Problemscited by 9,916
- 2021Evaluating Large Language Models Trained on Codecited by 8,205
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,270
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,904
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,404
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,242
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,066
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 300
- 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 284
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 192
5 more
- 2024Self-Reflection in LLM Agents: Effects on Problem-Solving Performancecited by 39
- 2025The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learningcited by 30
- 2025Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarkscited by 27
- 2025Evolving LLMs' Self-Refinement Capability via Synergistic Training-Inference Optimizationcited by 16
- 2025A Stitch in Time Saves Nine: Proactive Self-Refinement for Language Modelscited by 4
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Designcited by 9
- 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systemscited by 6
- 2026Co-Evolving Skill Generation and Policy Optimizationcited by 6
- 2026Biological Motifs for Agentic Controlcited by 0
- 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systemscited by 0
- 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learningcited by 0
- 2026MAGIC: Mixed-Granularity Agent Graphs via Incremental Construction with Dense-Reward Reinforcement Learning22 Sep 2026
- 2026OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems18 Sep 2026
- 2026Biological Motifs for Agentic Control5 Jul 2026
- 2026From Question Answering to Task Completion: A Survey on Agent System and Harness Design14 Jun 2026
- 2026Co-Evolving Skill Generation and Policy Optimization7 Jun 2026
- 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs
- 2026AdaSTORM: Scaling LLM Reasoning on Dynamic Graphs via Adaptive Spatio-Temporal Multi-Agent Collaboration
- 2026GraphMAS: A Systematic Benchmark of Multi-Agent Coordination for Graph Learning
- 2025Unleashing Diverse Thinking Modes in LLMs through Multi-Agent Collaboration
- 2024Scalable and Accurate Graph Reasoning with LLM-based Multi-Agents
- 2025Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research
- 2025AMAS: Adaptively Determining Communication Topology for LLM-based Multi-Agent System
- 2025Scaling Graph Chain-of-Thought Reasoning: A Multi-Agent Framework with Efficient LLM Serving