mlsanityData to 14 Oct 2026

Weak-Link Optimization for Multi-Agent Reasoning and Collaboration

arXiv 2604.15972 ↗First posted 17 Apr 2026cs.AI cs.CL cs.MAcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

LLM-driven multi-agent frameworks address complex reasoning tasks through multi-role collaboration. However, existing approaches often suffer from reasoning instability, where individual agent errors are amplified through collaboration, undermining overall performance. Current research mainly focuses on enhancing high-capability agents or suppressing unreliable outputs to improve framework effectiveness, while systematic identification and reinforcement of performance-limiting agents receive less attention. To address this gap, we propose WORC, a underlineweak-link underlineoptimization framework for multi-agent underlinereasoning and underlinecollaboration, grounded in the weak-link principle. WORC follows a two-stage workflow. In the weak agent localization stage, task features are constructed, and a meta-learning-based weight predictor trained on optimal configurations identified by swarm intelligence algorithms (SIAs) enables zero-shot mapping from these features to agent performance weights, where the agent with the lowest predicted weight is identified as the weak agent. In the weak-link optimization stage, an uncertainty-driven allocation strategy assigns additional reasoning budgets to weak agents, with lower predicted weights leading to larger repeated-sampling quotas to compensate for reliability deficiencies. Experimental results show that WORC achieves an average accuracy of 82.2% on reasoning benchmarks while improving framework stability and cross-architecture generalization, suggesting that compensating for weak links, rather than reinforcing strengths alone, enhances the robustness of multi-agent systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 50 of its 64 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

50 of 64 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Rethinking the Reliability of Multi-agent System: A Perspective from Byzantine Fault Tolerance13 Nov
  2. 2025SwarmSys: Decentralized Swarm-Inspired Agents for Scalable and Adaptive Reasoning11 Oct
  3. 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?24 Aug
  4. 2025Society of Mind Meets Real-Time Strategy: A Hierarchical Multi-Agent Framework for Strategic Reasoning8 Aug
  5. 2025Meta-Thinking in LLMs via Multi-Agent Reinforcement Learning: A Survey20 Apr
  6. 2025A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems12 Apr
  7. 2025ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learning12 Mar
  8. 2024AFlow: Automating Agentic Workflow Generation14 Oct
  9. 2024GroupDebate: Enhancing the Efficiency of Multi-Agent Debate Using Group Discussion21 Sep
  10. 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents13 Aug
  11. 2024CoMM: Collaborative Multi-Agent, Multi-Reasoning-Path Prompting for Complex Problem Solving26 Apr
  12. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?28 Feb
1 more
  1. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate30 May

Other references · 37

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  5. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  7. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  9. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  10. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  11. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
  12. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
25 more
  1. 2020Meta-Learning in Neural Networks: A Surveycited by 950
  2. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
  3. 2019Task2Vec: Task Embedding for Meta-Learningcited by 205
  4. 2025Deep Think with Confidencecited by 205
  5. 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
  6. 2024LLM Multi-Agent Systems: Challenges and Open Problemscited by 120
  7. 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoningcited by 110
  8. 2023Large Language Models as Analogical Reasonerscited by 107
  9. 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agentscited by 98
  10. 2025Atom of Thoughts for Markov LLM Test-Time Scalingcited by 54
  11. 2024MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmarkcited by 41
  12. 2025Multi-Agent Coordination across Diverse Applications: A Surveycited by 37
  13. 2024Model Swarms: Collaborative Search to Adapt LLM Experts via Swarm Intelligencecited by 27
  14. 2025RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memorycited by 27
  15. 2024KG4Diagnosis: A Hierarchical Multi-Agent LLM Framework with Knowledge Graph Enhancement for Medical Diagnosiscited by 26
  16. 2025Multi-Agent Autonomous Driving Systems with Large Language Models: A Survey of Recent Advancescited by 21
  17. 2026Learning Global Hypothesis Space for Enhancing Synergistic Reasoning Chaincited by 17
  18. 2025MetaMind: Modeling Human Social Thoughts with Metacognitive Multi-Agent Systemscited by 13
  19. 2023Vector Search with OpenAI Embeddings: Lucene Is All You Needcited by 12
  20. 2026Text summarization via global structure awarenesscited by 12
  21. 2024MAML-en-LLM: Model Agnostic Meta-Training of LLMs for Improved In-Context Learningcited by 10
  22. 2025Social Agent: Mastering Dyadic Nonverbal Behavior Generation via Conversational LLM Agentscited by 8
  23. 2026Experience Transfer for Multimodal LLM Agents in Minecraft Gamecited by 5
  24. 2026Efficient and Interpretable Multi-Agent LLM Routing via Ant Colony Optimizationcited by 3
  25. 2024Towards Unified Task Embeddings Across Multiple Models: Bridging the Gap for Prompt-Based Large Language Models and Beyondcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Guided Collaboration in Heterogeneous LLM-Based Multi-Agent Systems via Entropy-Based Understanding Assessment and Experience Retrieval
  2. 2026Orchestrating Intelligence: Confidence-Aware Routing for Efficient Multi-Agent Collaboration across Multi-Scale Models
  3. 2025Swarm Intelligence Enhanced Reasoning: A Density-Driven Framework for LLM-Based Multi-Agent Optimization
  4. 2025OMAC: A Holistic Optimization Framework for LLM-Based Multi-Agent Collaboration
  5. 2026HELENA:Hierarchical Sparse Coordination over a Union of Complementary Topologies for MAS
  6. 2026GBC: Gradient-Based Connections for Optimizing Multi-Agent Systems
  7. 2026Unifying Temporal and Structural Credit Assignment in LLM-Based Multi-Agent Prompt Optimization
  8. 2026DIANOIA: Diagnostic Decomposition and Joint Optimization for Multi-Agent Reasoning