mlsanityData to 7 Oct 2026

Cooperative Profiles Predict Multi-Agent LLM Team Performance in AI for Science Workflows

arXiv 2604.20658 ↗First posted 22 Apr 2026cs.CL cs.CY cs.MAcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Multi-agent systems built from teams of large language models (LLMs) are increasingly deployed for collaborative scientific reasoning and problem-solving. These systems require agents to coordinate under shared constraints, such as GPUs or credit balances, where cooperative behavior matters. Behavioral economics provides a rich toolkit of games that isolate distinct cooperation mechanisms, yet it remains unknown whether a model's behavior in these stylized settings predicts its performance in realistic collaborative tasks. Here, we benchmark 41 open-weight LLMs across six behavioral economics games and show that game-derived cooperative profiles robustly predict downstream performance in AI-for-Science tasks, where teams of LLM agents collaboratively analyze data, build models, and produce scientific reports under shared budget constraints. Models that effectively coordinate in games and invest in multiplicative team production (rather than greedy strategies) produce better scientific reports across three outcomes, accuracy, quality, and completeness. These associations hold after controlling for multiple factors, indicating that cooperative disposition is a distinct, measurable property of LLMs not reducible to general ability. Our behavioral games framework thus offers a fast diagnostic for screening cooperative fitness before costly multi-agent deployment.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 29 of its 73 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

29 of 73 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas16 Apr
  2. 2025Corrupted by Reasoning: Reasoning Language Models Become Free-Riders in Public Goods Games29 Jun

Other references · 27

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  3. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  4. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  5. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  6. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  7. 2024Phi-4 Technical Reportcited by 675
  8. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
  9. 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 231
  10. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology Viewcited by 221
  11. 2023Playing repeated games with Large Language Modelscited by 213
  12. 2019Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyrocited by 187
15 more
  1. 2020Open Problems in Cooperative AIcited by 167
  2. 2026Towards End-to-End Automation of AI Researchcited by 150
  3. 2023Theory of Mind for Multi-Agent Collaboration via Large Language Modelscited by 129
  4. 2024Emergent social conventions and collective bias in LLM populationscited by 115
  5. 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
  6. 2023MetaAgents: Large Language Model Based Agents for Decision-Making on Teamingcited by 85
  7. 2024How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environmentscited by 66
  8. 2023Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framingcited by 49
  9. 2019Theory of Minds: Understanding Behavior in Groups Through Inverse Planningcited by 30
  10. 2023The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?cited by 22
  11. 2025Emergent Coordination in Multi-Agent Language Modelscited by 22
  12. 2025Accelerating Earth Science Discovery via Multi-Agent LLM Systemscited by 13
  13. 2025FAIRGAME: a Framework for AI Agents Bias Recognition using Game Theorycited by 13
  14. 2025LLM-Hanabi: Evaluating Multi-Agent Gameplays with Theory-of-Mind and Rationale Inference in Imperfect Information Collaboration Gamecited by 8
  15. 2025Drivers of cooperation in social dilemmas on higher-order networkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards a Science of Collective AI: LLM-based Multi-Agent Systems Need a Transition from Blind Trial-and-Error to Rigorous Science
  2. 2026Do LLMs Take Care of Their Own? Similarity Signals Can Induce Cooperation
  3. 2026More Capable, Less Cooperative? When LLMs Fail At Zero-Cost Collaboration
  4. 2026COOP2: Defining, Observing, and Repairing Cooperation in LLM Multi-Agent Systems
  5. 2026MACC: Multi-Agent Collaborative Competition for Scientific Exploration
  6. 2026CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments
  7. 2026Multi-agent Scaling Across Disjunctive and Compensatory Tasks
  8. 2026Collective cooperation without individual fidelity in LLM agents