mlsanityData to 14 Oct 2026

From Process Loss to Assembly Bonus: Human-Grounded Diagnosis of Multi-Agent LLM Collaboration

arXiv 2609.13261 ↗First posted 6 Sep 2026cs.MA cs.AI cs.CLcited by 0

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

LLM agents are increasingly used for collaborative problem solving and human-group simulation. This makes outcome-only evaluation insufficient: if LLM groups are used as models of human groups, we need to know whether they succeed or fail through human-like deliberative mechanisms. We compare human group chats with matched LLM deliberation traces on Wason-style deductive reasoning, then test whether the same process signatures generalize to analogical, abductive, and analytical tasks. Humans and LLMs show the same assembly bonus asymmetry: discussion improves the average member more often than the best initial member. Initial-answer diversity accounts for the effect of model heterogeneity, increasing movement in both corrective and destructive directions. The main differences are process-level. Compared with humans, LLM groups follow majorities more often, surface less unique information, and converge earlier; correct minority signals succeed mainly when re-expressed early. Interventions motivated by human group-decision research yield modest improvements in collective outcomes, but do not remove the coordination bottleneck. Together, these results suggest that LLM groups can reproduce some outcome-level patterns of human deliberation while diverging in the mechanisms that generate assembly bonus and process loss, with implications for group simulation and human-AI collaboration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 35 of its 90 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

35 of 90 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026From Debate to Deliberation: Structured Collective Reasoning with Typed Epistemic Acts12 Mar
  2. 2026Epistemic Gain, Aleatoric Cost: Uncertainty Decomposition in Multi-Agent Debate for Math Reasoning1 Mar
  3. 2025What Makes LLM Agent Simulations Useful for Policy Practice? An Iterative Design Study in Emergency Preparedness26 Sep
  4. 2025Enhancing Multi-Agent Debate System Performance via Confidence Expression17 Sep
  5. 2025Finding Common Ground: Using Large Language Models to Detect Agreement in Multi-Agent Decision Conferences11 Jul
  6. 2025CortexDebate: Debating Sparsely and Equally for Multi-Agent Debate5 Jul
  7. 2025Stay Focused: Problem Drift in Multi-Agent Debate26 Feb
  8. 2025Voting or Consensus? Decision-Making in Multi-Agent Debate26 Feb
  9. 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society12 Feb
  10. 2024Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justice24 Dec
  11. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents4 Dec
  12. 2024GenSim: A General Social Simulation Platform with Large Language Model based Agents6 Oct
1 more
  1. 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs29 Nov

Other references · 22

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  3. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  4. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  5. 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
  6. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
  7. 2019Abductive Commonsense Reasoningcited by 301
  8. 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Informationcited by 49
  9. 2021From LSAT: The Progress and Challenges of Complex Reasoningcited by 43
  10. 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMscited by 38
  11. 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoningcited by 27
  12. 2021DeliData: A dataset for deliberation in multi-party problem solvingcited by 26
10 more
  1. 2024Confidence Calibration and Rationalization for LLMs via Multi-Agent Deliberationcited by 26
  2. 2024Six Fallacies in Substituting Large Language Models for Human Participantscited by 24
  3. 2024Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMscited by 17
  4. 2024GPT-4 Emulates Average-Human Emotional Cognition from a Third-Person Perspectivecited by 16
  5. 2025SAND: Boosting LLM Agents with Self-Taught Action Deliberationcited by 14
  6. 2026AgenticPay: A Multi-Agent LLM Negotiation System for Buyer-Seller Transactionscited by 12
  7. 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generationcited by 7
  8. 2026Orchestrating Intelligence: Confidence-Aware Routing for Efficient Multi-Agent Collaboration across Multi-Scale Modelscited by 6
  9. 2026When Does Multi-Agent Collaboration Help? An Entropy Perspectivecited by 3
  10. 2025Social Simulations with Large Language Model Risk Utopian Illusioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomes
  2. 2026LLM Agents for Deliberative Collaboration: A Study on Joint Decision Making Under Partial Observability
  3. 2026"Who Am I, and Who Else Is Here?" Behavioral Differentiation Without Role Assignment in Multi-Agent LLM Systems
  4. 2025The Social Laboratory: A Psychometric Framework for Multi-Agent LLM Evaluation
  5. 2026Language-model groups overstate consensus when replaying human deliberation on a reasoning task
  6. 2026CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments
  7. 2024Embodied LLM Agents Learn to Cooperate in Organized Teams
  8. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View