From Process Loss to Assembly Bonus: Human-Grounded Diagnosis of Multi-Agent LLM Collaboration
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
LLM agents are increasingly used for collaborative problem solving and human-group simulation. This makes outcome-only evaluation insufficient: if LLM groups are used as models of human groups, we need to know whether they succeed or fail through human-like deliberative mechanisms. We compare human group chats with matched LLM deliberation traces on Wason-style deductive reasoning, then test whether the same process signatures generalize to analogical, abductive, and analytical tasks. Humans and LLMs show the same assembly bonus asymmetry: discussion improves the average member more often than the best initial member. Initial-answer diversity accounts for the effect of model heterogeneity, increasing movement in both corrective and destructive directions. The main differences are process-level. Compared with humans, LLM groups follow majorities more often, surface less unique information, and converge earlier; correct minority signals succeed mainly when re-expressed early. Interventions motivated by human group-decision research yield modest improvements in collective outcomes, but do not remove the coordination bottleneck. Together, these results suggest that LLM groups can reproduce some outcome-level patterns of human deliberation while diverging in the mechanisms that generate assembly bonus and process loss, with implications for group simulation and human-AI collaboration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 35 of its 90 references that are in the map. First posted on arXiv 6 Sep 2026.
Builds on
35 of 90 references.
Closest ancestors · 13
Same direction, newest first
- 2026From Debate to Deliberation: Structured Collective Reasoning with Typed Epistemic Acts12 Mar
- 2026Epistemic Gain, Aleatoric Cost: Uncertainty Decomposition in Multi-Agent Debate for Math Reasoning1 Mar
- 2025What Makes LLM Agent Simulations Useful for Policy Practice? An Iterative Design Study in Emergency Preparedness26 Sep
- 2025Enhancing Multi-Agent Debate System Performance via Confidence Expression17 Sep
- 2025Finding Common Ground: Using Large Language Models to Detect Agreement in Multi-Agent Decision Conferences11 Jul
- 2025CortexDebate: Debating Sparsely and Equally for Multi-Agent Debate5 Jul
- 2025Stay Focused: Problem Drift in Multi-Agent Debate26 Feb
- 2025Voting or Consensus? Decision-Making in Multi-Agent Debate26 Feb
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society12 Feb
- 2024Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justice24 Dec
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents4 Dec
- 2024GenSim: A General Social Simulation Platform with Large Language Model based Agents6 Oct
Other references · 22
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
- 2019Abductive Commonsense Reasoningcited by 301
- 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Informationcited by 49
- 2021From LSAT: The Progress and Challenges of Complex Reasoningcited by 43
- 2025X-MAS: Towards Building Multi-Agent Systems with Heterogeneous LLMscited by 38
- 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoningcited by 27
- 2021DeliData: A dataset for deliberation in multi-party problem solvingcited by 26
10 more
- 2024Confidence Calibration and Rationalization for LLMs via Multi-Agent Deliberationcited by 26
- 2024Six Fallacies in Substituting Large Language Models for Human Participantscited by 24
- 2024Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMscited by 17
- 2024GPT-4 Emulates Average-Human Emotional Cognition from a Third-Person Perspectivecited by 16
- 2025SAND: Boosting LLM Agents with Self-Taught Action Deliberationcited by 14
- 2026AgenticPay: A Multi-Agent LLM Negotiation System for Buyer-Seller Transactionscited by 12
- 2025Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generationcited by 7
- 2026Orchestrating Intelligence: Confidence-Aware Routing for Efficient Multi-Agent Collaboration across Multi-Scale Modelscited by 6
- 2026When Does Multi-Agent Collaboration Help? An Entropy Perspectivecited by 3
- 2025Social Simulations with Large Language Model Risk Utopian Illusioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomes
- 2026LLM Agents for Deliberative Collaboration: A Study on Joint Decision Making Under Partial Observability
- 2026"Who Am I, and Who Else Is Here?" Behavioral Differentiation Without Role Assignment in Multi-Agent LLM Systems
- 2025The Social Laboratory: A Psychometric Framework for Multi-Agent LLM Evaluation
- 2026Language-model groups overstate consensus when replaying human deliberation on a reasoning task
- 2026CollabSim: A CSCW-Grounded Methodology for Investigating Collaborative Competence of LLM Agents through Controlled Multi-Agent Experiments
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teams
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View