When Disagreements Elicit Robustness: Investigating Self-Repair Capabilities under LLM Multi-Agent Disagreements
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Recent advances in Large Language Models (LLMs) have upgraded them from sophisticated text generators to autonomous agents capable of cooperation and tool use in multi-agent systems (MAS). However, it remains unclear how disagreements shape collective decision-making. In this paper, we revisit the role of disagreement and argue that general, partially overlapping disagreements prevent premature consensus and expand the explored solution space, while disagreements on task-critical steps can derail collaboration depending on the topology of solution paths. We investigate two collaborative settings with distinct path structures: collaborative reasoning (CounterFact, MQuAKE-cf), which typically follows a single evidential chain, whereas collaborative programming (HumanEval, GAIA) often adopts multiple valid implementations. Disagreements are instantiated as general heterogeneity among agents and as task-critical counterfactual knowledge edits injected into context or parameters. Experiments reveal that general disagreements consistently improve success by encouraging complementary exploration. By contrast, task-critical disagreements substantially reduce success on single-path reasoning, yet have a limited impact on programming, where agents can choose alternative solutions. Trace analyses show that MAS frequently bypasses the edited facts in programming but rarely does so in reasoning, revealing an emergent self-repair capability that depends on solution-path rather than scale alone. Our code is available at https://github.com/wbw625/MultiAgentRobustness.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 32 of its 46 references that are in the map. First posted on arXiv 21 Feb 2025.
Builds on
32 of 46 references.
Closest ancestors · 3
Same direction, newest first
- 2024GenSim: A General Social Simulation Platform with Large Language Model based Agents6 Oct
- 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View3 Oct
- 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr
Other references · 29
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2021Fast Model Editing at Scalecited by 498
- 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 479
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
17 more
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
- 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 300
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
- 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 217
- 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
- 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fastcited by 153
- 2023Theory of Mind for Multi-Agent Collaboration via Large Language Modelscited by 135
- 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 106
- 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 97
- 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communitiescited by 86
- 2023LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Modelscited by 68
- 2024MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generationcited by 44
- 2023Deciphering Digital Detectives: Understanding LLM Behaviors and Capabilities in Multi-Agent Mystery Gamescited by 30
- 2024Towards Collaborative Intelligence: Propagating Intentions and Reasoning for Multi-Agent Coordination with Large Language Modelscited by 10
- 2023Leveraging Large Language Models for Collective Decision-Makingcited by 6
- 2024Leveraging Multi-AI Agents for Cross-Domain Knowledge Discoverycited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
- 2026Consensus is Strategically Insufficient: Reasoning-Trace Disagreement as a Knowledge-Representation Signal
- 2026When AI Agents Disagree Like Humans: Reasoning Trace Analysis for Human-AI Collaborative Moderation
- 2025When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?
- 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning
- 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness
- 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning
- 2025Enhancing LLM Performance Through Debate: An Empirical Study on Multi-Agent Debate for Coding Tasks