mlsanityData to 14 Oct 2026

When Disagreements Elicit Robustness: Investigating Self-Repair Capabilities under LLM Multi-Agent Disagreements

arXiv 2502.15153 ↗First posted 21 Feb 2025cs.CLcited by 3

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Recent advances in Large Language Models (LLMs) have upgraded them from sophisticated text generators to autonomous agents capable of cooperation and tool use in multi-agent systems (MAS). However, it remains unclear how disagreements shape collective decision-making. In this paper, we revisit the role of disagreement and argue that general, partially overlapping disagreements prevent premature consensus and expand the explored solution space, while disagreements on task-critical steps can derail collaboration depending on the topology of solution paths. We investigate two collaborative settings with distinct path structures: collaborative reasoning (CounterFact, MQuAKE-cf), which typically follows a single evidential chain, whereas collaborative programming (HumanEval, GAIA) often adopts multiple valid implementations. Disagreements are instantiated as general heterogeneity among agents and as task-critical counterfactual knowledge edits injected into context or parameters. Experiments reveal that general disagreements consistently improve success by encouraging complementary exploration. By contrast, task-critical disagreements substantially reduce success on single-path reasoning, yet have a limited impact on programming, where agents can choose alternative solutions. Trace analyses show that MAS frequently bypasses the edited facts in programming but rarely does so in reasoning, revealing an emergent self-repair capability that depends on solution-path rather than scale alone. Our code is available at https://github.com/wbw625/MultiAgentRobustness.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 32 of its 46 references that are in the map. First posted on arXiv 21 Feb 2025.

Builds on

32 of 46 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024GenSim: A General Social Simulation Platform with Large Language Model based Agents6 Oct
  2. 2023Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View3 Oct
  3. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 29

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  5. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  6. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  7. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  8. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
  9. 2021Fast Model Editing at Scalecited by 498
  10. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 479
  11. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  12. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
17 more
  1. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
  2. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 300
  3. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
  4. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 251
  5. 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 217
  6. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
  7. 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fastcited by 153
  8. 2023Theory of Mind for Multi-Agent Collaboration via Large Language Modelscited by 135
  9. 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 106
  10. 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 97
  11. 2024Flooding Spread of Manipulated Knowledge in LLM-Based Multi-Agent Communitiescited by 86
  12. 2023LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Modelscited by 68
  13. 2024MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generationcited by 44
  14. 2023Deciphering Digital Detectives: Understanding LLM Behaviors and Capabilities in Multi-Agent Mystery Gamescited by 30
  15. 2024Towards Collaborative Intelligence: Propagating Intentions and Reasoning for Multi-Agent Coordination with Large Language Modelscited by 10
  16. 2023Leveraging Large Language Models for Collective Decision-Makingcited by 6
  17. 2024Leveraging Multi-AI Agents for Cross-Domain Knowledge Discoverycited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
  2. 2026Consensus is Strategically Insufficient: Reasoning-Trace Disagreement as a Knowledge-Representation Signal
  3. 2026When AI Agents Disagree Like Humans: Reasoning Trace Analysis for Human-AI Collaborative Moderation
  4. 2025When and Why Does Multi-Agent Debate Fail and Does It Really Underperform?
  5. 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoning
  6. 2025Revisiting Multi-Agent Debate as Test-Time Scaling: A Systematic Study of Conditional Effectiveness
  7. 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning
  8. 2025Enhancing LLM Performance Through Debate: An Empirical Study on Multi-Agent Debate for Coding Tasks