mlsanityData to 14 Oct 2026

Smart Alone, Blind Together: Why Accuracy Fails to CertifyTheory of Mind in Multi-Agent Teams

arXiv 2610.19051 ↗First posted 13 Oct 2026cs.AI cs.CL cs.LGcited by 0

On the map: LLM agents and tool use → Social simulation and multi-agent debate also fits: General LLM agent frameworks and benchmarks

Abstract (arXiv)

Coordinators that act on what they infer about teammates are usually certified by the accuracy of those inferences. We argue that accuracy is the wrong certificate, for two reasons. First, the accuracy needed to act depends on what a wrong action costs, so the bar belongs to the deployment, not the module. Second, a module's errors are rarely independent, and dependence has a sign: positively associated errors help where their damage overlaps and hurt where it compounds, so an accuracy threshold fails in a predictable direction, and once wrong beliefs interact and can do harm, no rule based on accuracy is right for every module. We test these predictions in task assignment, Level-Based Foraging and Hanabi, with injected errors, trained and Bayesian modules and five language models, and in human judgments. Accuracy fails in both directions, approving harmful language-model deployments in Hanabi, where shared errors compound, and rejecting beneficial ones in task assignment, where costly errors are rare. In our tasks it also buys far less redundancy than independence predicts: from GPT-5.4-mini to Claude Opus 5.5, error on teammates the models have evidence about falls from 32% to 11%, but the chance that all three observers misread one falls only from 16% to 9% (independence: 3.4% to 0.15%). We propose certifying the deployment, with a Blind-Spot Gate that prices error costs, pairwise interactions and measured dependence without deploying the module. On held-out data from the cells it was developed on, it makes no significant false approval in 20 splits (accuracy: 3.2 per split), and in preregistered tests on modules it was not developed on, it recovers what accuracy rejects (seven classifiers: regret 0.004 against 0.479) and catches what accuracy approves (a Bayesian module: significant false approvals in 17 of 20 splits for accuracy, 1 for the gate).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 11 of its 41 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

11 of 41 references.

References · 11

  1. 2019Human uncertainty makes classification more robustcited by 235
  2. 2018Machine Theory of Mindcited by 226
  3. 2020Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative Taskscited by 212
  4. 2017Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problemscited by 131
  5. 2021Algorithmic Monoculture and Social Welfarecited by 100
  6. 2023Jumanji: a Diverse Suite of Scalable Reinforcement Learning Environments in JAXcited by 58
  7. 2025Great Models Think Alike and this Undermines AI Oversightcited by 58
  8. 2015Belief and Truth in Hypothesised Behaviourscited by 21
  9. 2020Generating and Adapting to Diverse Ad-Hoc Cooperation Agents in Hanabicited by 13
  10. 2020Does it matter how well I know what you're thinking? Opponent Modelling in an RTS gamecited by 3
  11. 2026Theory of Scene: Breaking the Symmetry Trap in Multi-Agent LLM Coordinationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Perfect Teammates: Multi-Agent Collaboration with Unreliable Colleagues
  2. 2026When Small Models Are Right for Wrong Reasons: Process Verification for Trustworthy Agents
  3. 2026Trust Between AI Agents: Measuring Formation, Breakage, and Recovery, with Implications for Governing Multi-Agent Systems
  4. 2026Accurate but Not Humble: Evaluating Epistemic Humility in LLM Agents under Knowledge Conflict
  5. 2026Finding Where the Buck Stops: An Automated Failure Attribution-Based Reflection Framework for Multi-Agent Collaboration
  6. 2026Confident and Wrong: Silent Semantic Failures in Coding Agents
  7. 2026SkillJuror: Measuring How Agent Skill Organization Changes Runtime Behavior
  8. 2026Capable but Unreliable: Canonical Path Deviation as a Causal Mechanism of Agent Failure in Long-Horizon Tasks