Right Answers, Wrong States: Hidden Information Failures in Multi-Agent Collaboration
Not on the map. Why?
Abstract (arXiv)
Multi-agent systems are often judged by whether they reach the correct answer. This can miss a distinct failure: collaboration may leave behind a corrupted information state even when the immediate decision is correct. We call this an off-query failure. To study this failure in collaborative decision support, we introduce OffQuery, which separately evaluates evidence verification (T1), shared-state reconstruction (T2), and task resolution (T3) in two representative high-stakes settings: healthcare and disaster response. Across GPT, Gemini, and Qwen models, standard collaboration shows much stronger task performance than state reliability. Averaged over 21 model--setting combinations, task resolution reaches 64.7%, while evidence verification and state reconstruction reach only 14.3% and 43.1%. We trace this gap to selective information use: current queries often bypass corrupted facts, which become consequential when later tasks require them. We further introduce ReGround, which resolves conflicting evidence, verifies shared facts, reconstructs a trusted state, and reasons over that state. Across seven models from three families, ReGround improves all three capabilities in every evaluated setting, with average relative gains of 309.0%, 82.9%, and 17.6% on T1, T2, and T3. Reliable collaboration therefore requires both a correct decision and a reliable shared state for future reasoning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 39 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
31 of 39 references.
References · 31
- 2025Qwen3 Technical Reportcited by 8,195
- 2024GPT-4o System Cardcited by 4,467
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2025OpenAI GPT-5 System Cardcited by 910
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
- 2025MultiAgentBench: Evaluating the Collaboration and Competition of LLM agentscited by 169
- 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
19 more
- 2025Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models?cited by 74
- 2023LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Modelscited by 65
- 2023MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaborationcited by 56
- 2025G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent Systemscited by 56
- 2024MultiAgent Collaboration Attack: Investigating Adversarial Attacks in Large Language Model Collaborations via Debatecited by 54
- 2025Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agentscited by 39
- 2023Instruct and Extract: Instruction Tuning for On-Demand Information Extractioncited by 35
- 2024VillagerAgent: A Graph-Based Multi-Agent Framework for Coordinating Complex Task Dependencies in Minecraftcited by 34
- 2024CoMM: Collaborative Multi-Agent, Multi-Reasoning-Path Prompting for Complex Problem Solvingcited by 31
- 2025When One LLM Drools, Multi-LLM Collaboration Rulescited by 25
- 2025Multiple LLM Agents Debate for Equitable Cultural Alignmentcited by 20
- 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversitycited by 17
- 2024Autonomous Agents for Collaborative Task under Information Asymmetrycited by 15
- 2025Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMscited by 15
- 2026FlowSteer: Prompt-Only Workflow Steering Exposes Planning-Time Vulnerabilities in Multi-Agent LLM Systemscited by 7
- 2025Beyond Brainstorming: What Drives High-Quality Scientific Ideas? Lessons from Multi-Agent Collaborationcited by 6
- 2025Beyond Frameworks: Unpacking Collaboration Strategies in Multi-Agent Systemscited by 3
- 2026When Truth Is Distributed: Misinformation Derails Collective Fact Recovery in LLM-Based Multi-Agent Systemscited by 3
- 2026The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberationcited by 1
Built on by
Not cited yet.