Preventing Error Propagation in Multi-Agent AI through Runtime Monitoring
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Multi-agent AI systems can improve answer selection by allowing different language models to exchange reasoning traces, revise initial predictions, and support a final decision. However, such communication may also introduce reliability risks: reasoning from one agent can correct another agent's mistake, but it can also mislead an agent that was initially correct. This paper studies reliable multi-agent AI communication through reasoning exchange and runtime answer revision. We develop a framework in which agents first answer multiple-choice questions independently, then share reasoning traces and revise their decisions. We conduct numerical experiments where we evaluate whether this process improves accuracy, produces more positive than negative answer transitions, and remains effective across domains such as cybersecurity, networking, and general knowledge. The results help identify when multi-agent reasoning improves reliability and when it may propagate errors.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 23 of its 26 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
23 of 26 references.
References · 23
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
11 more
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 268
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
- 2019Domain Adaptive Inference for Neural Machine Translationcited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Candidate supply and answer selection shape the value of LLM judging in multi-agent systems
- 2026Beyond Final Accuracy: Auditing Communication in LLM Multi-Agent Systems
- 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
- 2025Benefits and Limitations of Communication in Multi-Agent Reasoning
- 2026Verifiable Semantics for Agent-to-Agent Communication
- 2025OPTAGENT: Optimizing Multi-Agent LLM Interactions Through Verbal Reinforcement Learning for Enhanced Reasoning
- 2026Misinformation Propagation in Benign Multi-Agent Systems
- 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs