mlsanityData to 7 Oct 2026

Preventing Error Propagation in Multi-Agent AI through Runtime Monitoring

arXiv 2606.29026 ↗First posted 27 Jun 2026cs.AI cs.ETcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Multi-agent AI systems can improve answer selection by allowing different language models to exchange reasoning traces, revise initial predictions, and support a final decision. However, such communication may also introduce reliability risks: reasoning from one agent can correct another agent's mistake, but it can also mislead an agent that was initially correct. This paper studies reliable multi-agent AI communication through reasoning exchange and runtime answer revision. We develop a framework in which agents first answer multiple-choice questions independently, then share reasoning traces and revise their decisions. We conduct numerical experiments where we evaluate whether this process improves accuracy, produces more positive than negative answer transitions, and remains effective across domains such as cybersecurity, networking, and general knowledge. The results help identify when multi-agent reasoning improves reliability and when it may propagate errors.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 23 of its 26 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

23 of 26 references.

References · 23

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  7. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  8. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  9. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  10. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  11. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  12. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
11 more
  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  3. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  4. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  5. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  7. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  8. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  9. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 268
  10. 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
  11. 2019Domain Adaptive Inference for Neural Machine Translationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Candidate supply and answer selection shape the value of LLM judging in multi-agent systems
  2. 2026Beyond Final Accuracy: Auditing Communication in LLM Multi-Agent Systems
  3. 2025Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate
  4. 2025Benefits and Limitations of Communication in Multi-Agent Reasoning
  5. 2026Verifiable Semantics for Agent-to-Agent Communication
  6. 2025OPTAGENT: Optimizing Multi-Agent LLM Interactions Through Verbal Reinforcement Learning for Enhanced Reasoning
  7. 2026Misinformation Propagation in Benign Multi-Agent Systems
  8. 2025AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs