Maat: Independent Deterministic Contract-Based Governance for Multi-Agent LLM Workflows
On the map: LLM agents and tool use → Software engineering coding agents also fits: Agent threats, guardrails and governance
Abstract (arXiv)
Large-language-model multi-agent systems (LLM-MAS) introduce a characteristic reliability problem: an error produced by one agent can be accepted as context by downstream agents and propagate across the workflow. Many proposed safeguards rely on learned or LLM-based judges whose verdicts are themselves probabilistic; we ask whether a deterministic layer can instead stop contract-detectable handoff defects. We present Maat, a runtime governance layer that validates agent-to-agent handoffs against a versioned workflow contract, or anchor, with no language model in the validation or scoring path. We evaluate it in six controlled domain workflows (6-15 agents, 522 trials) with injected data-level defects and a deterministic seven-check rubric. Version 1 reported gains in all six workflows (2.9-26.5%). A post-publication audit found that three benchmark scorers credited any early halt as a prevented defect. On paired trials where the governed run completed or halted on a finding attributable to a verified defect, the rubric score changes by +7.7% to +29.1% in five workflows and is flat in software development; model-call cost falls 17-53% where attributable halts occur early. A hand review of all 94 governed-arm halts found 35 false alarms (37%), caused by validator defects rather than model behaviour; counting those halts as failed work, the governed arm scores below the ungoverned arm in four of six workflows. The results support deterministic handoff validation for contract-expressible defects and show that validator configuration and halt attribution must themselves be tested; they do not establish universal correctness, hallucination detection, or model-independent effectiveness.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 17 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
14 of 17 references.
Closest ancestors · 5
Same direction, newest first
- 2026Agora: Git as Shared Memory for Collective AutoResearch16 Sep
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems17 May
- 2026MASPrism: Lightweight Failure Attribution for Multi-Agent Systems Using Prefill-Stage Signals8 May
- 2025Detecting Silent Failures in Multi-Agentic AI Trajectories6 Nov
- 2025Aegis: Automated Error Generation and Attribution for Multi-Agent Systems17 Sep
Other references · 9
- 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 223
- 2025Towards a Science of Scaling Agent Systemscited by 125
- 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Securitycited by 41
- 2026Agent-as-a-Judgecited by 15
- 2026From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaborationcited by 13
- 2026Hallucination Cascade: Analyzing Error Propagation in Multi-Agent LLM Systemscited by 12
- 2025Explainable and Fine-Grained Safeguarding of LLM Multi-Agent Systems via Bi-Level Graph Anomaly Detectioncited by 8
- 2026Delayed Verification Destabilizes Multi-Agent LLM Belief: Instability Thresholds and Optimal Corrector Placementcited by 4
- 2026PropGuard: Safeguarding LLM-MAS via Propagation-Aware Exploration and Remediationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Traceability and Accountability in Role-Specialized Multi-Agent LLM Pipelines
- 2026Do More Agents Help? Controlled and Protocol-Aligned Evaluation of LLM Agent Workflows
- 2026Mnemosyne: Agentic Transaction Processing for Validating and Repairing AI-generated Workflows
- 2026Organizational Control Layer: Governance Infrastructure at the Execution Boundary of LLM Agent Systems
- 2025Sherlock: Reliable and Efficient Agentic Workflow Execution
- 2026Symbolic Temporal Supervision of LLM Agents Using Contracts
- 2025ALAS: Transactional and Dynamic Multi-Agent LLM Planning
- 2026Formal Verification of Agentic Systems over Operational Data