The Argument is the Explanation: Structured Argumentation for Trust in Agents
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Humans are black boxes -- we cannot observe their neural processes, yet society functions by evaluating verifiable arguments. AI explainability should follow this principle: stakeholders need verifiable reasoning chains, not mechanistic transparency. We propose using structured argumentation to provide a level of explanation and verification neither interpretability nor LLM-generated explanation is able to offer. Our pipeline achieves state-of-the-art 94.44 macro F1 on the AAEC published train/test split (5.7 points above prior work) and 0.81 macro F1, ~0.07 above previous published results with comparable data setups, for Argumentative MicroTexts relation classification, converting LLM text into argument graphs and enabling verification at each inferential step. We demonstrate this idea on multi-agent risk assessment using the Structured What-If Technique, where specialized agents collaborate transparently to carry out risk assessment otherwise achieved by humans alone. Using Bipolar Assumption-Based Argumentation, we capture support/attack relationships, thereby enabling automatic hallucination detection via fact nodes attacking arguments. We also provide a verification mechanism that enables iterative refinement through test-time feedback without retraining. For easy deployment, we provide a Docker container for the fine-tuned AMT model, and the rest of the code with the Bipolar ABA Python package on GitHub.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 4 of its 17 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
4 of 17 references.
References · 4
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2020Reliable Post hoc Explanations: Modeling Uncertainty in Explainabilitycited by 125
- 2024Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AIcited by 6
- 2025Limited Generalizability in Argument Mining: State-Of-The-Art Models Learn Datasets, Not Argumentscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Argumentative Human-AI Decision-Making: Toward AI Agents That Reason With Us, Not For Us
- 2026A Theory of Post-hoc Debate Judgement
- 2026Measuring AI Accountability Through Argumentation Analysis: Can Model Reasoning Withstand Scrutiny?
- 2026Project Ariadne: A Structural Causal Framework for Auditing Faithfulness in LLM Agents
- 2026Evaluating the False Trust Engendered by LLM Explanations
- 2026The Reasoning Trap: An Information-Theoretic Bound on Closed-System Multi-Step LLM Reasoning
- 2024Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debate
- 2026FormalJudge: A Neuro-Symbolic Paradigm for Agentic Oversight