Adaptive Collaboration of Arena-Based Argumentative LLMs for Explainable and Contestable Legal Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Legal reasoning requires not only high accuracy but also the ability to justify decisions through verifiable and contestable arguments. However, existing Large Language Model (LLM) approaches, such as Chain-of-Thought (CoT) and Retrieval-Augmented Generation (RAG), often produce unstructured explanations that lack a formal mechanism for verification or user intervention. To address this limitation, we propose Adaptive Collaboration of Argumentative LLMs (ACAL), a neuro-symbolic framework that integrates adaptive multi-agent collaboration with an Arena-based Quantitative Bipolar Argumentation Framework (A-QBAF). ACAL dynamically deploys expert agent teams to construct arguments, employs a clash resolution mechanism to adjudicate conflicting claims, and utilizes uncertainty-aware escalation for borderline cases. Crucially, our framework supports a Human-in-the-Loop (HITL) contestability workflow, enabling users to directly audit and modify the underlying reasoning graph to influence the final judgment. Empirical evaluations on the LegalBench benchmark demonstrate that ACAL outperforms strong baselines across Gemini-2.5-Flash-Lite and Gemini-2.5-Flash architectures, effectively balancing efficient predictive performance with structured transparency and contestability. Our implementation is available at: https://github.com/loc110504/ACAL.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 21 of its 33 references that are in the map. First posted on arXiv 21 Feb 2026.
Builds on
21 of 33 references.
Closest ancestors · 4
Same direction, newest first
- 2025Thinking Longer, Not Always Smarter: Evaluating LLM Capabilities in Hierarchical Legal Reasoning9 Oct
- 2025Challenges for Generative AI in Legal Reasoning26 Aug
- 2025Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning11 Feb
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models20 Aug
Other references · 17
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecturecited by 122
- 2024(A)I Am Not a Lawyer, But...: Engaging Legal Experts towards Responsible LLM Policies for Legal Advicecited by 63
- 2023Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergencecited by 42
- 2024AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentationcited by 40
- 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agentscited by 37
- 2024Argumentative Large Language Models for Explainable and Contestable Claim Verificationcited by 36
- 2025On Verifiable Legal Reasoning: A Multi-Agent Framework with Formalized Knowledge Representationscited by 18
- 2023Survey on Leveraging Uncertainty Estimation Towards Trustworthy Deep Neural Networks: The Case of Reject Option and Post-training Processingcited by 7
5 more
- 2023Argument Attribution Explanations in Quantitative Bipolar Argumentation Frameworks (Technical Report)cited by 7
- 2025Motion2Meaning: A Clinician-Centered Framework for Contestable LLM in Parkinson's Disease Gait Interpretationcited by 6
- 2026LLM Agents in Law: Taxonomy, Applications, and Challengescited by 5
- 2025NomicLaw: Emergent Trust and Strategic Argumentation in LLMs During Collaborative Law-Makingcited by 4
- 2025SAMVAD: A Multi-Agent System for Simulating Judicial Deliberation Dynamics in Indiacited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Contestable Multi-Agent Debate with Arena-based Argumentative Computation for Multimedia Verificationcited by 2
- 2026Position: Multi-Agent Algorithmic Care Systems Demand Contestability for Trustworthy AIcited by 0
- 2026Consensus-based Agentic Large Language Model Framework for Harmonized Tariff Schedule Code Classificationcited by 0
- 2026CoPlan: A Trustworthy Co-Intelligence Interface for Care Planning through Role-Based Contestable Argument Graphscited by 0
- 2026CoPlan: A Trustworthy Co-Intelligence Interface for Care Planning through Role-Based Contestable Argument Graphs5 Aug 2026
- 2026Consensus-based Agentic Large Language Model Framework for Harmonized Tariff Schedule Code Classification15 Jun 2026
- 2026Contestable Multi-Agent Debate with Arena-based Argumentative Computation for Multimedia Verification14 May 2026
- 2026Position: Multi-Agent Algorithmic Care Systems Demand Contestability for Trustworthy AI21 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026L-MAD: A Systematic Evaluation of Multi-Agent Debate Structures in Legal Reasoning
- 2024Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration
- 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning
- 2026LRAS: Advanced Legal Reasoning with Agentic Search
- 2026Investigating Multi-Agent Deliberation in Law
- 2025Mitigating Manipulation and Enhancing Persuasion: A Reflective Multi-Agent Approach for Legal Argument Generation
- 2025When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governance
- 2025Debate-Feedback: A Multi-Agent Framework for Efficient Legal Judgment Prediction