Adaptive Collaboration of Arena-Based Argumentative LLMs for Explainable and Contestable Legal Reasoning
Organizations: Ho Chi Minh University of Science, Vietnam · University of New Brunswick, Canada · Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
Abstract
Legal reasoning requires not only high accuracy but also the ability to justify decisions through verifiable and contestable arguments. However, existing Large Language Model (LLM) approaches, such as Chain-of-Thought (CoT) and Retrieval-Augmented Generation (RAG), often produce unstructured explanations that lack a formal mechanism for verification or user intervention. To address this limitation, we propose Adaptive Collaboration of Argumentative LLMs (ACAL), a neuro-symbolic framework that integrates adaptive multi-agent collaboration with an Arena-based Quantitative Bipolar Argumentation Framework (A-QBAF). ACAL dynamically deploys expert agent teams to construct arguments, employs a clash resolution mechanism to adjudicate conflicting claims, and utilizes uncertainty-aware escalation for borderline cases. Crucially, our framework supports a Human-in-the-Loop (HITL) contestability workflow, enabling users to directly audit and modify the underlying reasoning graph to influence the final judgment. Empirical evaluations on the LegalBench benchmark demonstrate that ACAL outperforms strong baselines across Gemini-2.5-Flash-Lite and Gemini-2.5-Flash architectures, effectively balancing efficient predictive performance with structured transparency and contestability. Our implementation is available at: https://github.com/loc110504/ACAL.
Figures & tables
| Category | Roles |
| Adjudication | Judge, Law Clerk / Judicial Clerk |
| Litigation & Advocacy | Private Practice Lawyer, Prosecutor, Public Defender |
| Advisory & Transactional | Corporate Counsel, Compliance Officer, IP Attorney |
| Research & Support | Legal Analyst, Paralegal |
| Score Range | Interpretation |
| Incorrect legal analysis or misidentification of key elements | |
| Partially correct but missing critical components or overly generic | |
| Sound analysis with minor gaps or insufficient case-specific application | |
| Strong analysis with specific facts and correct legal reasoning | |
| Exceptional precision with authoritative citations and flawless logic |
| Model | Method | Learned Hands Courts | Hearsay | ||||||
| Acc | Prec | Rec | F1 | Acc | Prec | Rec | F1 | ||
| Gemini-2.5-Flash-Lite | SP | 57.8 | 63.1 | 57.8 | 53.1 | 69.2 | 73.6 | 71.5 | 68.9 |
| CoT | 69.3 | 69.3 | 69.2 | 69.2 | 69.2 | 74.7 | 71.8 | 68.7 | |
| RAG | 70.3 | 70.5 | 70.3 | 70.3 | 71.3 | 70.8 | 70.9 | 70.9 | |
| MAD | 69.8 | 69.8 | 69.8 | 69.8 | 74.5 | 75.8 | 72.4 | 72.7 | |
| ACAL (Ours) | 70.8 | 71.2 | 70.8 | 70.7 | 74.5 | 77.1 | 76.3 | 74.4 | |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.