OBJECTION! Lawyer Agents Mitigate Guilty Bias in Legal Judgment Prediction
Not on the map. Why?
Abstract (arXiv)
Legal Judgment Prediction (LJP) models are typically trained on documents that describe facts from a prosecutorial perspective. Existing datasets further exhibit severe label imbalance toward guilty outcomes. Consequently, these models suffer from "Guilty Bias", blindly accepting the prosecution's narrative as objective truth. Previous studies employing three-step reasoning structures or training on synthetically generated innocence data improve overall accuracy, but they still fail to mitigate bias at inference time. In this paper, we introduce OBJECTION, an inference-time pipeline that integrates an Adversarial Lawyer Agent into each 3-step reasoning of offense, unlawfulness, and culpability. Unlike generic critics, our agent actively challenges the model's presumptions of guilt by injecting legal defense arguments at each reasoning stage. To thoroughly evaluate this, we present a new "Natural Innocent" dataset including 3.4k real-world cases, overcoming the limitations of synthetic innocence benchmarks. Test results show that OBJECTION drastically reduces the False Guilty Rate (FGR) from 82.93% (SOTA baseline) to 16.69%, proving its capability to perform substantive legal reasoning. This work denotes a key progress toward aligning Legal AI with the presumption of innocence.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
15 of 31 references.
References · 15
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
- 2021Lawformer: A Pre-trained Language Model for Chinese Legal Long Documentscited by 115
- 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 111
- 2020Distinguish Confusing Law Articles for Legal Judgment Predictioncited by 62
- 2017Learning to Predict Charges for Criminal Cases with Legal Basiscited by 61
- 2022A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challengescited by 50
- 2023LLMRefine: Pinpointing and Refining Large Language Models via Fine-Grained Actionable Feedbackcited by 39
- 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agentscited by 36
- 2024LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraintscited by 34
- 2022Explainable Legal Case Matching via Inverse Optimal Transport-based Rationale Extractioncited by 21
Built on by
Not cited yet.