# Man and machine: artificial intelligence and judicial decision making

arXiv: https://arxiv.org/abs/2603.19042 · HTML: https://mlsanity.com/paper/2603.19042/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 9 of its 94 references that are in the map.
- First posted on arXiv 19 Mar 2026.

## Builds on (most cited first, 9 of 9)

- [Equality of Opportunity in Supervised Learning](https://mlsanity.com/paper/1610.02413/) (2016)
- [Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment](https://mlsanity.com/paper/1610.08452/) (2016)
- [Fairness in Criminal Justice Risk Assessments: The State of the Art](https://mlsanity.com/paper/1703.09207/) (2017)
- [Algorithmic Fairness](https://mlsanity.com/paper/2001.09784/) (2020)
- [The age of secrecy and unfairness in recidivism prediction](https://mlsanity.com/paper/1811.00731/) (2018)
- [Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment](https://mlsanity.com/paper/2012.02845/) (2020)
- [Simple rules for complex decisions](https://mlsanity.com/paper/1702.04690/) (2017)
- [Does AI help humans make better decisions? A statistical evaluation framework for experimental and observational studies](https://mlsanity.com/paper/2403.12108/) (2024)
- [Equal Confusion Fairness: Measuring Group-Based Disparities in Automated Decision Systems](https://mlsanity.com/paper/2307.00472/) (2023)

## Abstract (arXiv)

The integration of artificial intelligence (AI) into judicial decision making -- particularly in pretrial, sentencing, and parole contexts -- has generated a substantial and rapidly growing literature. Across computer science, economics, law, criminology, and psychology, researchers have examined the reliability, fairness, and real-world effects of AI-assisted decision making. Yet this literature remains fragmented, and differences in assumptions, concepts, and research priorities make it difficult to assess what is actually known. Using criminal justice risk assessment as a focal case, this article makes two contributions. First, we develop a conceptual framework that distinguishes and relates three central questions: (1) the predictive validity of automated risk assessment tools; (2) how algorithmic risk assessments compare with human predictions (AI-versus-Human); and (3) how algorithmic recommendations affect judges' decisions (AI-plus-Human). Second, we use this framework to synthesize the empirical evidence addressing each of these questions. Our review identifies important limitations in existing research on predictive validity, as well as substantial gaps in understanding how judges respond to AI advice and how those responses vary across individuals and decision-making environments. The available evidence suggests that AI decision aids have, so far, had at most modest effects on pretrial and sentencing decisions. We conclude that further research is needed to understand how judges make decisions in noisy informational environments and under what conditions AI tools can produce meaningful improvements in judicial decision making.
