mlsanityData to 7 Oct 2026

LegalSim: Multi-Agent Simulation of Legal Systems for Discovering Procedural Exploits

arXiv 2510.03405 ↗First posted 3 Oct 2025cs.MA cs.AI cs.CRcited by 1

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

We present LegalSim, a modular multi-agent simulation of adversarial legal proceedings that explores how AI systems can exploit procedural weaknesses in codified rules. Plaintiff and defendant agents choose from a constrained action space (for example, discovery requests, motions, meet-and-confer, sanctions) governed by a JSON rules engine, while a stochastic judge model with calibrated grant rates, cost allocations, and sanction tendencies resolves outcomes. We compare four policies: PPO, a contextual bandit with an LLM, a direct LLM policy, and a hand-crafted heuristic; Instead of optimizing binary case outcomes, agents are trained and evaluated using effective win rate and a composite exploit score that combines opponent-cost inflation, calendar pressure, settlement pressure at low merit, and a rule-compliance margin. Across configurable regimes (e.g., bankruptcy stays, inter partes review, tax procedures) and heterogeneous judges, we observe emergent ``exploit chains'', such as cost-inflating discovery sequences and calendar-pressure tactics that remain procedurally valid yet systemically harmful. Evaluation via cross-play and Bradley-Terry ratings shows, PPO wins more often, the bandit is the most consistently competitive across opponents, the LLM trails them, and the heuristic is weakest. The results are stable in judge settings, and the simulation reveals emergent exploit chains, motivating red-teaming of legal rule systems in addition to model-level testing.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 12 of its 25 references that are in the map. First posted on arXiv 3 Oct 2025.

Builds on

12 of 25 references.

References · 12

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2016Concrete Problems in AI Safetycited by 1,582
  3. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
  4. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
  5. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
  6. 2018Scalable agent alignment via reward modeling: a research directioncited by 438
  7. 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 308
  8. 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
  9. 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 115
  10. 2019Open-ended Learning in Symmetric Zero-sum Gamescited by 96
  11. 2019α-Rank: Multi-Agent Evaluation by Evolutioncited by 50
  12. 2025ScamAgents: How AI Agents Can Simulate Human-Level Scam Callscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents
  2. 2026Enhancing Judgment Document Generation via Agentic Legal Information Collection and Rubric-Guided Optimization
  3. 2026Can LLMs Time Travel? Enhancing Temporal Consistency in Legal Agentic Search through Reinforcement Learning
  4. 2026Parthenon Law: A Self-Evolving Legal-Agent Framework
  5. 2025Law in Silico: Simulating Legal Society with LLM-Based Agents
  6. 2026Closing the Loop: Formally Verified Law as a Reward Signal for Self-Improving Legal AI
  7. 2026Beyond Goodhart's Law: A Dynamic Benchmark for Evaluating Compliance in Multi-Agent Systems
  8. 2026LRAS: Advanced Legal Reasoning with Agentic Search