mlsanityData to 7 Oct 2026

LegalWorld: A Life-Cycle Interactive Environment for Legal Agents

arXiv 2606.18728 ↗First posted 17 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Civil litigation is inherently a life-cycle process: what a lawyer drafts on day one constrains what unfolds at trial months later. Yet existing legal benchmarks evaluate isolated subtasks, and prior legal-agent simulators reinitialize each scenario from shared ground truth, leaving cross-stage causal dependencies unmodeled. We present LegalWorld, a life-cycle interactive environment that models Chinese civil litigation as a causally connected state chain of five stages (seven sub-scenarios), grounded in 75,309 paired Chinese civil judgments. We pair it with reusable infrastructure (local memory, global case memory, a Skill/Tool library) that keeps each dispute consistent across its full life cycle. Building on this environment, we construct LongJud-Bench to evaluate agent capability across all five connected stages. 18,992 ratings from 217 legal-background evaluators confirm that LegalWorld trajectories are procedurally faithful and role-consistent; and a capability-level cross-model evaluation reveals sharp divergences that aggregate scores cannot expose, with no single backbone leading across consultation, drafting, and courtroom advocacy. Detailed resources will be released publicly.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

22 of 34 references.

References · 22

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  3. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  4. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  6. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
  7. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
  8. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
  9. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 210
  10. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
  11. 2018CAIL2018: A Large-Scale Legal Dataset for Judgment Predictioncited by 168
  12. 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
10 more
  1. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
  2. 2024AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentationcited by 39
  3. 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agentscited by 36
  4. 2025PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactionscited by 30
  5. 2024Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulationcited by 15
  6. 2018Overview of CAIL2018: Legal Judgment Prediction Competitioncited by 13
  7. 2025Ready Jurist One: Benchmarking Language Agents for Legal Intelligence in Dynamic Environmentscited by 13
  8. 2024Enhancing Legal Case Retrieval via Scaling High-quality Synthetic Query-Candidate Pairscited by 11
  9. 2025Evolution in Simulation: AI-Agent School with Dual Memory for High-Fidelity Educational Dynamicscited by 3
  10. 2025Law in Silico: Simulating Legal Society with LLM-Based Agentscited by 3

Built on by

Not cited yet.