mlsanityData to 14 Oct 2026

Legal Zero-Days: A Novel Risk Vector for Advanced AI Systems

arXiv 2508.10050 ↗First posted 12 Aug 2025cs.CY cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce the concept of "Legal Zero-Days" as a novel risk vector for advanced AI systems. Legal Zero-Days are previously undiscovered vulnerabilities in legal frameworks that, when exploited, can cause immediate and significant societal disruption without requiring litigation or other processes before impact. We present a risk model for identifying and evaluating these vulnerabilities, demonstrating their potential to bypass safeguards or impede government responses to AI incidents. Using the 2017 Australian dual citizenship crisis as a case study, we illustrate how seemingly minor legal oversights can lead to large-scale governance disruption. We develop a methodology for creating "legal puzzles" as evaluation instruments for assessing AI systems' capabilities to discover such vulnerabilities. Our findings suggest that while current AI models may not reliably find impactful Legal Zero-Days, future systems may develop this capability, presenting both risks and opportunities for improving legal robustness. This work contributes to the broader effort to identify and mitigate previously unrecognized risks from frontier AI systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 21 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

6 of 21 references.

References · 6

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
  3. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
  4. 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 313
  5. 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 201
  6. 2024Evaluating Frontier Models for Dangerous Capabilitiescited by 128

Built on by

Not cited yet.