Chai: Agentic Discovery of Cryptographic Misuse Vulnerabilities
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
AI-assisted vulnerability discovery has proven effective for bug classes like memory safety, where instrumentation confirms memory violations and efficiently filters false positives. Many dangerous vulnerability classes, such as cryptographic misuse, however, lack any comparable instrumentation. In this work, we present Chai, an AI-based system that discovers and validates cryptographic misuse vulnerabilities through naturally occurring signals. To achieve this, Chai rethinks the classical technique of differential testing by leveraging AI to 1) improve precision for detecting real security issues in libraries, and 2) repurpose commonly overlooked discrepancies as leads for tangible vulnerabilities in downstream applications. In doing so, Chai inverts the prevailing paradigm of AI vulnerability discovery: instead of auditing one codebase for many flaws, it catalogs flaws at the library level and propagates them across a cryptographic dependency graph, delivering compounding efficiency gains. We evaluate Chai across X.509, JWT, and SAML libraries. Chai discovered a previously unknown critical vulnerability in an SSL library that powers billions of devices, along with security bugs in one library behind a major web browser and another in major Linux distributions. In total, these techniques surfaced over 100 vulnerabilities.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 12 of its 65 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
12 of 65 references.
Closest ancestors · 4
Same direction, newest first
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction20 May
- 2026ExploitBench: A Capability Ladder Benchmark for LLM Cybersecurity Agents13 May
- 2026ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?11 May
- 2024LLM Agents can Autonomously Exploit One-day Vulnerabilities11 Apr
Other references · 8
- 2025CyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scalecited by 78
- 2019Small World with High Risks: A Study of Security Threats in the npm Ecosystemcited by 37
- 2023Prompt Fuzzing for Fuzz Driver Generationcited by 27
- 2025Incalmo: An Autonomous LLM-assisted System for Red Teaming Multi-Host Networkscited by 17
- 2025ELFuzz: Efficient Input Generation via LLM-driven Synthesis Over Fuzzer Spacecited by 15
- 2026SoK: DARPA's AI Cyber Challenge (AIxCC): Competition Design, Architectures, and Lessons Learnedcited by 9
- 2024Generating API Parameter Security Rules with LLM for API Misuse Detectioncited by 7
- 2026OSS-CRS: Liberating AIxCC Cyber Reasoning Systems for Real-World Open-Source Securitycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Code-Augur: Agentic Vulnerability Detection via Specification Inference
- 2025Agentic Discovery and Validation of Android App Vulnerabilities
- 2026MobileCybench: Evaluating Agent Vulnerability Discovery via Executable Probes
- 2025LibVulnWatch: A Deep Assessment Agent System and Leaderboard for Uncovering Hidden Vulnerabilities in Open-Source AI Libraries
- 2026Antaeus: Hunting Repository-Level Logic Vulnerabilities via Context-Grounded LLM Reasoning ↗
- 2025From base cases to backdoors: An Empirical Study of Unnatural Crypto-API Misuse ↗
- 2026CWE-bench: Refocusing Agentic Security from Exploitation to Defense
- 2025Automated Vulnerability Validation and Verification: A Large Language Model Approach