CryptoScope: Utilizing Large Language Models for Automated Cryptographic Logic Vulnerability Detection
Not on the map. Why?
Abstract (arXiv)
Cryptographic algorithms are fundamental to modern security, yet their implementations frequently harbor subtle logic flaws that are hard to detect. We introduce CryptoScope, a novel framework for automated cryptographic vulnerability detection powered by Large Language Models (LLMs). CryptoScope combines Chain-of-Thought (CoT) prompting with Retrieval-Augmented Generation (RAG), guided by a curated cryptographic knowledge base containing over 12,000 entries. We evaluate CryptoScope on LLM-CLVA, a benchmark of 92 cases primarily derived from real-world CVE vulnerabilities, complemented by cryptographic challenges from major Capture The Flag (CTF) competitions and synthetic examples across 11 programming languages. CryptoScope consistently improves performance over strong LLM baselines, boosting DeepSeek-V3 by 11.62%, GPT-4o-mini by 20.28%, and GLM-4-Flash by 28.69%. Additionally, it identifies 9 previously undisclosed flaws in widely used open-source cryptographic projects.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 6 of its 30 references that are in the map. First posted on arXiv 15 Aug 2025.
Builds on
6 of 30 references.
References · 6
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2018CryptoGuard: High Precision Detection of Cryptographic Vulnerabilities in Massive-sized Java Projectscited by 8
- 2024Beyond Static Pattern Matching? Rethinking Automatic Cryptographic API Misuse Detection in the Era of LLMscited by 6
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025BudgetLeak: Membership Inference Attacks on RAG Systems via the Generation Budget Side Channelcited by 3
- 2025CoTDeceptor:Adversarial Code Obfuscation Against CoT-Enhanced LLM Code Agentscited by 3
- 2026Bulkhead: Automated Semantic Detection and Remediation of Container Escape Vulnerabilitiescited by 0
- 2026Bulkhead: Automated Semantic Detection and Remediation of Container Escape Vulnerabilities14 Jul 2026
- 2025CoTDeceptor:Adversarial Code Obfuscation Against CoT-Enhanced LLM Code Agents24 Dec 2025
- 2025BudgetLeak: Membership Inference Attacks on RAG Systems via the Generation Budget Side Channel15 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Benchmarking Large Language Models for Cryptanalysis and Side-Channel Vulnerabilities
- 2026An Empirical Security Evaluation of LLM-Generated Cryptographic Rust Code ↗
- 2025CipherBank: Exploring the Boundary of LLM Reasoning Capabilities through Cryptography Challenges
- 2026SecureRAG-RTL: A Retrieval-Augmented, Multi-Agent, Zero-Shot LLM-Driven Framework for Hardware Vulnerability Detection
- 2024CryptoFormalEval: Integrating LLMs and Formal Verification for Automated Cryptographic Protocol Vulnerability Detection
- 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning
- 2026OpenAnt: LLM-Powered Vulnerability Discovery Through Code Decomposition, Adversarial Verification, and Dynamic Testing
- 2026SEC-bench Pro: Can Language Models Solve Long-Horizon Software Security Tasks?