Scratchy: Visual-Scratchpad Multimodal Reasoning for Cryptographic Proof Generation in EasyCrypt
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large language models (LLMs) have recently made substantial progress in formal proof generation, yet presenting distinctive challenges in cryptographic area. Computational security arguments posit that a valid proof must coordinate probability, adversarial games, invariants, assumptions and bounds, which can be provided by a machine-checked framework named EasyCrypt. Although all objects may appear in available context, LLMs still struggle because proof-theoretic dependencies are typically implicit in a linear representation and distributed across multiple programs. So, this paper presents Scratchy, a visual-scratchpad approach that exposes these dependencies for multimodal generation. Given the natural-language security description, with formal context and target propositions, the proof objects can be normalized into a typed proof-relation graph. Then a structure-preserving visual compiler transforms the graph into the formula-rich visual proof state that guides a multimodal model in generating the EasyCrypt proof. Also, the Scratchy-eval, a 114-task dataset derived from reliable official EasyCrypt files, has been introduced. It contains 64 security-form proof generations and 50 multiple-choice knowledge tests. After a series of evaluations, covering semantic grounding, relational invariants, and game reductions, classical LLMs like GPT-5.6-Sol and Claude-Opus-5 have gained a clear advantage from Scratchy's structured visual proof states. This contrast suggests that explicit proof structure can make the improvement and multimodal proof-state representation as a promising direction for computer-aided cryptography.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 1 of its 26 references that are in the map. First posted on arXiv 5 Sep 2026.
Builds on
1 of 26 references.
References · 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CipherBank: Exploring the Boundary of LLM Reasoning Capabilities through Cryptography Challenges
- 2025Benchmarking Large Language Models for Cryptanalysis and Side-Channel Vulnerabilities
- 2025From Evaluation to Enhancement: Large Language Models for Zero-Knowledge Proof Code Generation ↗
- 2025CryptoScope: Utilizing Large Language Models for Automated Cryptographic Logic Vulnerability Detection
- 2025The Trojan Example: Jailbreaking LLMs through Template Filling and Unsafety Reasoning
- 2025Three Minds, One Legend: Jailbreak Large Reasoning Model with Adaptive Stacked Ciphers
- 2026DHMark: Public-Key Watermarking for LLM-Generated Text via Diffie-Hellman-Guided Rejection Sampling
- 2026Evaluating Large Language Models for Symbolic Security Protocol Analysis