cs.CRSep 5, 2026

Scratchy: Visual-Scratchpad Multimodal Reasoning for Cryptographic Proof Generation in EasyCrypt

Authors: Yupeng Ren, Zhaoxuan Li, Rui Zhang

Organizations: State Key Laboratory of Cyberspace Security Defense, Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100085, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing 100049, China

Abstract

Large language models (LLMs) have recently made substantial progress in formal proof generation, yet presenting distinctive challenges in cryptographic area. Computational security arguments posit that a valid proof must coordinate probability, adversarial games, invariants, assumptions and bounds, which can be provided by a machine-checked framework named EasyCrypt. Although all objects may appear in available context, LLMs still struggle because proof-theoretic dependencies are typically implicit in a linear representation and distributed across multiple programs. So, this paper presents Scratchy, a visual-scratchpad approach that exposes these dependencies for multimodal generation. Given the natural-language security description, with formal context and target propositions, the proof objects can be normalized into a typed proof-relation graph. Then a structure-preserving visual compiler transforms the graph into the formula-rich visual proof state that guides a multimodal model in generating the EasyCrypt proof. Also, the Scratchy-eval, a 114-task dataset derived from reliable official EasyCrypt files, has been introduced. It contains 64 security-form proof generations and 50 multiple-choice knowledge tests. After a series of evaluations, covering semantic grounding, relational invariants, and game reductions, classical LLMs like GPT-5.6-Sol and Claude-Opus-5 have gained a clear advantage from Scratchy's structured visual proof states. This contrast suggests that explicit proof structure can make the improvement and multimodal proof-state representation as a promising direction for computer-aided cryptography.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. ProofSketcher: Hybrid LLM + Lightweight Proof Checker for Reliable Math/Logic Reasoning

    Apr 7, 2026Kranthi Kommuru, Kunal Khanvilkar, Gaurav ParekhLarge Language Model-Guided Theorem ProvingAutomated Theorem Proving

  2. s2n-bignum-bench: A practical benchmark for evaluating low-level code reasoning of LLMs

    Mar 15, 2026Balaji Rao, John Harrison, Soonho Kong +2Large Language Model-Guided Theorem ProvingAutomated Theorem Proving

  3. An AI Approach to Verified Production Cryptographic Libraries

    Aug 2, 2026Chuyue Sun, Su Fong, Zhiyi Kuang +5Software SecurityProgram Synthesis