Automated Theorem Proving

Follow this topic Ask about this topic

Momentum

13 papers in the last four weeks, up 86% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 103

All topics

TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics
Jun 8, 2026QuocViet Pham, Elvir Karimov, Andrey Galichin +1Mathematical Reasoning Benchmarks LLM Evaluation
Skolkovo Institute of Science and Technology · HSE University · Sberbank +1
Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery
Jun 7, 2026Syed Rifat Raiyan, Mohsinul Kabir, Hasan Mahmud +2Mathematical Reasoning Benchmarks Automated Theorem Proving
Systems and Software Lab (SSL), Department of Computer Science and Engineering, Islamic University of Technology, Gazipur, Bangladesh · Department of Computer Science, University of Manchester, Manchester, United Kingdom
Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement
Jun 4, 2026Jui-Hui Chung, Ziyang Cai, Zihao Li +14Automated Theorem Proving Lean Theorem Proving
1Princeton Language and Intelligence, Princeton University · 2Amazon.
Automated Proving of Shannon-Type Entropy Inequalities via Fine-Tuned Language Models and Guided Tree Search
Jun 4, 2026Shing Yin Wong, Shaocheng Liu, Linqi Song +2Automated Theorem Proving LLM Training
Department of Computer Science, City University of Hong Kong · Department of Information Engineering, The Chinese University of Hong Kong
Hypothesis-Disciplined Multi-Agent Automated Formalization of Asymptotic Statistical Theory
Jun 3, 2026Tingzhou Wei, Zeyu Zheng, Ethan X. Fang +1Automated Theorem Proving Lean Theorem Proving
Department of Biostatistics & Bioinformatics, Duke University · Department of Mathematical Sciences, Carnegie Mellon University · Department of Biostatistics, Harvard T.H. Chan School of Public Health
Optimizing the Cost-Quality Tradeoff of Agentic Theorem Provers in Lean
Jun 3, 2026Kári Rögnvaldsson, Chenhao Sun, Jasper Dekoninck +1Automated Theorem Proving Lean Theorem Proving
1ETH Zurich, Switzerland.
Abduction Prover in Isabelle/HOL
Jun 3, 2026Yutaka Nagashima, Daniel Sebastian GocAutomated Theorem Proving Abductive Reasoning
Institute of Computer Science, the Czech Academy of Sciences, Czechia
LEAP: Supercharging LLMs for Formal Mathematics with Agentic Frameworks
Jun 2, 2026Po-Nien Kung, Linfeng Song, Dawsen Hwang +10Mathematical Reasoning Benchmarks Automated Theorem Proving
Google Cloud AI Research · Google Cloud · Google DeepMind
A Theoretical Framework for Self-Play Theorem Proving Algorithms
Jun 1, 2026Thomas Chen, Zhiyuan LiAutomated Theorem Proving Language Model Self-Improvement
Expected Value Alignment for Generative Reward Modeling in Formal Mathematics Verification
May 31, 2026Shihao Ji, Haotao Tan, Zihui Song +1Reward Modeling Automated Theorem Proving
FVSpec: Real-World Property-Based Tests as Lean Challenges
May 31, 2026Quinn Dougherty, Max von Hippel, Simon Henniger +2Automated Software Testing Automated Theorem Proving
Forall R&D, work completed at Galois Inc · work completed at Galois Inc · Some work completed at Benchify +2
Automating Formal Verification with Reinforcement Learning and Recursive Inference
May 29, 2026Max TanRL for Code Generation Inference-Time Search
Department of Electrical Engineering and Computer Science · Massachusetts Institute of Technology
MerLean-Prover: A Recursive Looping Harness for Lean 4 Theorem Proving
May 26, 2026Jinzheng Li, Zeru Zhu, Yuanjie RenAutomated Theorem Proving Lean Theorem Proving
1Northeastern University · 2Stony Brook University · 3Massachusetts Institute of Technology
Keep the Proof State Live: Snapshotting for Efficient Tactic Search in Lean 4
May 25, 2026Austin Shen, Yunong ShiInference-Time Search Automated Theorem Proving
University of Michigan · Amazon Web Services
Agentic Proving for Program Verification
May 22, 2026Alessandro Sosso, Akhil Arora, Bas SpittersAutomated Theorem Proving Formal Verification
Department of Computer Science Aarhus University Aarhus, Denmark
Less Effort, Shorter Proofs: Reinforcement Learning for Security Protocol Analysis in Tamarin
May 22, 2026Matthias Cosler, Cas Cremers, Bernd Finkbeiner +2Reinforcement Learning Automated Theorem Proving
CISPA Helmholtz Center for Information Security, Saarbrücken, Germany · Technical University of Munich, Munich, Germany
Advancing Mathematics Research with AI-Driven Formal Proof Search
May 21, 2026George Tsoukalas, Anton Kovsharov, Sergey Shirobokov +18Automated Theorem Proving AI Agent Evaluation
1Google DeepMind1 · 2Aarhus University · 3Google
What are the Right Symmetries for Formal Theorem Proving?
May 21, 2026Krzysztof Olejniczak, Radoslav Dimitrov, Xingyue Huang +3Automated Theorem Proving Test-Time Augmentation
University of Oxford · KAIST · TU Wien +1
ImProver 2: Iteratively Self-Improving LMs for Neurosymbolic Proof Optimization
May 21, 2026Riyaz Ahuja, Tate Rowney, Jeremy Avigad +1LLM Self-Refinement Automated Theorem Proving
Carnegie Mellon University
OProver: A Unified Framework for Agentic Formal Theorem Proving
May 17, 2026David Ma, Kaijing Ma, Shawn Guo +7Automated Theorem Proving Lean Theorem Proving
M-A-P
Orthologic for SAT Solving
May 14, 2026Vladislas de Haldat, Simon Guilloud, Viktor KunčakLogical Reasoning Automated Theorem Proving
1EPFL
Formal Conjectures: An Open and Evolving Benchmark for Verified Discovery in Mathematics
May 13, 2026Moritz Firsching, Paul Lezeau, Salvatore Mercuri +8Mathematical Reasoning Benchmarks Automated Theorem Proving
Google DeepMind · Imperial College London · Stockholms universitet +1
Rethinking Supervision Granularity: Segment-Level Learning for LLM-Based Theorem Proving
May 12, 2026Shuo Xu, Jiakun Zhang, Junyu Lai +2Supervised Fine-Tuning Automated Theorem Proving
State Key Laboratory for Novel Software Technology, Nanjing University, China
FormalRewardBench: A Benchmark for Formal Theorem Proving Reward Models
May 11, 2026Zeynel A. Uluşan, Burak S. Akbudak, Can S. Erer +1Reward Modeling Automated Theorem Proving
Koç University, Department of Computer Science and Engineering · Codeway Studios · Bo˘gaziçi University, Department of Computer Engineering +1
Automated Formal Proofs of Combinatorial Identities via Wilf-Zeilberger Guidance and LLMs
May 6, 2026Beibei Xiong, Hangyu Lv, Junqi Liu +5Automated Theorem Proving Lean Theorem Proving
School of Software Engineering, East China Normal University, Shanghai, China · Institute of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China · School of Computer and Information Engineering, Henan University, Kaifeng, China
Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMs
May 1, 2026Jasper Dekoninck, Nikola Jovanović, Tim Gehrunger +4Mathematical Reasoning Benchmarks LLM Evaluation
ETH Zurich · INSAIT · Sofia University "St. Kliment Ohridski"
DreamProver: Evolving Transferable Lemma Libraries via a Wake-Sleep Theorem-Proving Agent
Apr 29, 2026Youyuan Zhang, Jialiang Sun, Hangrui Bi +4Automated Theorem Proving Program Synthesis
University of Toronto · UC Berkeley
QED: An Open-Source Multi-Agent System for Generating Mathematical Proofs on Open Problems
Apr 27, 2026Chenyang An, Qihao Ye, Minghao Pan +1AI Agents for Scientific Discovery Automated Theorem Proving
University of California, San Diego, La Jolla, USA · California Institute of Technology, Pasadena, USA · Amazon Web Services
OptProver: Bridging Olympiad and Optimization through Continual Training in Formal Theorem Proving
Apr 26, 2026Chenyi Li, Yanchen Nie, Zhenyu Ming +3Continual Learning for LLMs Automated Theorem Proving
School of Mathematical Sciences, Peking University · 2Huawei Technologies · Center for Machine Learning Research, Peking University +1
Benchmarking Testing in Automated Theorem Proving
Apr 26, 2026Jongyoon Kim, Hojae Han, Seung-won HwangLLM Evaluation Automated Theorem Proving
Interdisciplinary Program in Artificial Intelligence, Seoul National University1 · Electronics and Telecommunications Research Institute2

Jun 8, 2026, cs.AIJ/K move · Enter open · S save

TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics

QuocViet Pham, Elvir Karimov, Andrey Galichin, Ivan Oseledets

Skolkovo Institute of Science and Technology · HSE University · Sberbank+1

Mathematical Reasoning Benchmarks LLM Evaluation Automated Theorem Proving Benchmark Design Lean Theorem Proving

Open paper AskPDF arXiv

LLMs have recently achieved strong results on formal proving benchmarks. However, existing evaluations remain heavily concentrated on competition-style problems and often fail to capture how models behave on longer, more dependency-rich mathematical developments. We introduce TheoremBench, a Lean4 benchmark designed to evaluate theorem provers beyond contest settings. The benchmark is built from nearly one hundred classical theorems and is released in two complementary forms: a plain main version containing one target theorem per instance, and a premised version that expands each theorem into a structured family of related proving tasks consisting of the main theorem together with automatically extracted supporting subtheorems. This design enables evaluation of not only whether the final theorem was proved from scratch, but also of partial progress through the internal proof structure of a theorem. Our experiments show that explicit premises substantially improve performance for Lean4-capable prover models. To provide a comprehensive evaluation, we introduce theorem-level coverage and token-efficiency metrics that expose qualitative differences in proof behavior. The results show that current provers remain strongly biased toward easy subtheorems and often solve theorems through long and inefficient tactic traces rather than compact proof plans. TheoremBench therefore provides a more fine-grained view of formal reasoning ability and highlights the importance of structural benchmark design for evaluating Lean4 theorem provers.

Momentum

Related topics

Latest papers 103