Overview

Autoformalization translates informal mathematical statements, proofs, and software or scientific requirements into forms that proof assistants and solvers can check. Systems commonly combine language models with library retrieval, dependency-aware decomposition, and iterative feedback from Lean or Isabelle checkers, provers, model checkers, and tests. Benchmarks span competition and textbook mathematics, first-order logic, and executable software specifications, while agentic workflows increasingly tackle larger theories and research developments. The central challenge is semantic faithfulness: a formal artifact can compile or verify while misstating its source, so evaluation increasingly combines execution with equivalence checks, adversarial tests, and human review.

Latest papers

CardsList

116 papers18 papers in the last four weeks, up 100% on the four weeks before. 0.1% of all new papers.

  1. Sorries Are Not the Hard Part: An Expert-Review Case Study of a Semi-Autonomous Formalization

    Jun 11, 2026Vasily Ilin, Brian NugentFormal VerificationLean Theorem Proving

  2. (Auto)formalization is supposed to be easy: Trellis process semantics for spelling out rigorous proofs

    Jun 8, 2026Wesley PegdenLLM Self-RefinementLLM Agents

  3. Reasoning without Gold Standards: A Proxy-Judge Theory of Autoformalization

    Jun 8, 2026Lei Xu, Xin Quan, André FreitasLLM Self-RefinementLLM-as-a-Judge

  4. Can LLMs Write Correct TLA+ Specifications? Evaluating Natural-Language-to-TLA+ Generation

    Jun 4, 2026Arslan Bisharat, Brian Ortiz, Eric Spencer +5LLM EvaluationFormal Verification

  5. LeanMarathon: Toward Reliable AI Co-Mathematicians through Long-Horizon Lean Autoformalization

    Jun 3, 2026Yuanhe Zhang, Yuekai Sun, Taiji Suzuki +2Lean Theorem ProvingAutoformalization

  6. Hypothesis-Disciplined Multi-Agent Automated Formalization of Asymptotic Statistical Theory

    Jun 3, 2026Tingzhou Wei, Zeyu Zheng, Ethan X. Fang +1Automated Theorem ProvingLean Theorem Proving

  7. Characterizing initial human-AI proof formalization workflows

    Jun 2, 2026Katherine M. Collins, Simon Frieder, Jonas Bayer +14Human-in-the-Loop AIAutoformalization

  8. Robust Asynchronous Planning via Auto-Formalization

    May 31, 2026Jiayi Zhang, Jianing Yin, Ben Zhou +1LLM PlanningSymbolic Planning

  9. Formalizing Mathematics at Scale

    May 28, 2026Ahmad Rammal, Niket Patel, Fabian Gloeckle +5Formal VerificationLean Theorem Proving

  10. Risk-Controlled Lean-as-Judge for Natural-Language Mathematical Reasoning

    May 27, 2026Pauline Bourigault, Xiaotong Ji, Matthieu Zimmer +2LLM Answer VerificationSelective Prediction

  11. Verus-SpecGym: An Agentic Environment for Evaluating Specification Autoformalization

    May 26, 2026Anmol Agarwal, Natalie Neamtu, Pranjal Aggarwal +6LLM Agent EvaluationFormal Verification

  12. By Their Fruits You Will Know Them: Comparing Formalizations of Law by the Decisions They Encode

    May 24, 2026Julius Vernie, Matthias GrabmairLLM EvaluationDifferential Testing

  13. Lean-GAP: A Dataset of Formalized Graduate Algebra Problems

    May 20, 2026Seewoo Lee, Byung-Hak Hwang, Hyojae Lim +10Mathematical Reasoning BenchmarksFormal Verification

  14. Pseudo-Formalization for Automatic Proof Verification

    May 19, 2026Slim Barkallah, Luke Bailey, Kaiyue Wen +2Mathematical Reasoning BenchmarksLLM-as-a-Judge

  15. Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Models

    May 14, 2026Frederik Schmitt, Matthias Cosler, Niklas Metzger +4Program SynthesisFormal Verification

  16. MathAtlas: A Benchmark for Autoformalization in the Wild

    May 13, 2026Nilay Patel, Noah Arias, Davit Babayan +7Mathematical Reasoning BenchmarksAutoformalization

  17. Formal Conjectures: An Open and Evolving Benchmark for Verified Discovery in Mathematics

    May 13, 2026Moritz Firsching, Paul Lezeau, Salvatore Mercuri +8Mathematical Reasoning BenchmarksAutomated Theorem Proving

  18. Coherency through formalisations of Structured Natural Language, A case study on FRETish

    May 11, 2026Joost J. Joosten, Marina López Chamosa, Sofía Santiago FernándezFormal VerificationAutoformalization

  19. CodeClinic: Evaluating Automation of Coding Skills for Clinical Reasoning Agents

    May 10, 2026Timothy Ossowski, Xinchi Liu, Danyal Maqbool +6HealthcareLLM Agent Skill Learning

  20. VeriContest: A Competitive-Programming Benchmark for Verifiable Code Generation

    May 8, 2026Zichen Xie, Mrigank Pawagi, Yuxin Liu +5Code GenerationFormal Verification

  21. LiveFMBench: Unveiling the Power and Limits of Agentic Workflows in Specification Generation

    May 2, 2026Dong Xu, Jialun Cao, Guozhao Mo +9LLM Agent EvaluationFormal Verification

  22. Autoformalizing Memory Specifications with Agents

    Apr 30, 2026Jan Ole Ernst, Dmitri Michelangelo Saberi, Derek Christ +6Formal Hardware VerificationAutoformalization

  23. Faithful Autoformalization via Roundtrip Verification and Repair

    Apr 27, 2026Daneshvar Amrollahi, Jerry Lopez, Clark BarrettLLM Self-CorrectionLegal NLP

  24. Characterizing Paraphrase-Induced Failures in Lean 4 Autoformalization

    Apr 25, 2026William Feng, Ethan Lou, Aryan SharmaLean Theorem ProvingCode Generation Evaluation

  25. FormalScience: Scalable Human-in-the-Loop Autoformalisation of Science with Agentic Code Generation in Lean

    Apr 24, 2026Jordan Meadows, Lan Zhang, Andre FreitasHuman-in-the-Loop AIAgentic Code Generation

  26. BODHI: Precise OS Kernel Specification Inference

    Apr 22, 2026Zhiming Chang, Ziyang LiKnowledge Augmentation for Language ModelsLLM Prompting

  27. Decompose, Structure, and Repair: A Neuro-Symbolic Framework for Autoformalization via Operator Trees

    Apr 21, 2026Xiaoyang Liu, Zineng Dong, Yifan Bai +3LLM Self-CorrectionNeuro-Symbolic Reasoning