cs.CLNov 12, 2026

daVinci-Prover: Agent-Native Mid-Training for Formal Theorem Proving

Authors: Wenhong Zhu, Xuefeng Li, Jiashuo Zhang, Yu Chen, Tiantian Mi, Qipeng Guo, Pengfei Liu

Organizations: Shanghai Innovation Institute · Shanghai Jiao Tong University · Generative Artificial Intelligence Research Lab (GAIR) · Fudan University

Abstract

Advances in large language models (LLMs) are rapidly transforming formal theorem proving. Yet further progress remains constrained by the lack of a transparent and effective data recipe for systematically improving theorem-proving models. In this work, we argue that effective agentic provers require strong mathematical skill priors to ground theorem proving and agentic trajectories to enable long-horizon, interactive proof construction. To this end, we synthesize an agent-native 33.7B-token mid-training corpus covering decomposition, search, self-verification, and revision, together with verifier-grounded agentic trajectories. We further introduce the daVinci-Prover harness, which enables models to construct proofs and interact with a Lean verifier in an isolated workspace, and use it to collect approximately 36K high-quality agent trajectories for supervised fine-tuning. Our mid-training recipe yields an average improvement of 13.7 points over the matched Qwen3-8B SFT-only baseline across MiniF2F, FATE-M, and ProofNet. When applied to the Qwen3.5 series, our approach also yields strong performance across theorem-proving benchmarks and achieves near-saturating MiniF2F performance with memory compaction. The results highlight agent-native mid-training as an effective foundation for developing stronger interactive theorem-proving agents.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. AIProver: Agentic Auto-Formalization of Mathematical Research via Certificate-Driven Evolving Harness

    Oct 4, 2026Prithwish Jana, Viet Bach Hoang, Logan Luna +9Mathematical Reasoning BenchmarksAutomated Theorem Proving

  2. OpenProver: Agentic and Interactive Theorem Proving with Lean 4

    Jul 10, 2026Matěj Kripner, Milan StrakaMulti-Agent LLM SystemsAutomated Theorem Proving