LLM Mathematical Reasoning

LLM: Large Language Model

Overview

The field investigates whether language models can carry out arithmetic, multi-step problem solving, and proof construction reliably—not just produce correct-looking answers. Common approaches include chain-of-thought prompting, supervised and reinforcement learning, test-time search and voting, tool use with code or computer algebra, and formal verification with proof assistants such as Lean. Evaluation spans word-problem and contest benchmarks such as GSM8K, MATH, and AIME, as well as formal proof tasks like miniF2F; newer tests probe robustness to equivalent transformations, multilingual inputs, and research-level problems. Models can perform strongly on familiar contest tasks, but generalization, faithful reasoning, proof quality, and reliable verification remain unresolved tensions, especially on open-ended research mathematics.

Latest papers

CardsList

282 papers10 papers in the last four weeks, down 66% on the four weeks before. 0.1% of all new papers.

  1. AI has its own style in mathematical proving

    Nov 12, 2026Xiaokai Li, Ziyu Zhou, Qibin Cheng +3LLM Mathematical ReasoningLarge Language Model-Guided Theorem Proving

  2. ProofDiff: Auditable Argument-Level Comparison of AI-Generated Mathematical Proofs

    Nov 6, 2026Matan Tsafrir, Esdras Medeiros, Jorge Poco +3Computational ArgumentationLLM Mathematical Reasoning

  3. ReSI-Math: Exploring Recoverable Capability Frontiers for Efficient Reasoning Improvement

    Nov 3, 2026Yao Cui, Zhen Yang, Yuandong Wang +3LLM Mathematical ReasoningEfficient Language Model Reasoning

  4. Scaling Mathematical Proof Supervision from Structured Textbooks

    Oct 29, 2026Youqing Fang, Zhouqi Hua, Yinhao Tang +7LLM Mathematical ReasoningStructured Reasoning in Language Models

  5. Beyond Selected Breakthroughs: Evaluating Language Models on Randomly Sampled Mathematical Conjectures

    Oct 29, 2026Helen Jenne, Davis Brown, Jesse He +1LLM Mathematical ReasoningAI-Assisted Mathematical Discovery

  6. Efficient Proof Generation for Lean Statements with Multiple Candidate Answers

    Oct 25, 2026Pengzhen Lin, Ke Zhang, Maziar Raissi +1Automated Theorem ProvingLLM Mathematical Reasoning

  7. IneqAgent: Agentic Inequality Proving in Lean with Symbolic Computation

    Oct 14, 2026Gaolei He, Jinhui Li, Ruobing Zuo +2Lean Theorem ProvingLLM Mathematical Reasoning

  8. Attention-Graph Curvature for the Verification of Mathematical Reasoning

    Oct 12, 2026Kanghyeon Kim, Johannes F. Lutzeyer, Yanzhu GuoLanguage Model Error DetectionReasoning Verification

  9. ACED: Reference-Anchored Aggregation of Natural-Language and Executable Evidence for Mathematical Reasoning

    Oct 12, 2026Yiyi Lu, Jiaxiang Geng, Bing LuoLLM Mathematical ReasoningLLM Reasoning

  10. MathVis: Can AI Reason through Drawing? A Benchmark for Mathematical Figure Generation

    Oct 9, 2026Jingjing Wei, Hao Zhao, Xinke Li +3Mathematical Reasoning BenchmarksLLM Mathematical Reasoning

  11. Bolzano: From Expert-Guided Proof Search to Automated Open-Problem Solving

    Oct 7, 2026Adrián Zámečník, Matěj Kripner, Martin Koutecký +5Automated Theorem ProvingAI Agents for Scientific Discovery

  12. Can the Library Speak? Self-Advertised Method Selection for Formal Proving

    Oct 7, 2026Xiaopeng Yuan, Suijin Wang, Yanli Wang +5Automated Theorem ProvingLLM Mathematical Reasoning

  13. When Tools Lie: Reliability of Mathematical Agents Under Corrupted Tool Feedback

    Oct 6, 2026Kavienan Jegatheesan, Gayathri LihinikaduarachchiLLM Agent VerificationLLM Agent Reliability

  14. CALR: Continuous Anchored Latent Reasoning via Render-of-Thought Compression

    Oct 5, 2026Zhaoyang Wei, Bowen Jiang, Yanchao Hao +5Efficient Language Model ReasoningLatent Visual Reasoning

  15. The Missing Primitive: Diagnosing and Repairing Mathematical Reasoning in Large Language Models

    Oct 1, 2026Shuo Xing, Zilin Dai, Chengyuan Qian +7Mathematical Reasoning BenchmarksSelf-Distillation

  16. Function-Structured Reinforcement Learning with Executable Verifiers for Mathematical Reasoning

    Oct 1, 2026Zihan Liu, Xurong XieLLM Reasoning with GraphsRL for Language Model Reasoning

  17. ReSolve: Reusing Candidate Reasoning through Selective Generative Moderation

    Oct 1, 2026Bangji Yang, Jiajun Fan, Hongbo Ma +6Efficient Language Model ReasoningInference-Time Compute Allocation

  18. Improving Math Reasoning through Value-guided Informative Search

    Oct 1, 2026Shaohuai Liu, Yuning Wu, Haoran Liu +3RL for Language Model ReasoningReinforcement Learning with Verifiable Rewards

  19. Mathematical Transfer in LLMs Follows Reasoning Approach More Than Topic

    Sep 29, 2026Sajad Goudarzi, Samaneh Zamanifard, Seyed Amin Seyed Haeri +2Transfer LearningLLM Mathematical Reasoning

  20. Beyond Compression: Diagnosing How Post-Training Changes Mathematical Reasoning

    Sep 29, 2026Hongyang Li, Yiming Zhu, Xiao Li +3Language Model DistillationRL Post-Training