cs.AIAug 17, 2026

Assessing LLMs' mathematical abilities requires understanding the various mechanisms of mathematical creativity

Authors: Silvère Gangloff

Organizations: University of Ostrava, Ostrava, Czech Republic.

Abstract

How should we assess whether large language models can perform mathematical invention? I argue that this question is currently underspecified: mathematical creativity is not one capacity but several mechanistically distinct modes of meaning-making - reflexive introspection on mathematical practice, analogical import from the sciences, problem-driven construction, and the bridging of distant domains - together with a further, cross-cutting distinction between meaning pursued because a pattern was observed and meaning pursued because it is strategically wanted, a distinction I develop through the case of conjecture-formation. These mechanisms are likely non-substitutable, so that competence in one does not transfer to the others. Grounding each in a historical case study and in an architecture-level account of current transformer-based systems, I suggest that today's models concentrate their competence in modes shaped by recombination and search over existing building blocks; if that description holds, the remaining modes are out of reach in principle, not just slower - though whether it holds is itself the open, empirical part. Because proof is getting cheaper as AI improves at generating it - a shift the field's own leading voices are now diagnosing - mathematical value is migrating toward the modes current systems cannot yet perform, and evaluations of AI mathematical ability should be organized around this taxonomy rather than around aggregate benchmarks that conflate it.

Explore similar work

CardsList
  1. LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketches

    Apr 2, 2026Linyang He, Qiyao Yu, Hanze Dong +5Mathematical Reasoning BenchmarksLLM Evaluation

  2. LemmaBench: A Live, Research-Level Benchmark to Evaluate LLM Capabilities in Mathematics

    Feb 27, 2026Antoine Peyronnet, Fabian Gloeckle, Amaury HayatMathematical Reasoning BenchmarksAutomated Theorem Proving

  3. Can LLM generate interesting mathematical research problems?

    Mar 19, 2026Xiaoyang Chen, Xiang JiangMathematical Problem GenerationResearch Idea Generation