Mathematical Reasoning

Follow this topic Ask about this topic

Momentum

17 papers in the last four weeks, against 2 the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 113

All topics

PyraMathBench: Evaluating and Improving Mathematical Capability in Large Language Models
Jun 2, 2026Zetian Ouyang, Linlin Wang, Gerard de Melo +1Numerical Reasoning in Language Models Mathematical Reasoning Benchmarks
East China Normal University · Hasso Plattner Institute, University of Potsdam
Iteris: Agentic Research Loops for Computational Mathematics
Jun 1, 2026Leheng Chen, Zihao Liu, Wanyi He +1Mathematical Reasoning Large Language Model-Guided Scientific Discovery
School of Mathematical Sciences, Peking University · 5Zhongguancun Academy · 2Beijing International Center for Mathematical Research and the New Cornerstone Science Laboratory, Peking University +2
Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA
May 29, 2026Hao Chen, Xing Tang, Qirui Liu +6Retrieval-Augmented Generation Hallucination in Language Models
Shenzhen Technology University FiT, Tencent Shenzhen, China · South China University of Technology Guangzhou, China · The Hong Kong University of Science and Technology Hong Kong SAR, China +2
Distilling LLM Feedback for Lean Theorem Proving
May 29, 2026Gaetan Narozniak, Gérard Biau, Rémi Munos +2RL for Language Model Reasoning Mathematical Reasoning
FAIR at Meta, Inria · Sorbonne Université, Institut universitaire de France · FAIR at Meta +2
The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models
May 27, 2026Dueun Kim, Albert NoMasked Diffusion Models Language Model Decoding
Department of Artificial Intelligence, Yonsei University
Skill-Conditioned Gated Self-Distillation for LLM Reasoning
May 27, 2026Jiazhen Huang, Xiao Chen, Xiao Luo +3Mathematical Reasoning Self-Distillation
Tsinghua University · University of Wisconsin-Madison · X-Humanoid +2
Beyond Input Understanding: Diagnosing Multilingual Mathematical Reasoning with Directed Acyclic Trace Graphs
May 26, 2026Jiaqiao Zhang, Zhoujun Li, Raoyuan Zhao +5Mathematical Reasoning Low-Resource Language Processing
Southwest University · LMU Munich & MCML
Reasoning, Code, or Both? How Large Language Models Handle Variations in Math Questions
May 26, 2026Matthew KutakhCoT Reasoning Mathematical Reasoning
GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solving
May 25, 2026Yingji Zhang, Yong Dai, André FreitasLatent Visual Reasoning Mathematical Reasoning
X-Humanoid, China · Department of Computer Science, University of Manchester, UK · Idiap Research Institute, Switzerland +1
Tailoring Teaching to Aptitude: Direction-Adaptive Self-Distillation for LLM Reasoning
May 21, 2026Hongbin Zhang, Chaozheng Wang, Kehai Chen +4On-Policy Self-Distillation Mathematical Reasoning
Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China · Keeta AI, Meituan, Beijing, China · Peng Cheng Laboratory, Shenzhen, China
When Are Teacher Tokens Reliable? Position-Weighted On-Policy Self-Distillation for Reasoning
May 20, 2026Xiaogeng Liu, Xinyan Wang, Yingzi Ma +2CoT Distillation On-Policy Self-Distillation
1Johns Hopkins University · University of Wisconsin–Madison · 3Nanyang Technological University
Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interaction
May 20, 2026Juncheng Hu, Jiawei Du, Xin Zhang +1Mathematical Reasoning LLM Mathematical Reasoning
National University of Singapore, Singapore · Centre for Frontier AI Research, Agency for Science, Technology and Research, Singapore · Institute of High Performance Computing, Agency for Science, Technology and Research, Singapore
Using Aristotle API for AI-Assisted Theorem Proving in Lean 4: A Formalisation Case Study of the Grasshopper Problem
May 19, 2026Gabriel Rongyang LauMathematical Reasoning Lean Theorem Proving
Nanyang Technological University, Singapore
Detecting and Mitigating the Correct-Answer Extinction Window in Test-Time Reinforcement Learning with Majority Voting
May 19, 2026Hongxiang Lin, Zhirui Kuai, Erpeng Xue +1Reinforcement Learning RL for Language Model Reasoning
Meituan
LinAlg-Bench: A Forensic Benchmark Revealing Structural Failure Modes in LLM Mathematical Reasoning
May 15, 2026Shradha Agarwal, Deepak Rajbhar, Tariq JMathematical Reasoning Benchmarks LLM Evaluation
Department of Nuclear Engineering and Computer Science Missouri University of Science and Technology Rolla, Missouri
SAGE: Shaping Anchors for Guided Exploration in RLVR of LLMs
May 15, 2026Chanuk Lee, Minki Kang, Sung Ju HwangKL-Regularized RL RL for Language Model Reasoning
KAIST
From LLM-Generated Conjectures to Lean Formalizations: Automated Polynomial Inequality Proving via Sum-of-Squares Certificates
May 14, 2026Ruobing Zuo, Hanrui Zhao, Gaolei He +2Mathematical Reasoning Neuro-Symbolic Reasoning
School of Software Engineering, East China Normal University, Shanghai, China · College of Computer Science and Technology, National University of Defense Technology, Changsha, China · School of Computer and Information Engineering, Henan University, Kaifeng, China
Seirênes: Adversarial Self-Play with Evolving Distractions for LLM Reasoning
May 12, 2026Chi Zhang, Haibo Qiu, Qiming Zhang +3RL for Language Model Reasoning Adversarial Attacks on LLMs
School of Computer Science, Wuhan University · Meituan Inc · Independent Researchers +1
fg-expo: Frontier-guided exploration-prioritized policy optimization via adaptive kl and gaussian curriculum
May 12, 2026Mingxiong Lin, Zhangquan Gong, Maowen Tang +6Reinforcement Learning RL for Language Model Reasoning
OPPO AI Center
Hilbert-Geo: Solving Solid Geometric Problems by Neural-Symbolic Reasoning
May 11, 2026Ruoran Xu, Haoyu Cheng, Bin Dong +1Symbolic Reasoning Multimodal Reasoning
Xi’an Jiaotong-Liverpool University · Ricoh Software Research Center Beijing Co.,Ltd.
On-Policy Distillation with Best-of-N Teacher Rollout Selection
May 10, 2026Ke Zhang, Yunjie Tian, Dongdi Zhao +4CoT Distillation Best-of-N Sampling
Johns Hopkins University · TikTok · University of California, San Diego +1
Crosslingual On-Policy Self-Distillation for Multilingual Reasoning
May 10, 2026Yihong Liu, Raoyuan Zhao, Michael A. Hedderich +1On-Policy Self-Distillation Cross-Lingual Reasoning in Language Models
Center for Information and Language Processing, LMU Munich · Munich Center for Machine Learning (MCML)
Memorize Theorems, Not Instances: Probing SFT Generalization through Mathematical Reasoning
May 10, 2026Ruiying Peng, Mengyu Yang, Jing Lei +3Supervised Fine-Tuning Memorization in Language Models
Tsinghua Shenzhen International Graduate School · Huawei Technologies
Re $^2$ Math: Benchmarking Theorem Retrieval in Research-Level Mathematics
May 9, 2026Zicheng Lyu, Wenjie Yang, Shengzhong Zhang +1Mathematical Reasoning Benchmarks LLM Evaluation
Fudan University Shanghai, China · Nanjing University of Aeronautics and Astronautics Nanjing, Jiangsu, China · Fudan University Shanghai Innovation Institute Shanghai, China
MathConstraint: Automated Generation of Verified Combinatorial Reasoning Instances for LLMs
May 8, 2026Viresh Pati, Zhengyu Li, Piyush Jha +3Mathematical Reasoning Benchmarks Synthetic Benchmark Generation
Georgia Institute of Technology, USA · KNOWIDEA Technologies
Mathematical Reasoning via Intervention-Based Time-Series Causal Discovery Using LLMs as Concept Mastery Simulators
May 8, 2026Tsuyoshi OkitaMathematical Reasoning Causal Inference
Kyushu Institute of Technology
Adaptive Negative Reinforcement for LLM Reasoning:Dynamically Balancing Correction and Diversity in RLVR
May 8, 2026Yash Ingle, Jaival Chauhan, Ankit Yadav +1Reinforcement Learning RL for Language Model Reasoning
Sardar Vallabhbhai National Institute of Technology (SVNIT), Surat, India
AGPO: Asymmetric Group Policy Optimization for Verifiable Reasoning and Search Ads Relevance at JD
May 7, 2026Yang Xu, Kun Yao, Yiming Deng +3RL for Language Model Reasoning Policy Optimization
Nanjing University, Nanjing, China · Peking University, Beijing, China · JD.com, Beijing, China
Probing Structural Mathematical Reasoning in Language Models with Algebraic Trapdoors
May 5, 2026Igor RivinMathematical Reasoning Benchmarks Mathematical Reasoning
Igor Rivin
JURY-RL: Votes Propose, Proofs Dispose for Label-Free RLVR
Apr 28, 2026Xinjie Chen, Biao Fu, Jing Wu +4RL for Language Model Reasoning Mathematical Reasoning
Tongyi Lab, Alibaba Group, Hangzhou, China

Jun 2, 2026, cs.AIJ/K move · Enter open · S save

PyraMathBench: Evaluating and Improving Mathematical Capability in Large Language Models

Zetian Ouyang, Linlin Wang, Gerard de Melo, Liang He

East China Normal University · Hasso Plattner Institute, University of Potsdam

Numerical Reasoning in Language Models Mathematical Reasoning Benchmarks RL for Language Model Reasoning Mathematical Reasoning LLM Tool Use LLM Mathematical Reasoning

Open paper AskPDF arXiv

Despite the pivotal role of numerical reasoning as the cornerstone of mathematical capabilities in large language models (LLMs) across applications, few benchmarks evaluate LLMs by integrating numerical processing and mathematical reasoning, hindering the interpretability of failures in math tasks. We introduce PyraMathBench, a comprehensive hierarchical benchmark with 32,505 questions derived from 7,404 math word problems, spanning 4 key cognitive aspects, 14 subcategories, and 2 modalities. Experiments reveal that LLMs' performance is severely compromised by inadequate numerical computation and weak handling of abstract numerical questions. To address this, we propose the Smart Optimization & Learning-based VErsatile module (SOLVE) and Interactive Relative Policy Optimization (IRPO), which enhance LLMs' numerical-mathematical synergy via efficient tool calls (fuzzy matching and low-quality call rejection). Comparative experiments show Qwen-2.5 achieves a 5.0 score improvement with SOLVE and IRPO training.

Momentum

Related topics

Latest papers 113