Mathematical Reasoning Benchmarks

Follow this topic Ask about this topic

Momentum

13 papers in the last four weeks, up 117% on the four weeks before. 0.2% of all new papers.

Jul 6Week of Sep 21

Latest papers 101

All topics

Improving Math Reasoning through Value-guided Informative Search
Oct 1, 2026Shaohuai Liu, Yuning Wu, Haoran Liu +3Mathematical Reasoning Benchmarks Reinforcement Learning With Verifiable Reward
Amazon · Department of Electrical and Computer Engineering, Texas A&M University
Reason in Style: Discovering and Controlling Style in Language Models
Sep 30, 2026Ioana Marinescu, Eric Karl Oermann, Kyunghyun ChoStylistic Fidelity Style
NYU · NYU & NYU Langone Health
Exploring More, Reasoning Better: Stepwise Risk-Sensitive GRPO for Diffusion Language Models
Sep 30, 2026Yue YU, Bowen Zuo, David Crandall +2Diffusion Language Models Large Language Model Reinforcement Learning
Indiana University · University of California, Riverside
Correct Answers, Invalid Traces: What Verifiable Grade-School Math Reveals About Chain-of-Thought Traces
Sep 29, 2026Ratish Puduppully, Pranabendu Misra, Paarth Iyer +3Reasoning Traces Chain-of-Thought Reasoning
IT University of Copenhagen · Chennai Mathematical Institute · Indian Institute of Technology Jammu +1
From Dissonance to Orchestration: Teacher Intervention in On-Policy Distillation
Sep 29, 2026Yuhao Wang, Ruiyang Ren, Yinan Zhang +3Teacher Mathematical Reasoning Benchmarks
Nanyang Technological University, Singapore · Baidu Inc.
Selecting Diverse SFT Traces Improves Post-RL Generalization
Sep 27, 2026Dylan Zhang, Mingyuan Wu, Jinning LiSupervised Finetuning Reasoning Paths
University of Illinois Urbana-Champaign, work done at Google · Google
What Shared Prefixes Hide: Trajectory Dropout for On-Policy Distillation
Sep 27, 2026Zizhuo Lin, Quanling Liu, Yi Yang +1Teacher Process-Level Supervision
Zhejiang University
Multimodal Thinking with Renderable Programs
Sep 24, 2026Sunli Chen, Ding Zhong, Ziqiao Ma +6Scalable Vector Graphic Mathematical Reasoning Benchmarks
University of Massachusetts Amherst · University of Michigan · University of Illinois Urbana-Champaign +1
When and Where to Trust the Teacher: Unifying On-Policy Distillation and GRPO through Entropy-Calibrated Credit Assignment
Sep 23, 2026Jie Zhang, Jingxiao Yang, Zhehao Huang +2Reinforcement Learning With Verifiable Reward Teacher
Shanghai Jiao Tong University · Zhejiang University
Planned Test-Time Scaling with Coordinated Reasoning Paths
Sep 23, 2026Xueqing Wu, Langxing Bai, Hritik Bansal +5Test-Time Scaling Test Time
University of California, Los Angeles · Amazon
Giving Credit Where It's Due: Redundancy-Aware Learning for Efficient Reasoning
Sep 22, 2026Yuqing Zhou, Hong Wang, Manqing Mao +8Reasoning Traces Mathematical Reasoning Benchmarks
George Mason University · Amazon, Inc
Math Reasoning in LLMs is Organized by Approach, Not Topic
Sep 22, 2026Sajad Goudarzi, Samaneh Zamanifard, Moloud Nasiri +1Mathematical Reasoning Benchmarks Large Language Model Tool Use
Clemson University
iSDFT: Information-Proximal Self-Distillation for Continual Learning in LLMs
Sep 21, 2026Ahmed Khaled Khamis, Xiaotong Ji, Hassan Jaber +4Self-Distillation Framework Self-Teacher
Imperial College London · Politecnico di Torino · UCL Centre for AI
Voice of Reason: Reinforcement Learning for Spoken Math
Sep 16, 2026Timothée Weisselberger, Edouard Graves, Alexandre DéfossezSpeech Language Models Mathematical Reasoning Benchmarks
Kyutai Paris, France · Kyutai, Gradium Paris, France
ChitraMiti: Benchmarking Visual Grounding and Modality Reliance in Bengali Geometric Reasoning
Sep 14, 2026Khan Raiyan Ibne Reza, Sanjana Aktar Maria, Sumaiya Tabassum Nimi +1Multimodal Reasoning Benchmarks Mathematical Reasoning Benchmarks
North South University
Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning
Sep 9, 2026Yaning Jia, Chunhui Zhang, Wenxuan Xu +3Supervised Finetuning Mathematical Reasoning Benchmarks
Dartmouth College · Carnegie Mellon University
Difficulty-Adaptive Tree-Structured Policy Optimization for Expanding Reasoning Coverage in RLVR
Sep 8, 2026Youngjun Yu, Sanghwan Jang, Hwanjo YuReinforcement Learning With Verifiable Reward Autoregressive Rollout
Pohang University of Science and Technology (POSTECH)
Learning What to Practice: Diagnosis-Guided Self-Evolution for Language Models
Sep 1, 2026Xincheng Wei, Yifan Ding, Fucheng Xiong +6Self-Evolution Mathematical Reasoning Benchmarks
The Chinese University of Hong Kong, Shenzhen · Meituan, LongCat Team · Peking University +2
Numeracy in Large Language Models: Fundamental Limitations and Paths to Improvement
Aug 13, 2026Aoxin NiMathematical Reasoning Benchmarks Fundamental Limits
Department of Computer Science University of Chinese Academy of Sciences
Mismatch Matters: On-Policy Distillation Beyond Token Agreement
Aug 10, 2026Zichao Yu, Chengzhi Yu, Shengze Xu +4Teacher Mismatch
The University of Hong Kong · University of Science and Technology of China · The Chinese University of Hong Kong
Privileged Solutions or Context-Induced Teacher Behavior? Dissecting On-Policy Self-Distillation
Aug 10, 2026Yuki Ichihara, Naoto Iwase, Mohammad Atif Quamar +1Teacher Privileged Context
Mohamed bin Zayed University of Artificial Intelligence · Nagoya University · RIKEN AIP
PAST: Privileged Adaptation from Complete Student Trajectories for On-Policy Self-Distillation
Aug 9, 2026Yangyang Feng, Zhuoyan Feng, Junlan ChenSingle Trajectory Mathematical Reasoning Benchmarks
1The Hong Kong University of Science and Technology (Guangzhou) · 2Sun Yat-sen University
RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer
Aug 6, 2026Xinye Wang, Junxiao Liu, Shujian HuangLLM Reasoning Strategies Unsupervised On-Policy Self-Distillation
National Key Laboratory for Novel Software Technology, Nanjing University
Is More Privileged Information Better? From Solution Traces to Problem-Solving Structure in Self-Distilled Reasoning
Aug 3, 2026Xuyang Zhao, Liting Zhang, Zichen Xu +4Mathematical Reasoning Benchmarks Privileged Context
1TMCC, College of Computer Science, Nankai University, Tianjin, China · 2Huawei Technologies Ltd., Beijing, China
TrAC: Trace-Conditioned Answer Consistency for Efficient Uncertainty Quantification in LLMs
Aug 1, 2026Dahai Yu, Lin Jiang, Rongchao Xu +1Large Language Model Uncertainty LLM Reasoning Strategies
Florida State University Tallahassee, Florida, USA
Sample More, Reflect Less: Self-Refine and Reflexion Lose to Repeated Sampling at Equal Token Cost, from 1.5B to 7B
Jul 30, 2026Iliya MirzaeiSelf-Referential Bias Reflections
Department of Computer Science Stony Brook University
SVR: Self-Verifying Refinement via Joint Verdict-Confidence Reinforcement Learning for Adaptive Test-Time Compute
Jul 30, 2026Hongyu Chen, Liang Lin, Guangrun WangReinforcement Learning With Verifiable Reward Test Time
1Sun Yat-sen University · 2Guangdong Key Laboratory of Big Data Analysis and Processing · 3X-Era AI Lab
LEEPS: Latent-Guided Explore-Exploit Prompt Sampling for Efficient RLVR in Large Language Models
Jul 30, 2026Shuang Liang, Haoyang Zhou, Yifan Gong +2Reinforcement Learning With Verifiable Reward LLM Reasoning Strategies
Renmin University of China · AntGroup
ReDiPPO: Reference-Guided Value Calibration and Discrepancy-Aware Token Reweighting for Mathematical Reasoning
Jul 30, 2026Zhenrong Zhang, Fei Wu, Jun Du +2Mathematical Reasoning Benchmarks Mathematical Reasoning
1IFLYTEK Research · University of Science and Technology of China
Kalman Meets Curriculum: Efficient Dynamic Prompt Selection for Adaptive RL Finetuning
Jul 30, 2026Haodong Zhu, Yangyang Ren, Yanjing Li +4Automatic Prompt Optimization Mathematical Reasoning Benchmarks
1Beihang University · 2Zhongguancun Academy · 3Nanyang Technological university +1
ReCo: Reweighting GRPO Against Distributional Concentration
Jul 29, 2026Junoh Park, Junseo Hwang, Wonguk Cho +1Reweighting Mathematical Reasoning Benchmarks
Graduate School of Data Science, Seoul National University
Pass the Baton: Trajectory-Relayed On-Policy Distillation
Jul 28, 2026Haolei Xu, Xiaowen Xu, Haiwen Hong +5Teacher Mathematical Reasoning Benchmarks
1Zhejiang University · 2Yuvion Team, Alibaba Group
AdvancedMathBench: A Benchmark Suite for Advanced Mathematical Proof Generation and Verification
Jul 13, 2026Lingkai Kong, Zijian Wu, Yuzhe Gu +11Research-Level Mathematics Mathematical Reasoning Benchmarks
Shanghai AI Laboratory · Shanghai Jiao Tong University · MMLab, The Chinese University of Hong Kong +1
MIRA-Math: A Benchmark for Minimal Information Requesting and Mathematical Reasoning
Jul 8, 2026Charbel Al Bateh, Samer SaabMathematical Reasoning Mathematical Reasoning Benchmarks
Department of Electrical and Computer Engineering Lebanese American University Byblos, Lebanon
LLM-as-a-Verifier: A General-Purpose Verification Framework
Jul 6, 2026Jacky Kwok, Shulu Li, Pranav Atreya +6Large Language Models(Llms Feedback
Stanford University · UC Berkeley · NVIDIA Research
Know When to Stop: Segment-Level Credit Assignment for Reducing Overthinking
Jul 1, 2026Chia-Hsuan Lee, Sihui Dai, Mingyang Zhou +4Reasoning Traces Iterative Self-Correction
Capital One
Does Verbose Chain-of-Thought Really Help? In-Distribution Evidence that Content, Not Length, Matters
Jun 29, 2026Wenlong Wang, Fergal ReidChain-of-Thought Reasoning LLM Reasoning Strategies
Fin AI Research
SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematics
Jun 29, 2026Nikolay Georgiev, Maria Drencheva, Kseniia Ibragimova +3Mathematical Reasoning Benchmarks Mathematics
INSAIT, Sofia University “St. Kliment Ohridski” · ETH Zurich
ReNIO: Reweighting Negative Trajectory Importance for LLM On-Policy Distillation
Jun 22, 2026Chen Lin, Kedi Chen, Wei ZhangMathematical Reasoning Benchmarks Negative Results
East China Normal University · Shanghai Innovation Institute
Architecture-Aware Reinforcement Learning Makes Sliding-Window Attention Competitive in Math Reasoning
Jun 10, 2026Kai Liu, Peijie Dong, Xinchen Xie +5Mathematical Reasoning Benchmarks Large Language Model Reinforcement Learning
Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University · Hong Kong University of Science and Technology (Guangzhou) · Shanghai AI Laboratory
N-GRPO: Embedding-Level Neighbor Mixing for Enhanced Policy Optimization
Jun 9, 2026Xukun Zhu, Hang Yu, Peng Di +1Mathematical Reasoning Benchmarks Flow-Grpo
Zhejiang University · Ant Group
KCSAT-ML: Probing Reasoning Models with Nationwide-Cohort Human Difficulty
Jun 9, 2026Sanghee Park, Geewook Kim, Kee-Eung KimMathematical Reasoning Benchmarks Large Reasoning Models
NAVER Cloud AI · KAIST AI
SG-OPD: Sign-Gated On-Policy Distillation via Sign-Consistency Gating and Phased Teacher Sampling
Jun 8, 2026Haoran Xu, Hongyu Wang, Yifei Gao +3Efficient On-Policy Distillation Teacher
Zhejiang University · Hunan University · Tianjin University +2
A Regret Minimization Framework on Preference Learning in Large Language Models
Jun 8, 2026Suhwan Kim, Taehyun Cho, Geon-Hyeong Kim +4Reinforcement Learning From Human Feedback Sequential Preference Optimization
Seoul National University, Seoul, South Korea · LG AI Research, Seoul, South Korea · UNIST, Ulsan, South Korea +1
Diverse Thinking Schemata Elicit Better Reasoning in Large Language Models
Jun 8, 2026Xinyue Liang, Yizhe Yang, Yu Bai +3Large Reasoning Models Mathematical Reasoning Benchmarks
School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China
Selective-Advantage Entropy-Adaptive Horizon GRPO: Asymmetric Token-Level Discounting for Efficient Reinforcement Learning of Language Models
Jun 3, 2026Chirag Chawla, Rohan Charudatt Salvi, Madhav S. BaidyaPolicy Gradient Offline Reinforcement Learning
Indian Institute of Technology (BHU), Varanasi, India · Department of Computer Science, University of Illinois Chicago, IL 60607, USA
LoRi: Low-Rank Distillation for Implicit Reasoning
Jun 3, 2026Ryan Solgi, Jiayi Tian, Zheng ZhangChain-of-Thought Reasoning Reasoning Skills
University of California-Santa Barbara, USA
Testing LLM Arithmetic Reasoning Generalization with Automatic Numeric-Remapping Attacks
Jun 2, 2026Malia Barker, Bishal Lakha, Edoardo Serra +1Mathematical Reasoning Benchmarks LLM Reasoning Strategies
Department of Computer Science, Boise State University, Boise, ID, USA · University of L'Aquila, L'Aquila, Italy
Right Makes Might: Aligning Verified Hidden States Empowers RL Reasoning
Jun 2, 2026Ziyue Wang, Aomufei Yuan, Yongfu Zhu +10Reinforcement Learning With Verifiable Reward Mathematical Reasoning Benchmarks
1Peking University · 2JINGDONG · 3Shanghai Innovation Institute +2
FormInv: A Measurement Protocol for Semantic Invariance in Mathematical Reasoning Benchmarks
May 27, 2026Nishal Thomas, Noel ThomasMathematical Reasoning Benchmarks Theorem Proving
Independent Researcher · Mohamed Bin Zayed University of Artificial Intelligence
Skill-Conditioned Gated Self-Distillation for LLM Reasoning
May 27, 2026Jiazhen Huang, Xiao Chen, Xiao Luo +3Unsupervised On-Policy Self-Distillation LLM Reasoning Strategies
Tsinghua University · University of Wisconsin-Madison · X-Humanoid +2
Interpretability-Guided Layer Selection over Subspace Projection: SAEs as Stethoscopes, Not Scalpels, for Raw Task Vector Model Editing
May 27, 2026Li Lei, Madalina Ciobanu, Qingqing Mao +1Mathematical Reasoning Benchmarks Subspace
Incept Labs Houston, TX · Incept Labs, Houston, TX · Titan Holdings, San Francisco, CA
Joint Training of Multi-Token Prediction in Reinforcement Learning via Optimal Coefficient Calibration
May 27, 2026Zili Wang, Jiajun Chai, Lin Chen +3Reinforcement Learning With Verifiable Reward Multi-Token Prediction
School of Artificial Intelligence, University of Chinese Academy of Sciences, China · MAIS, Institute of Automation, Chinese Academy of Sciences, China · Meituan
ReverseMath: Answer Inversion for Scalable and Verifiable Mathematical Problem Generation
May 26, 2026Raoyuan Zhao, Yihong Liu, Yupei Du +2Mathematical Reasoning Benchmarks Reverse
Center for Information and Language Processing, LMU Munich · 2Munich Center for Machine Learning (MCML) · 3Saarland University
Reasoning, Code, or Both? How Large Language Models Handle Variations in Math Questions
May 26, 2026Matthew KutakhMathematical Reasoning Benchmarks LLM Reasoning Strategies
Tailoring Teaching to Aptitude: Direction-Adaptive Self-Distillation for LLM Reasoning
May 21, 2026Hongbin Zhang, Chaozheng Wang, Kehai Chen +4Unsupervised On-Policy Self-Distillation Self-Teacher
Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China · Keeta AI, Meituan, Beijing, China · Peng Cheng Laboratory, Shenzhen, China
From Reasoning Chains to Verifiable Subproblems: Curriculum Reinforcement Learning Enables Credit Assignment for LLM Reasoning
May 21, 2026Xitai Jiang, Zihan Tang, Wenze Lin +3Curriculum Reinforcement Learning Reinforcement Learning With Verifiable Reward
LeapLab, Tsinghua University · Qiuzhen College, Tsinghua University · B Gao Huang
Advantage Collapse in Group Relative Policy Optimization: Diagnosis and Mitigation
May 20, 2026Xixiang He, Qiyao Sun, Ao Cheng +5Reinforcement Learning With Verifiable Reward Collapse
National University of Defense Technology, Changsha, Hunan, China · Intelligent Game and Decision Lab, Beijing, China · The Chinese University of Hong Kong, Shenzhen, Guangdong, China
Beyond Fixed Budgets: Characterizing the Inelasticity and Limitations of Tree-of-Thought Reasoning Strategies
May 19, 2026Atkia Mahila, Avinash Maurya, M. Mustafa Rafique +1LLM Reasoning Strategies Monte Carlo Tree Search
Rochester Institute of Technology Rochester, USA · Argonne National Laboratory Lemont, USA
Detecting and Mitigating the Correct-Answer Extinction Window in Test-Time Reinforcement Learning with Majority Voting
May 19, 2026Hongxiang Lin, Zhirui Kuai, Erpeng Xue +1Reward Functions Mathematical Reasoning Benchmarks
Meituan

Oct 1, 2026, cs.AIJ/K move · Enter open · S save

Improving Math Reasoning through Value-guided Informative Search

Shaohuai Liu, Yuning Wu, Haoran Liu, Enzo Jia+2

Amazon · Department of Electrical and Computer Engineering, Texas A&M University

Mathematical Reasoning Benchmarks Reinforcement Learning With Verifiable Reward Verifiable Rewards

Open paper AskPDF arXiv

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the mathematical reasoning capabilities of large language models. Recent work introduces search into RLVR rollouts to increase trajectory diversity, but diversity alone does not ensure that the search-induced rollout policy improves upon the current policy. To address this gap, we propose APIVIS, a training-time framework that adapts finite-budget Gumbel search to chunk-level mathematical reasoning. APIVIS combines direct and searched responses within each rollout group, allowing improvements found by search to produce informative relative rewards. It further applies selective supervision to search-improved tokens, preserving a learning signal when uniform group rewards render GRPO ineffective. We show that exact value-guided selection improves the expected verifier reward at each searched state and that this guarantee extends to the complete rollout policy, with a corresponding approximate guarantee under bounded value-estimation error. Experiments on widely recognized mathematical reasoning benchmarks and different model scales demonstrate substantial improvements over competitive search-based methods, validating the effectiveness of APIVIS.

Momentum

Related topics

Latest papers 101