LLM Mathematical Reasoning

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

19 papers in the last four weeks, up 375% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 194

All topics

From Reasoning Chains to Verifiable Subproblems: Curriculum Reinforcement Learning Enables Credit Assignment for LLM Reasoning
May 21, 2026Xitai Jiang, Zihan Tang, Wenze Lin +3RL for Language Model Reasoning Credit Assignment in RL
LeapLab, Tsinghua University · Qiuzhen College, Tsinghua University · B Gao Huang
MindLoom: Composing Thought Modes for Frontier-Level Reasoning Data Synthesis
May 20, 2026Haiyang Shen, Taian Guo, Xuanzhong Chen +11Synthetic Data Generation Structured Reasoning
1Peking University · 2Tsinghua University
Learning First Integrals via Backward-Generated Data and Guided Reinforcement Learning
May 20, 2026Jingfeng Zhong, Zhengxiang Liu, Zhijie Wang +1Synthetic Data Generation for Language Models LLM Mathematical Reasoning
Shanghai Jiao Tong University China
Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interaction
May 20, 2026Juncheng Hu, Jiawei Du, Xin Zhang +1Mathematical Reasoning LLM Mathematical Reasoning
National University of Singapore, Singapore · Centre for Frontier AI Research, Agency for Science, Technology and Research, Singapore · Institute of High Performance Computing, Agency for Science, Technology and Research, Singapore
RMA: Context-Orchestrated Research Math Agents
May 20, 2026Zelin Zhao, Bo Yuan, Yuchen Zhu +2LLM Context Management LLM Mathematical Reasoning
Georgia Institute of Technology
The Readout Shortcut: Positional Number Copying Dominates Arithmetic CoT Readout in Small Language Models
May 20, 2026Ming LiuNumerical Reasoning in Language Models CoT Faithfulness
Amazon
What Really Improves Mathematical Reasoning: Structured Reasoning Signals Beyond Pure Code
May 19, 2026Yuze Zhao, Junpeng Fang, Lu Yu +6Structured Reasoning LLM Code Generation
State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China, Hefei, China · Individual Researcher · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center +1
Mathematical Reasoning in Large Language Models: Benchmarks, Architectures, Evaluation, and Open Challenges
May 19, 2026Husnain Amjad, Raja Khurram Shahzad, Aamir Shahzad +1Mathematical Reasoning Benchmarks LLM Evaluation
School of Electrical Engineering and Computer Science, National University of Sciences and Technology, Islamabad, Pakistan · Department of Communication, Quality Management and Information Systems, Mid Sweden University, Östersund Campus, Sweden · School of Computing, Data, and Mathematical Sciences, Western Sydney University, Indonesia
Beyond Fixed Budgets: Characterizing the Inelasticity and Limitations of Tree-of-Thought Reasoning Strategies
May 19, 2026Atkia Mahila, Avinash Maurya, M. Mustafa Rafique +1LLM Evaluation Inference-Time Search
Rochester Institute of Technology Rochester, USA · Argonne National Laboratory Lemont, USA
STAR-PólyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision
May 19, 2026Jiaao Wu, Xian Zhang, Hanzhang Liu +3Multi-Agent Orchestration Multi-Agent Reasoning
1Tsinghua University · 2Microsoft Research · 3New York University +1
Implicit Hierarchical GRPO: Decoupling Tool Invocation from Execution for Tool-Integrated Mathematical Reasoning
May 18, 2026Li Wang, Xiaohan Wang, Xiaodong Lu +5RL for Language Model Reasoning Hierarchical RL
Meituan · Tsinghua University
Weak-to-Strong Elicitation via Mismatched Wrong Drafts
May 17, 2026Wei DengRL for Language Models RL for Language Model Reasoning
Independent Researcher
Step-wise Rubric Rewards for LLM Reasoning
May 17, 2026Weichu Xie, Haozhe Zhao, Wenpu Liu +15Reward Modeling Credit Assignment in RL
Peking University · JD Explore Academy · Shanghai Jiao Tong University +2
LinAlg-Bench: A Forensic Benchmark Revealing Structural Failure Modes in LLM Mathematical Reasoning
May 15, 2026Shradha Agarwal, Deepak Rajbhar, Tariq JMathematical Reasoning Benchmarks LLM Evaluation
Department of Nuclear Engineering and Computer Science Missouri University of Science and Technology Rolla, Missouri
From LLM-Generated Conjectures to Lean Formalizations: Automated Polynomial Inequality Proving via Sum-of-Squares Certificates
May 14, 2026Ruobing Zuo, Hanrui Zhao, Gaolei He +2Mathematical Reasoning Neuro-Symbolic Reasoning
School of Software Engineering, East China Normal University, Shanghai, China · College of Computer Science and Technology, National University of Defense Technology, Changsha, China · School of Computer and Information Engineering, Henan University, Kaifeng, China
Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling
May 13, 2026Yafu Li, Runzhe Zhan, Haoran Zhang +25RL for Language Model Reasoning LLM Mathematical Reasoning
Shanghai AI Laboratory · The Chinese University of Hong Kong · Shanghai Jiao Tong University +2
YFPO: Yoked Feature Preference Optimization with Neuron-Guided Rewards
May 12, 2026Yifan LePreference Optimization Language Model Post-Training
Independent Researcher
Nice Fold or Hero Call: Learning Budget-Efficient Thinking for Adaptive Reasoning
May 12, 2026Zhaomeng Zhou, Lan Zhang, Junyang Wang +2RL for Language Model Reasoning Efficient Language Model Reasoning
University of Science and Technology of China · The Chinese University of Hong Kong
Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information
May 12, 2026Guobin Shen, Xiang Cheng, Chenxiao Zhao +4On-Policy Self-Distillation RL for Language Model Reasoning
1Xiaohongshu Inc. · Institute of Automation, Chinese Academy of Sciences
Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness
May 11, 2026Ivo Petrov, Jasper Dekoninck, Dimitar I. Dimitrov +1Mathematical Reasoning Benchmarks LLM Evaluation
1INSAIT, Sofia University "St. Kliment Ohridski" · 2ETH Zurich
M2A: Synergizing Mathematical and Agentic Reasoning in Large Language Models
May 11, 2026Junjian Wang, Xin Zhou, Qiran Xu +1Software Engineering Agents Agentic Reasoning
Institute of Automation, Chinese Academy of Sciences · Li Auto Inc.
Beyond Accuracy: Evaluating Strategy Diversity in LLM Mathematical Reasoning
May 10, 2026Xia Yang, Xuanyi Zhang, Hao Hu +1Mathematical Reasoning Benchmarks LLM Evaluation
University of Toronto · Upper Canada College · East China Normal University
Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
May 9, 2026Guijin Son, Seungone Kim, Catherine Arnett +73Mathematical Reasoning Benchmarks Benchmark Design
Mathematical Reasoning via Intervention-Based Time-Series Causal Discovery Using LLMs as Concept Mastery Simulators
May 8, 2026Tsuyoshi OkitaMathematical Reasoning Causal Inference
Kyushu Institute of Technology
Teaching Language Models to Think in Code
May 8, 2026Hyeon Hwang, Jiwoo Lee, Jaewoo KangNumerical Reasoning in Language Models LLM Mathematical Reasoning
Korea University · Korea University, AIGEN Sciences
GSM-SEM: Benchmark and Framework for Generating Semantically Variant Augmentations
May 8, 2026Jyotika Singh, Fang Tu, Aziza Mirsaidova +11Mathematical Reasoning Benchmarks Benchmark Design
Oracle AI
Verifier-Backed Hard Problem Generation for Mathematical Reasoning
May 7, 2026Yuhang Lai, Jiazhan Feng, Yee Whye Teh +1Reinforcement Learning with Verifiable Rewards Multi-Agent LLMs
Department of Data Science, City University of Hong Kong · School of Intelligence Science and Technology, Peking University · Work done during Jiazhan’s visiting at the Department of Statistics, University of Oxford. +2
AI co-mathematician: Accelerating mathematicians with agentic AI
May 7, 2026Daniel Zheng, Ingrid von Glehn, Yori Zwols +15AI Agents for Scientific Discovery AI-Assisted Scientific Research
Google DeepMind · Google
OPSD Compresses What RLVR Teaches: A Post-RL Compaction Stage for Reasoning Models
May 7, 2026Jaehoon Kim, Dongha LeeReinforcement Learning with Verifiable Rewards On-Policy Distillation
Yonsei University
Shortcut Solutions Learned by Transformers Impair Continual Compositional Reasoning
May 6, 2026William T. Redman, Erik C. Johnson, Brian RobinsonCompositional Reasoning Continual Learning
Johns Hopkins Applied Physics Lab

May 21, 2026, cs.LGJ/K move · Enter open · S save

From Reasoning Chains to Verifiable Subproblems: Curriculum Reinforcement Learning Enables Credit Assignment for LLM Reasoning

Xitai Jiang, Zihan Tang, Wenze Lin, Yang Yue+2

LeapLab, Tsinghua University · Qiuzhen College, Tsinghua University · B Gao Huang

RL for Language Model Reasoning Credit Assignment in RL Step-Level Credit Assignment in RL Curriculum RL Reinforcement Learning with Verifiable Rewards LLM Mathematical Reasoning

Open paper AskPDF arXiv

Reinforcement learning from verifiable rewards (RLVR) has shown strong promise for LLM reasoning, but outcome-based RLVR remains inefficient on hard problems because correct final-answer rollouts are rare and sample-level credit assignment cannot use partial progress in failed attempts. We introduce SCRL (Subproblem Curriculum Reinforcement Learning), a curriculum RL framework that derives verifiable subproblems from reference reasoning chains and fixes the final subproblem as the original problem. This turns partial progress on hard problems into verifiable learning signals. Algorithmically, SCRL uses subproblem-level normalization, which normalizes rewards independently at each subproblem position and assigns the resulting advantages to the corresponding answer spans, enabling finer-grained credit assignment without external rubrics or reward models. Our analysis shows that subproblem curricula lift hard problems out of gradient dead zones, with larger relative gains as the original problem becomes harder. Across seven mathematical reasoning benchmarks, SCRL outperforms strong curriculum-learning baselines, improving average accuracy over GRPO by +4.1 points on Qwen3-4B-Base and +1.9 points on Qwen3-14B-Base. On AIME24, AIME25, and IMO-Bench, SCRL further improves pass@1 by +3.7 points and pass@64 by +4.6 points on Qwen3-4B-Base, indicating better exploration on hard reasoning problems.

Momentum

Related topics

Latest papers 194