RL for Language Model Reasoning

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

91 papers in the last four weeks, up 176% on the four weeks before. 0.9% of all new papers.

Jul 13Week of Sep 28

Latest papers 707

All topics

Improving Math Reasoning through Value-guided Informative Search
Oct 1, 2026Shaohuai Liu, Yuning Wu, Haoran Liu +3RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards
Amazon · Department of Electrical and Computer Engineering, Texas A&M University
Adapter Thickets: Splitting an RLVR Budget Beats Concentrating It
Oct 1, 2026Jonathan Williams, Esin Tureci Karthik R. NarasimhanRL for Language Model Reasoning Low-Rank Adaptation
Princeton University
Sharpen Before You Adapt: Data-Free Entry-State Sharpening for Test-Time Reinforcement Learning
Oct 1, 2026Zhanming Zhang, Vinoth SelvendranRL for Language Model Reasoning Test-Time RL
Independent Researcher New York, NY · Independent Researcher Palo Alto, CA
Exploring More, Reasoning Better: Stepwise Risk-Sensitive GRPO for Diffusion Language Models
Sep 30, 2026Yue YU, Bowen Zuo, David Crandall +2RL for Language Model Reasoning Group Relative Policy Optimization
Indiana University · University of California, Riverside
Make Sparse Rewards Count: Density-Aware Reward Aggregation for Multi-Reward RL
Sep 30, 2026Tong Zheng, Skylar Zhai, Zhan Cheng +7Multi-Objective Reinforcement Learning Reinforcement Learning
University of Chinese Academy of Sciences · University of Minnesota Twin Cities · University of Wisconsin–Madison +5
Semifactual Credit-Augmented Policy Optimization
Sep 30, 2026Junshu Pan, Zhizhang Fu, Shulin Huang +5Prompt Sensitivity RL for Language Model Reasoning
Zhejiang University · Westlake University · Shanghai Innovation Institute +1
Unlearnable, or Unmeasured? On the Reliability of Difficulty Labels in RLVR
Sep 30, 2026Chandak Chakma, Syed Nazmus Sakib, Nafiul Haque +1Reinforcement Learning RL for Language Model Reasoning
Department of Robotics and Mechatronics Engineering, University of Dhaka
Advancing Entropy-Level Credit Assignment in RLVR via Proximal Entropy Policy Optimization
Sep 30, 2026Yun Kim, Nojun KwakRL for Language Model Reasoning Credit Assignment in RL
Seoul National University
GRPO Training Dynamics for Small Language Models
Sep 30, 2026Rajat Ghosh, Vaishnavi Bhargava, Henry Wong +2RL for Language Model Reasoning Group Relative Policy Optimization
Nutanix
Trust the Critic More
Sep 30, 2026Kaiyue Wen, Luke Bailey, Arvind Mahankali +1RL for Language Model Reasoning Credit Assignment in RL
Stanford University
Learning Process Rewards via Reasoning State Propagation
Sep 30, 2026Kai Gan, Zi-Hao Zhou, Bo Ye +3Process Reward Models RL for Language Model Reasoning
School of Computer Science and Engineering, Southeast University, Nanjing 210096, China · Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, China · Zhongguancun Academy +1
T-Router: Learning Thalamic Routing for Reasoning with Parameter-Efficient Reinforcement Learning
Sep 30, 2026Liuxian Ma, Jiale Dai, Jiaqi Li +1Reinforcement Learning RL for Language Model Reasoning
College of Artificial Intelligence, Tsinghua University · State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University · Beijing Institute for General Artificial Intelligence
Mitigating the Length-Scaling Tax with Online Distillation
Sep 30, 2026Xu Wan, Wenyue Xu, Shengjie Zhao +1RL for Language Model Reasoning On-Policy Distillation
ByteDance Seed · Tongji University · Peking University
OpenJev-RLCD: A Working RLCD Implementation
Sep 30, 2026Zhimin Gao, Pichao WangRL for Language Models RL for Language Model Reasoning
StateTree: Enhancing Long-Term Dialogue Reasoning via Reinforcement Learning
Sep 30, 2026Naen Xu, Wanqing Cui, Yibo Hu +5Temporal Reasoning in Language Models RL for Language Model Reasoning
Zhejiang University · Taobao & Tmall Group of Alibaba
GraphCert: Bootstrap Agentic Graph Reasoning with Certified Evidence Rubrics
Sep 30, 2026Weiqi Jiang, Yuchen Ying, Rui Wang +5LLM Reasoning with Graphs RL for Language Model Reasoning
Zhejiang University, Hangzhou, China · Nanyang Technological University, Singapore · Hangzhou City University, Hangzhou, China
What Pretraining and Midtraining Make Learnable from Rewards?
Sep 29, 2026Chiwun Yang, Xiaoyu LiRL for Language Model Reasoning Continued Pretraining
City University of Hong Kong · University of New South Wales
ArgGYM: A Procedural, Engine-Verified Benchmark for Structured Defeasible Reasoning
Sep 29, 2026İbrahim Ethem Deveci, Funda Tan Çalık, Barış Deniz Sağlam +1LLM Evaluation RL for Language Model Reasoning
Graduate School of Informatics Middle East Technical University Ankara, Türkiye
Diagnosing and Improving Probabilistic Reasoning in Large Language Models
Sep 29, 2026Huaman Sun, Dingcheng Wang, Jason Hartline +1RL for Language Model Reasoning LLM Decision-Making
Department of Computer Science Northwestern University Evanston, IL 60201, USA
Learning Beyond What You Sample: Off-Policy-Aware Cross-Model Trajectory Exchange for RLVR
Sep 29, 2026Doohyuk Jang, Yoonsik Park, Gyouk Chu +2RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards
KAIST · AITRICS
Privy to the Foil: Recasting Value Estimation with a Self-Privileged Critic for RLVR
Sep 29, 2026Kun Liang, Chenming Tang, Clive Bai +5Value Function Estimation RL for Language Model Reasoning
School of Computer Science, Peking University · National Key Laboratory for Multimedia Information Processing, Peking University · Foundation Model Department, Tencent
MetaCtrl: Your Large Language Models Can Reason Better and More Concisely with a Metacognitive Controller
Sep 29, 2026Zhibin Wen, Tao Han, Lei Bai +2RL for Language Model Reasoning Efficient Language Model Reasoning
Southern University of Science and Technology · The Hong Kong University of Science and Technology · Shanghai Artificial Intelligence Laboratory +1
Learning to Prove, Not Just to Answer: Reinforcement Learning from Formal Verification for Natural-Language Logical Reasoning
Sep 29, 2026Qili Zhang, Qianren Mao, Hanze Cai +11Logical Reasoning RL for Language Model Reasoning
Zhongguancun Laboratory · Beihang University · Nanyang Technological University +1
Unlocking the Critic: Reward-Free Policy Optimization for LLM Post-Training
Sep 29, 2026Hongyang Li, Xiao Li, Caesar Wu +3Reinforcement Learning Value Function Estimation
University of Luxembourg · Seafill Open-Source Community · Université Paris-Saclay
What Does Post-Training Change in Multilingual Reasoning?
Sep 29, 2026Hongyang Li, Xiao Li, Caesar Wu +2Multilingual Language Model Evaluation Cross-Lingual Reasoning in Language Models
University of Luxembourg · Seafill Open-Source Community
SRJudge: Empowering Large Language Models with Selective Reasoning for Fine-Grained Knowledge Concept Tagging
Sep 29, 2026Zhiwei Yang, Jiahua Yang, Huiru Lin +2RL for Language Model Reasoning AI in Education
Guangdong Institute of Smart Education, Jinan University, Guangzhou, China · School of Physical Education, Jinan University, Guangzhou, China · Guangdong Provincial Key Laboratory of Speed Capability Research, Guangzhou, China +1
Dual-Channel Robust Group-Relative Policy Optimization via Advantage and Sequence-Weight Estimation
Sep 29, 2026Zhongyi Li, Wan Tian, Xiang Xu +4RL for Language Model Reasoning Group Relative Policy Optimization
Beihang University · Peking University · Nanjing University
Where Does Staleness Accumulate? Pool Aware Effective Staleness Control for Asynchronous RL in LLM Post-Training
Sep 29, 2026Chenliang Li, Neiwen Ling, Zijun Wei +1Asynchronous RL RL for Language Model Reasoning
ByteDance · Texas A&M University · University of Virginia
CorrGRPO: Correlation-Normalized GRPO for Multi-Reward Learning
Sep 29, 2026Wenbin Hu, Huihao Jing, Haochen Shi +3Multi-Objective Reinforcement Learning RL for Language Models
Hong Kong University of Science and Technology
SIPO: Unifying Reinforcement Learning with On-Policy Self-Distillation
Sep 29, 2026Zhenrui Yue, Huimin Zeng, Yueqi Wang +8RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards
University of Illinois · UC San Diego · Rochester Institute of Technology +2

Oct 1, 2026, cs.AIJ/K move · Enter open · S save

Improving Math Reasoning through Value-guided Informative Search

Shaohuai Liu, Yuning Wu, Haoran Liu, Enzo Jia+2

Amazon · Department of Electrical and Computer Engineering, Texas A&M University

RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards LLM Mathematical Reasoning

Open paper AskPDF arXiv

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the mathematical reasoning capabilities of large language models. Recent work introduces search into RLVR rollouts to increase trajectory diversity, but diversity alone does not ensure that the search-induced rollout policy improves upon the current policy. To address this gap, we propose APIVIS, a training-time framework that adapts finite-budget Gumbel search to chunk-level mathematical reasoning. APIVIS combines direct and searched responses within each rollout group, allowing improvements found by search to produce informative relative rewards. It further applies selective supervision to search-improved tokens, preserving a learning signal when uniform group rewards render GRPO ineffective. We show that exact value-guided selection improves the expected verifier reward at each searched state and that this guarantee extends to the complete rollout policy, with a corresponding approximate guarantee under bounded value-estimation error. Experiments on widely recognized mathematical reasoning benchmarks and different model scales demonstrate substantial improvements over competitive search-based methods, validating the effectiveness of APIVIS.

Momentum

Related topics

Latest papers 707