RL for Language Model Reasoning

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

91 papers in the last four weeks, up 176% on the four weeks before. 0.9% of all new papers.

Jul 13Week of Sep 28

Latest papers 707

All topics

BASIS: Batchwise Advantage Estimation from Single-Rollout Information Sharing for LLM Reasoning
May 26, 2026Shijin Gong, Erhan Xu, Kai Ye +3RL for Language Model Reasoning Critic-Free RL
School of Management, University of Science and Technology of China · Department of Statistics, London School of Economics and Political Science · Department of Engineering Science, University of Oxford
Learning When to Think While Listening in Large Audio-Language Models
May 26, 2026Zhiyuan Song, Weici Zhao, Yang Xiao +3Audio QA RL for Language Model Reasoning
University of Pennsylvania
GeoFaith: A Spatio-Temporal Dual View of Faithful Chain-of-Thought
May 26, 2026Weijiang Lv, Wentong Zhao, Jiayu Wang +3CoT Faithfulness RL for Language Model Reasoning
1Xidian University · 2Xi’an Jiaotong University · 3Mohamed bin Zayed University of Artificial Intelligence +2
Ratio-Variance Regularized Policy Optimization
May 26, 2026Yu Luo, Shuo Han, Yihan Hu +5RL for Language Model Reasoning Policy Optimization
Department of Foundation Model, 2012 Labs, Huawei Shanghai · Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University · Department of Computer Science and Technology, Tsinghua University +1
Spend Your Rollouts Where It Counts: Rollout Allocation for Group-Based RL Post-Training
May 26, 2026Woojeong Kim, Ziyi Yang, Jing Nathan Yan +1Reinforcement Learning RL for Language Model Reasoning
Databricks · Cornell University
RICE-PO: Turning Retrieval Interactions into Credit Signals for Reasoning Agents
May 25, 2026Mingchen Li, Hansi Zeng, Zhuo Qian +3RL for Language Model Reasoning Credit Assignment in RL
University of Massachusetts, Amherst · Texas Tech University · University of Connecticut
LECTOR: Joint Optimization of Scientific Reasoning Graphs and Introduction Generation
May 25, 2026Jiabei Xiao, Yizhou Wang, Chen Tang +3RL for Language Model Reasoning AI-Assisted Scientific Research
1The Chinese University of Hong Kong · 2Shanghai Artificial Intelligence Laboratory · 3Fudan University
When Self-Belief Misleads: Active Label Acquisition for Reinforcement Learning with Verifiable Rewards
May 25, 2026Li Wang, Xiaodong Lu, Xiaohan Wang +5Reinforcement Learning RL for Language Model Reasoning
Meituan · Beihang University · Nanyang Technological University
Reinforcement Learning from Denoising Feedback
May 25, 2026Qi He, Huan Chen, Ya Guo +3RL for Language Model Reasoning RL for Diffusion Models
Fudan University · Ant Group · Hong Kong University of Science and Technology
DVAO: Dynamic Variance-adaptive Advantage Optimization for Multi-reward Reinforcement Learning
May 25, 2026Guochao Jiang, Jingyi Song, Guofeng Quan +3Multi-Objective Reinforcement Learning RL for Language Model Reasoning
Alibaba Cloud Computing
Extreme Region Policy Distillation
May 25, 2026Changyu Chen, Xiting Wang, Rui YanKL-Regularized RL RL for Language Model Reasoning
Gaoling School of Artificial Intelligence, Renmin University of China · Wuhan University
AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution
May 25, 2026Zehao Wang, Yihan Zeng, Zidong Gong +5RL for Language Model Reasoning Multimodal Large Language Models
Harbin Institute of Technology · Huawei Noah’s Ark Lab · Independent Researcher
Credit Assignment with Resets in Language Model Reasoning
May 25, 2026Ankur Samanta, Akshayaa Magesh, Ayush Jain +7RL for Language Model Reasoning Credit Assignment in RL
1Meta AI · 2Columbia University · *Work done at Meta +2
Harmony in Diversity: Multi-domain Contrastive Policy Optimization for Large Reasoning Models
May 25, 2026Zongji Yu, Wenshui Luo, Yiliu Sun +5Reinforcement Learning RL for Language Model Reasoning
Shanghai Jiao Tong University · Shanghai AI Laboratory · Shandong University
Not only where, But when: Temporal Scheduling for RLVR
May 25, 2026Jinghao Zhang, Ruilin Li, Feng Zhao +1RL for Language Model Reasoning Credit Assignment in RL
University of Science and Technology of China · Shanghai Innovation Institute · Wuhan University
Quantifying Empirical Compute-Supervision Tradeoffs in RLVR
May 24, 2026Ryo Mitsuhashi, Patrick Chen, Isabelle Tseng +2Reinforcement Learning RL for Language Model Reasoning
1Princeton University
Hide to Guide: Learning via Semantic Masking
May 24, 2026Ruitao Liu, Qinghao Hu, Alex Hu +6Reward Hacking RL for Language Model Reasoning
1MIT · 2NVIDIA
Directional Alignment Mitigates Reward Hacking in Reinforcement Learning for Language Models
May 24, 2026Wenlong Deng, Jiaji Huang, Kaan Ozkara +4Reward Hacking RL for Language Models
University of British Columbia · Vector Institute · Amazon
Better, Faster: Harnessing Self-Improvement in Large Reasoning Models
May 24, 2026Qihuang Zhong, Liang Ding, Juhua Liu +3Overthinking in Language Models RL for Language Model Reasoning
1Nanyang Technological University, Singapore · 2Alibaba Group · School of Computer Science, Wuhan University, China +1
Test-Time Deep Thinking to Explore Implicit Rules
May 24, 2026Wentong Chen, Xin Cong, Zhong Zhang +8RL for Language Model Reasoning LLM Agents
Renmin University of China Beijing, China · Department of Statistics and Data Science, Tsinghua University Beijing, China · School of Computer Science and Engineering, UESTC Chengdu, China +4
HiMed: Incentivizing Hindi Reasoning in Medical LLMs
May 23, 2026Dingfeng Jiang, Han Yan, Chenze Ma +12Multilingual Language Models Healthcare
1The Chinese University of Hong Kong, Shenzhen · 2Indian Institute of Technology (Banaras Hindu University) Varanasi · 3Tongji University +4
Learning to Reason Efficiently with A* Post-Training
May 23, 2026Andreas Opedal, Francesco Ignazio Re, Abulhair Saparov +3Process Reward Models RL for Language Model Reasoning
αETH Zürich · γPurdue University · βMPI for Intelligent Systems, Tübingen
RL with Learnable Textual Feedback: A Bilevel Approach
May 23, 2026Utsav Singh, Sidhaarth Sredharan, Souradip Chakraborty +1Reinforcement Learning RL for Language Model Reasoning
University of Central Florida · 2Carnegie Mellon University · 3Universtiy of Maryland
Understanding and Mitigating Premature Confidence for Better LLM Reasoning
May 23, 2026Jingchu Gai, Guanning Zeng, Christina Baek +4Confidence Estimation in Language Models RL for Language Model Reasoning
1Carnegie Mellon University · 2Tsinghua University
CurveRL: Principled Distribution-Aware Context Reweighting for LLM Reasoning
May 23, 2026Ke Sun, Yizhou Zhao, Jiayi Xin +2Reinforcement Learning RL for Language Model Reasoning
University of Pennsylvania
State commitment learning: training language models to distinguish computation from memory
May 22, 2026Fei Ding, Yongkang Zhang, Runhao Liu +3RL for Language Model Reasoning
Alibaba Group · Tsinghua University
Metacognition as Reward: Reinforcing LLM Reasoning via Knowledge and Regulation Signals
May 22, 2026Sirui Chen, Lei Xu, Yuying Zhao +6Process Reward Models RL for Language Model Reasoning
1Tongji University · 2Shanghai AI Laboratory · 3Nanyang Technological University +3
Post-Training is About States, Not Tokens: A State Distribution View of SFT, RL, and On-Policy Distillation
May 21, 2026Dong NieSupervised Fine-Tuning RL for Language Model Reasoning
Independent Researcher
Clipping Bottleneck: Stabilizing RLVR via Stochastic Recovery of Near-Boundary Signals
May 21, 2026Shuo Yang, Jinda Lu, Chiyu Ma +8RL for Language Model Reasoning Group Relative Policy Optimization
Qwen Pilot Team, Alibaba Group
Two is better than one: A Collapse-free Multi-Reward RLIF Training Framework
May 21, 2026Shourov Joarder, Diganta Sikdar, Ahsan Habib Akash +2Multi-Objective Reinforcement Learning Intrinsic Reward Methods
Bangladesh University of Engineering and Technology, Bangladesh · West Virginia University, USA · University of Aberdeen, UK +2

May 26, 2026, cs.LGJ/K move · Enter open · S save

BASIS: Batchwise Advantage Estimation from Single-Rollout Information Sharing for LLM Reasoning

Shijin Gong, Erhan Xu, Kai Ye, Giulia Livieri+2

School of Management, University of Science and Technology of China · Department of Statistics, London School of Economics and Political Science · Department of Engineering Science, University of Oxford

RL for Language Model Reasoning Critic-Free RL Reinforcement Learning with Verifiable Rewards Policy Gradient Methods RL Post-Training Policy Learning+1

Open paper AskPDF arXiv

Reinforcement learning with verifiable rewards has become a standard recipe for improving the reasoning abilities of large language models. Existing algorithms face a tradeoff between computational efficiency and sample efficiency in value estimation and policy learning. We introduce BASIS, a critic-free post-training algorithm designed to address this tradeoff. At each online training step, BASIS samples only one rollout per prompt, but leverages rich information across prompts in the entire batch to improve value function estimation. Our experiments demonstrate that BASIS reduces MSE in value function estimation by 69% compared to REINFORCE++, a representative single-rollout baseline, and achieves lower MSE with one rollout than group mean estimators with 8 rollouts. This improvement in value estimation translates to better policy optimization: using substantially less training time, BASIS achieves performance close to multi-rollout GRPO-type baselines and often outperforms single-rollout REINFORCE-type baselines.

Momentum

Related topics

Latest papers 707