RL for Language Model Reasoning

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

91 papers in the last four weeks, up 176% on the four weeks before. 0.9% of all new papers.

Jul 13Week of Sep 28

Latest papers 707

All topics

LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
May 21, 2026Yuchun Fan, Bei Li, Peiguang Li +9Multilingual Language Models Reinforcement Learning
NLP Lab, School of Computer Science and Engineering, Northeastern University, Shenyang, China · Meituan Inc. 3NiuTrans Research, Shenyang, China
Search-E1: Self-Distillation Drives Self-Evolution in Search-Augmented Reasoning
May 21, 2026Zihan Liang, Yufei Ma, Ben Chen +4Tool-Augmented Language Model Agents On-Policy Self-Distillation
Survive or Collapse: The Asymmetric Roles of Data Gating and Reward Grounding in Self-Play RL
May 21, 2026Sophia Xiao Pu, Zhaotian Weng, Chengzhi Liu +4Reinforcement Learning Self-Play RL
University of California, Santa Barbara · Cisco Research
CLORE: Content-Level Optimization for Reasoning Efficiency
May 21, 2026Yuyang Wu, Qiyao Xue, Guanxing Lu +4RL for Language Model Reasoning Efficient Language Model Reasoning
Carnegie Mellon University · University of North Carolina, Chapel Hill · University of Pittsburgh +1
Reinforced Graph of Thoughts: RL-Driven Adaptive Prompting for LLMs
May 21, 2026Manuel Noah Riesen, Peter Alfred von NiederhäusernLLM Reasoning with Graphs LLM Prompting
School of Engineering and Computer Science Bern University of Applied Sciences Bern, Switzerland
From Reasoning Chains to Verifiable Subproblems: Curriculum Reinforcement Learning Enables Credit Assignment for LLM Reasoning
May 21, 2026Xitai Jiang, Zihan Tang, Wenze Lin +3RL for Language Model Reasoning Credit Assignment in RL
LeapLab, Tsinghua University · Qiuzhen College, Tsinghua University · B Gao Huang
Reasoning through Verifiable Forecast Actions: Consistency-Grounded RL for Financial LLMs
May 21, 2026Jialin Chen, Aosong Feng, Harshit Verma +7Time Series Reasoning RL for Language Model Reasoning
Yale University · Arizona State University · University of Texas Rio Grande Valley
OPPO: Bayesian Value Recursion for Token-Level Credit Assignment in LLM Reasoning
May 21, 2026Yu Li, Rui Miao, Tian Lan +1Value Function Estimation Token-Level Credit Assignment
1George Washington University · 2The University of Texas at Dallas
Why Semantic Entropy Fails: Geometry-Aware and Calibrated Uncertainty for Policy Optimization
May 20, 2026Zheyuan Zhang, Kaiwen Shi, Han Bao +3RL for Language Model Reasoning Policy Optimization
University of Notre Dame · †Corresponding Author
You Only Need Minimal RLVR Training: Extrapolating LLMs via Rank-1 Trajectories
May 20, 2026Zhepei Wei, Xinyu Zhu, Wei-Lin Chen +3RL for Language Model Reasoning Low-Rank Approximation
University of Virginia · Washington University in St. Louis
DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards
May 20, 2026Kaiyi Zhang, Wei Wu, Yankai LinPolicy Gradient Token-Level Credit Assignment
Gaoling School of Artificial Intelligence, Renmin University of China · Ant International
How Much Online RL is Enough? Informative Rollouts for Offline Preference Optimization in RLVR
May 20, 2026Richa Verma, Balaraman RavindranDirect Preference Optimization RL for Language Model Reasoning
TCS Research Department of CSE IIT Madras Chennai, India · Department of Data Science & AI, Wadhwani School of Data Science & AI IIT Madras Chennai, India
LamPO: A Lambda Style Policy Optimization for Reasoning Language Models
May 20, 2026Redacted by arXivRL for Language Model Reasoning Group Relative Policy Optimization
Pinterest, San Francisco, CA 94107, USA
Advantage Collapse in Group Relative Policy Optimization: Diagnosis and Mitigation
May 20, 2026Xixiang He, Qiyao Sun, Ao Cheng +5RL for Language Model Reasoning Group Relative Policy Optimization
National University of Defense Technology, Changsha, Hunan, China · Intelligent Game and Decision Lab, Beijing, China · The Chinese University of Hong Kong, Shenzhen, Guangdong, China
Thinking-while-speaking: A Controlled, Interleaved Reasoning Method for Real-Time Speech Generation
May 20, 2026Xuan Du, Qiangyu Yan, Wenshuo Li +4RL for Language Model Reasoning Controllable Speech Generation
Huawei Technologies
Multi-Step Likelihood-Ratio Correction for Reinforcement Learning with Verifiable Rewards
May 20, 2026Deokgyu Yoon, Hyungkyu Kang, Joongkyu Lee +4RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards
1Seoul National University · 2Upstage
AGPO: Adaptive Group Policy Optimization with Dual Statistical Feedback
May 20, 2026Miaobo Hu, Shuhao Hu, Bokun Wang +5RL for Language Model Reasoning Group Relative Policy Optimization
Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100092, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing 100049, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
OSCToM: RL-Guided Adversarial Generation for High-Order Theory of Mind
May 19, 2026Sharmin Sultana Srishty, Kazi Mahathir Rahman, Malaika Parizat Sakkhi +2Cognitive Modeling Theory of Mind
Department of Computer Science BRAC University
LC-ERD: Mining Latent Logic for Self-Evolving Reasoning via Consistency-Regulated Reward Decomposition
May 19, 2026Yanyu Chen, Jiyue Jiang, Dianzhi Yu +8RL for Language Model Reasoning Process Supervision
The Chinese University of Hong Kong · Shanghai Jiaotong University · Fudan University
Beyond Mode Collapse: Distribution Matching for Diverse Reasoning
May 19, 2026Xiaozhe Li, Yang Li, Xinyu Fang +10KL-Regularized RL RL for Language Model Reasoning
1Tongji University, China · 6Independent · 2Shanghai AI Laboratory, China +3
Detecting and Mitigating the Correct-Answer Extinction Window in Test-Time Reinforcement Learning with Majority Voting
May 19, 2026Hongxiang Lin, Zhirui Kuai, Erpeng Xue +1Reinforcement Learning RL for Language Model Reasoning
Meituan
CEPO: RLVR Self-Distillation using Contrastive Evidence Policy Optimization
May 19, 2026Ahmed Heakl, Abdelrahman M. Shaker, Youssef Mohamed +4Token-Level Credit Assignment RL for Language Model Reasoning
MBZUAI · Linköping University · Australian National University
When to Stop Reusing: Dynamic Gradient Gating for Sample-Efficient RLVR
May 19, 2026Yuchun Miao, Sen Zhang, Yuqi Zhang +4RL for Language Model Reasoning Policy Optimization
National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University · Meituan Longcat Team · The University of Sydney +1
LambdaPO: A Lambda Style Policy Optimization for Reasoning Language Models
May 19, 2026Redacted by arXivRL for Language Model Reasoning Group Relative Policy Optimization
Taming the Thinker: Conditional Entropy Shaping for Adaptive LLM Reasoning
May 19, 2026Shuyu Wei, Jian Sun, Delai Qiu +6RL for Language Model Reasoning LLM Reasoning
Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence, Beijing Jiaotong University · Unisound AI Technology Co., Ltd.
AMR-SD: Asymmetric Meta-Reflective Self-Distillation for Token-Level Credit Assignment
May 18, 2026Zhenlin Wei, Pu Jian, Yingzhuo Deng +6Token-Level Credit Assignment RL for Language Model Reasoning
Meituan Beijing, China · University of Chinese Academy of Sciences
Implicit Hierarchical GRPO: Decoupling Tool Invocation from Execution for Tool-Integrated Mathematical Reasoning
May 18, 2026Li Wang, Xiaohan Wang, Xiaodong Lu +5RL for Language Model Reasoning Hierarchical RL
Meituan · Tsinghua University
FBOS-RL: Feedback-Driven Bi-Objective Synergistic Reinforcement Learning
May 18, 2026Xikai Zhang, Yongzhi Li, Likang Xiao +6RL for Language Model Reasoning RL Exploration
Hangzhou International Innovation Institute, Beihang University · Kuaishou Technology · School of Artificial Intelligence, Beihang University
SD-Search: On-Policy Hindsight Self-Distillation for Search-Augmented Reasoning
May 18, 2026Yufei Ma, Zihan Liang, Ben Chen +6On-Policy Self-Distillation RL for Language Model Reasoning
Kuaishou Technology
Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains
May 18, 2026Zhonghang Yuan, Zhefan Wang, Fang Hu +7RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards
Shanghai Artificial Intelligence Laboratory · Shanghai Innovation Institute

May 21, 2026, cs.CLJ/K move · Enter open · S save

LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance

Yuchun Fan, Bei Li, Peiguang Li, Yilin Wang+8

NLP Lab, School of Computer Science and Engineering, Northeastern University, Shenyang, China · Meituan Inc. 3NiuTrans Research, Shenyang, China

Multilingual Language Models Reinforcement Learning Cross-Lingual Reasoning in Language Models RL for Language Model Reasoning LLM Reasoning

Open paper AskPDF arXiv

Reinforcement learning has proven effective for enhancing multi-step reasoning in large language models (LLMs), yet its benefits have not fully translated to multilingual contexts. Existing methods struggle with a fundamental trade-off: prioritizing input-language consistency severely hampers reasoning quality, while prioritizing reasoning often leads to unintended language drift toward English. We address this challenge with LANG, a novel framework that leverages language-conditioned hints to guide exploration in non-English reasoning tasks. Our method incorporates two key mechanisms to prevent dependency on these hints: a progressive decay schedule that gradually withdraws scaffolding, and a language-adaptive switch that tailors learning horizons to specific language difficulties. Empirical results on challenging multilingual mathematical benchmarks reveal that LANG substantially enhances reasoning performance without compromising language consistency. Moreover, we show that our framework generalizes beyond mathematics, fostering more consistent language alignment across model layers

Momentum

Related topics

Latest papers 707