Reinforcement Learning with Verifiable Rewards

Also known as RLVR

Follow this topic Ask about this topic

Momentum

59 papers in the last four weeks, up 119% on the four weeks before. 0.6% of all new papers.

Jul 13Week of Sep 28

Latest papers 438

All topics

Transferability for General Reasoning: An Automated Curriculum for Multi-Domain RLVR
Jun 23, 2026Yongjin Yang, Jiarui Liu, Yinghui He +3RL for Language Model Reasoning Curriculum RL
Jinesis Lab, University of Toronto & Vector Institute1 · Carnegie Mellon University2 · Princeton University3 +4
Geo-Strat-RL: Learning Geological Event Reasoning from Verifiable Tasks
Jun 23, 2026Lukas MosserVLM Reasoning Reinforcement Learning with Verifiable Rewards
Aker BP ASA
ExTra: Exploratory Trajectory Optimization for Language Model Reinforcement Learning
Jun 23, 2026Wenyang Hu, Junxiang Jia, Zhen Shu +3RL for Language Models RL for Language Model Reasoning
1National University of Singapore · 2SAP
SER: Learning to Ground Video Reasoning with Semantic Evidence Rewards
Jun 23, 2026Sheng Xia, Zhengqin Lai, Tianxiang Jiang +4Temporal Video Grounding Video Reasoning
Nanjing University · Shanghai Innovation Institute · Harbin Institute of Technology, Shenzhen +2
Closing the Loop: Formally Verified Law as a Reward Signal for Self-Improving Legal AI
Jun 22, 2026Armin Heydari, Torben LeowaldFormal Verification Reinforcement Learning with Verifiable Rewards
Harvard University · Department of Philosophy, Harvard University, Cambridge, MA, USA. · Columbia University +1
Provable Benefits of RLVR over SFT for Reasoning Models: Learning to Backtrack Efficiently
Jun 22, 2026Stanley Wei, Juno KimRL for Language Model Reasoning Efficient Language Model Reasoning
1Princeton University · University of California, Berkeley.
What are Key Factors for Updates in RL for LLM Reasoning?
Jun 21, 2026Peidong Wang, Demi Wang, Xufang Luo +5Reinforcement Learning RL for Language Model Reasoning
School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China · *Work done during internship at Microsoft Research Asia. · 2Microsoft Research +1
Curriculum Reinforcement Learning Can Incentivize Reasoning Capacity in LLMs Beyond the Base Model
Jun 21, 2026Pengxiang Cai, Tianchen Fang, Xiaohan Li +3RL for Language Model Reasoning Curriculum RL
The Hong Kong University of Science and Technology (Guangzhou) · Nanyang Technological University · Zhejiang University
When Does a Video-Language Model Stop Watching? Reward Strength Controls the Formation and Reversal of Visual Shortcuts in Multimodal RLVR
Jun 20, 2026Zekun XuVision-Language Models Video-Language Models
School of Computer Science, The University of Sydney, Sydney, Australia
Mat-Pref: Verifiable-Reward Training Improves Compositional Reasoning in Inorganic Materials
Jun 20, 2026Sarrah R. Mikhail Leung, Taehan Kim, Jeongbin ParkCompositional Reasoning RL for Language Model Reasoning
University of California, Berkeley · 2Machine Learning at Berkeley · University of Michigan
When Do Intrinsic Rewards Work for Code Reasoning? A Comprehensive Study
Jun 18, 2026Xiaolong Jin, Xuandong Zhao, Wenbo Guo +2RL for Code Generation Intrinsic Reward Methods
Purdue University · UC Berkeley · UC Santa Barbara
ELVA: Exploring Ranking-Driven Universal Multimodal Retrieval
Jun 18, 2026Yuhan Liu, Pei Fu, Hang Li +8Reinforcement Learning Multimodal Large Language Models
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · MiLM Plus, Xiaomi Inc · Zhongguancun Academy, Beijing, China
Process-Verified Reinforcement Learning for Theorem Proving via Lean
Jun 18, 2026Minsu Kim, Se-Young YunReinforcement Learning Automated Theorem Proving
KAIST AI
VIMPO: Value-Implicit Policy Optimization for LLMs
Jun 18, 2026Zhewei Kang, Aosong Feng, Sergey Levine +2RL for Language Model Reasoning Policy Optimization
UC Berkeley · Yale University
Reward as An Agent for Embodied World Models
Jun 18, 2026Pu Li, Zhigang Lin, Qiang Wu +3Reward Modeling Reward Hacking
Kairos Team
Beyond Entropy: Learning from Token-Level Distributional Deviations for LLM Reasoning
Jun 18, 2026Xuanzhi Feng, Zhengyang Li, Zeyu Liu +6Reinforcement Learning RL for Language Model Reasoning
The Hong Kong University of Science and Technology, Hong Kong, China · Sichuan University, Chengdu, China · The Hong Kong Polytechnic University, Hong Kong, China
STARE: Surprisal-Guided Token-Level Advantage Reweighting for Policy Entropy Stability
Jun 17, 2026Haipeng Luo, Qingfeng Sun, Songli Wu +4RL for Language Model Reasoning Maximum Entropy RL
Shenzhen International Graduate School, Tsinghua University · Tencent Hunyuan
GraphPO: Graph-based Policy Optimization for Reasoning Models
Jun 17, 2026Yuliang Zhan, Xinyu Tang, Jian Li +7Reinforcement Learning LLM Reasoning with Graphs
Gaoling School of Artificial Intelligence, Renmin University of China · Ant Group
Learning from Own Solutions: Self-Conditioned Credit Assignment for Reinforcement Learning with Verifiable Rewards
Jun 17, 2026Yingyu Shan, Yuhang Guo, Zihao Cheng +7Token-Level Credit Assignment RL for Language Model Reasoning
Beijing Institute of Technology · Beihang University · Independent Researcher
Sparsity Curse: Understanding RLVR Model Parameter Space from Model Merging
Jun 16, 2026Chenrui Wu, Zexi Li, Jiajun Bu +2Reinforcement Learning with Verifiable Rewards Language Model Merging
Zhejiang University Hangzhou, China · Simon Fraser University Burnaby, Canada · Knowin AI Shenzhen, China +4
SFT Overtraining Predicts Rank Inversion via Entropy Collapse Under RLVR
Jun 16, 2026Siddharth Aphale, Kelly LiuSupervised Fine-Tuning Group Relative Policy Optimization
Stanford University, Stanford, CA, USA.
Rethinking Groups in Critic-Free RLVR
Jun 15, 2026Yihong Wu, Liheng Ma, Lingfeng Xiao +4Reinforcement Learning RL for Language Model Reasoning
1Université de Montréal · 2McGill University · 3Mila - Quebec AI Institute +3
DEEPRUBRIC: Evidence-Tree Rubric Supervision for Efficient Reinforcement Learning of Deep Research Agents
Jun 15, 2026Minghang Zhu, Chuyang Wei, Junhao Xu +3Deep Research Agents Rubric-Based RL
Shandong University, Qingdao, China · Zhongguancun Academy, Beijing, China · Fudan University, Shanghai, China
A Gradient Perspective on RLVR Stability and Winner Advantage Policy Optimization
Jun 15, 2026Prasanth YSS, Zhichen Ren, Rasa Hosseinzadeh +6RL for Language Model Reasoning Policy Optimization
Layer 6 AI
STRIDE: Strategic Trajectory Reasoning via Discriminative Estimation for Verifiable Reinforcement Learning
Jun 14, 2026Qinjian Zhao, Zhihao Dou, Dinggen Zhang +10RL for Language Model Reasoning Credit Assignment in RL
Kean University · Case Western Reserve University · University of Texas at Austin +4
Localizing Credit at the Divergence: Path-Conditioned Self-Distillation for LLM Reasoning
Jun 14, 2026Yu Li, Shu Hong, Tian LanRL for Language Model Reasoning Credit Assignment in RL
Department of Electrical and Computer Engineering, George Washington University
Understanding Diversity Collapse in RLVR via the Lens of Overtraining
Jun 13, 2026Suqin Yuan, Jinkun Chen, Jiyang Zheng +6Reinforcement Learning Reasoning Diversity
Sydney AI Centre, The University of Sydney · Southeast University · Microsoft +3
CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment
Jun 12, 2026Jiayue Cao, Zhicong Lu, Xuehan Sun +6Multimodal Reward Modeling VLM Reasoning
University of Chinese Academy of Sciences · 2Wuhan University · 3Tsinghua University +1
MaxProof: Scaling Mathematical Proof with Generative-Verifier RL and Population-Level Test-Time Scaling
Jun 11, 2026Jiacheng Chen, Xinyu Zhang, Shunkai Zhang +20Automated Theorem Proving Inference-Time Scaling
MiniMax · The Chinese University of Hong Kong · Fudan University +2
ReSum: Synergizing LLM Reasoning and Summarization with Reinforcement Learning
Jun 11, 2026Xucong Wang, Ziyu Ma, Yong Wang +5RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards
University of Science and Technology of China · 2AMAP, Alibaba Group

Jun 23, 2026, cs.AIJ/K move · Enter open · S save

Transferability for General Reasoning: An Automated Curriculum for Multi-Domain RLVR

Yongjin Yang, Jiarui Liu, Yinghui He, Lechen Zhang+2

Jinesis Lab, University of Toronto & Vector Institute1 · Carnegie Mellon University2 · Princeton University3+4

RL for Language Model Reasoning Curriculum RL Cross-Domain Transfer Learning Reinforcement Learning with Verifiable Rewards

Open paper AskPDF arXiv

Reinforcement learning with verifiable rewards (RLVR) has been extended from single-domain training to multi-domain reasoning suites spanning mathematics, programming, and science. However, the training curriculum (how often each domain is sampled) is typically fixed or hand-tuned, even though reasoning skills transfer unevenly across domains. Existing learnability-based curricula adapt to where the policy is currently improving, but are blind to whether a gradient step on the selected domain benefits the remaining domains. In this paper, we propose Transfer-Aware Curriculum (TAC), a bandit-style online curriculum that prioritizes domains whose updates broadly benefit the rest of the training suite. TAC repurposes signals already produced by RL training: per-domain advantages capture local learnability, and projected gradients, taken from the GRPO step being computed, estimate cross-domain transferability via gradient-geometry alignment, at negligible cost (<1% wall-clock overhead). Across a six-domain reasoning suite, TAC achieves the best macro-averaged accuracy on both Qwen3-1.7B and Llama3.2-3B, outperforming proportional random sampling, a hand-designed schedule, and a learnability-only bandit, and improving over the last of these by up to 2.8 points (10% relative). Ablations show performance degrades sharply when the transferability term is removed, and TAC remains robust on imbalanced training mixtures where learnability-only curricula over-commit to dominant domains. Our findings establish cross-domain transferability as a key signal for curriculum design in multi-domain RLVR.

Momentum

Related topics

Latest papers 438