Verifiable Rewards

Follow this topic Ask about this topic

Recent momentum

-14%

6 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

1 new paper

A weekly snapshot of new work published in Verifiable Rewards.

143 papers

Latest in Verifiable Rewards

Browse all topics →

Hint-Guided Diversified Policy Optimization for LLM Reasoning
Jun 2, 2026Zhiyu Cao, Kaixin Wu, Mingjie Zhong +4Large Language Model Reasoning Reinforcement Learning With Verifiable Reward
CAPF: Guiding Search-Agent Rollouts with Credit-Attenuated Privileged Feedback
Jun 1, 2026Bin Chen, Xinye Liao, Yiming Liu +2Reinforcement Learning With Verifiable Reward Search-Augmented Reasoning
Before the Model Learns the Bug:Fuzzing RLVR Verifiers
May 31, 2026Jaideep RayReinforcement Learning With Verifiable Reward Verifiable Rewards
CARE-RL: Capability-Aware Reinforcement Learning for Mitigating Cross-Domain Conflicts
May 30, 2026Rui Zhang, Xinle Wu, Yao LuDeepmind Control Suite Verifiable Rewards
EchoRL: Reinforcement Learning via Rollout Echoing
May 29, 2026Jinhe Bi, Aniri, Minglai Yang +9Reinforcement Learning Post-Training Reinforcement Learning With Verifiable Reward
Combinatorial Synthesis: Scaling Code RLVR via Atomic Decomposition and Recombination
May 29, 2026Jiasheng Zheng, Boxi Cao, Boxi Yu +6Reinforcement Learning With Verifiable Reward Mock-Interface Synthesis
Annealed Softmax Greedy in Many-Armed Bayesian Bandits
May 29, 2026William Overman, Mohsen BayatiEntropy Regularized Reinforcement Learning Reinforcement Learning With Verifiable Reward
Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR
May 29, 2026Ruina Hu, Chen Wang, Lai Wei +5Visual Evidence Multimodal Reasoning Benchmarks
Improving Small Language Models for Code Generation with Reinforcement Learning from Verification Feedback
May 28, 2026Egor Skopin, Evgeny KotelnikovCode Generation Reinforcement Learning With Verifiable Reward
VeriGate: Verifier-Gated Step-Level Supervision for GRPO
May 28, 2026Aakriti Agrawal, Minghui Liu, Furong HuangGroup Relative Policy Optimization Reinforcement Learning With Verifiable Reward
HPO: Hysteretic Policy Optimization for Stable and Efficient Training under Sparse-Reward Regime
May 28, 2026Mohamed Sana, Nicola Piovesan, Antonio De Domenico +2Sparse Rewards Multi-Objective Policy Optimization
Verifiable Rewards Beyond Math and Code: Lightweight Corpus-Grounded Process Supervision for Factual Question Answering
May 28, 2026Shicheng Fan, Haochang Hao, Dehai Min +3Verifiable Rewards Text Corpora
When RL Suppresses Its Own Vocabulary: Recovering Reasoning Diversity in Puzzle-to-Math Transfer
May 28, 2026Mayug Maniparambil, Arjun Karuvally, Terrence Sejnowski +1Large Language Model Reasoning Reinforcement Learning With Verifiable Reward
Label-Free Reinforcement Learning via Cross-Model Entropy
May 27, 2026Matt Gorbett, Hossein ShiraziReinforcement Learning Post-Training Cross-Entropy Losses
Single-Rollout Hidden-State Dynamics for Training-Free RLVR Data Selection
May 27, 2026Jianghao Wu, Jianfei Cai, Weiqiang Wang +3Reinforcement Learning With Verifiable Reward Verifiable Rewards
Soft-SVeRL: Self-Verified Reinforcement Learning with Soft Rewards
May 27, 2026Saurabh Dash, Pierre Clavier, John Dang +4Reinforcement Learning With Verifiable Reward Verifiable Rewards
Mechanistically Interpreting the Role of Sample Difficulty in RLVR for LLMs
May 27, 2026Yue Cheng, Jiajun Zhang, Xiaohui Gao +3Reinforcement Learning With Verifiable Reward Verifiable Rewards
Where Rollouts Begin: Low-Load, High-Leverage First-Token Diversification for RLVR
May 27, 2026Soeun Kim, Albert NoReinforcement Learning With Verifiable Reward Verifiable Rewards
IRDS: Interpretable RLVR Data Selection via Verifier-Coupled Sparse Autoencoder Coverage
May 27, 2026Yuhan Li, Mingxu Zhang, Dazhong Shen +1Reinforcement Learning With Verifiable Reward Verifiable Rewards
BASIS: Batchwise Advantage Estimation from Single-Rollout Information Sharing for LLM Reasoning
May 26, 2026Shijin Gong, Erhan Xu, Kai Ye +3Value Functions Verifiable Rewards
RLVR Datasets and Where to Find Them: Tracing Data Lineage for Better Training Data
May 26, 2026Hsiu-Yuan Huang, Weijie Liu, Chenming Tang +5Reinforcement Learning With Verifiable Reward Training Data Attribution
Peak-Then-Collapse and the Four Interface Channels of Knowledge-Graph Tool Use
May 25, 2026Tianda Sun, Dimitar KazakovKnowledge Graphs Reinforcement Learning With Verifiable Reward
When Self-Belief Misleads: Active Label Acquisition for Reinforcement Learning with Verifiable Rewards
May 25, 2026Li Wang, Xiaodong Lu, Xiaohan Wang +5Reinforcement Learning With Verifiable Reward Verifiable Rewards
Credit Assignment with Resets in Language Model Reasoning
May 25, 2026Ankur Samanta, Akshayaa Magesh, Ayush Jain +7Credit Assignment Multi-Objective Policy Optimization
Hide to Guide: Learning via Semantic Masking
May 24, 2026Ruitao Liu, Qinghao Hu, Alex Hu +6Reinforcement Learning With Verifiable Reward Verifiable Rewards
Clipping Bottleneck: Stabilizing RLVR via Stochastic Recovery of Near-Boundary Signals
May 21, 2026Shuo Yang, Jinda Lu, Chiyu Ma +8Reinforcement Learning With Verifiable Reward Gradient Clipping
Two is better than one: A Collapse-free Multi-Reward RLIF Training Framework
May 21, 2026Shourov Joarder, Diganta Sikdar, Ahsan Habib Akash +2Reinforcement Learning With Verifiable Reward Verifiable Rewards
One-Way Policy Optimization for Self-Evolving LLMs
May 21, 2026Shuo Yang, Jinda Lu, Kexin Huang +6Reinforcement Learning With Verifiable Reward Verifiable Rewards
From Reasoning Chains to Verifiable Subproblems: Curriculum Reinforcement Learning Enables Credit Assignment for LLM Reasoning
May 21, 2026Xitai Jiang, Zihan Tang, Wenze Lin +3Curriculum Reinforcement Learning Reinforcement Learning With Verifiable Reward
You Only Need Minimal RLVR Training: Extrapolating LLMs via Rank-1 Trajectories
May 20, 2026Zhepei Wei, Xinyu Zhu, Wei-Lin Chen +3Reinforcement Learning With Verifiable Reward Reinforcement Learning Post-Training
DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards
May 20, 2026Kaiyi Zhang, Wei Wu, Yankai LinReinforcement Learning With Verifiable Reward Credit Assignment
How Much Online RL is Enough? Informative Rollouts for Offline Preference Optimization in RLVR
May 20, 2026Richa Verma, Balaraman RavindranReinforcement Learning With Verifiable Reward Group Relative Policy Optimization
Multi-Step Likelihood-Ratio Correction for Reinforcement Learning with Verifiable Rewards
May 20, 2026Deokgyu Yoon, Hyungkyu Kang, Joongkyu Lee +4Reinforcement Learning With Verifiable Reward Verifiable Rewards
GeoX: Mastering Geospatial Reasoning Through Self-Play and Verifiable Rewards
May 19, 2026Kyeongjin Ahn, Seungeon Lee, Krishna P. Gummadi +1Geoquery Self-Play
GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignment
May 19, 2026Minxuan Lv, Tiehua Mei, Tanlong Du +9Efficient Long-Context Inference Deep Reinforcement Learning
When to Stop Reusing: Dynamic Gradient Gating for Sample-Efficient RLVR
May 19, 2026Yuchun Miao, Sen Zhang, Yuqi Zhang +4Reinforcement Learning With Verifiable Reward Verifiable Rewards
Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains
May 18, 2026Zhonghang Yuan, Zhefan Wang, Fang Hu +7Reinforcement Learning With Verifiable Reward Large Language Model Reasoning
Leveraging Error Diversity in Group Rollouts for Reinforcement Learning
May 17, 2026Wenpu Liu, Yuqi Xu, Weichu Xie +8Reinforcement Learning With Verifiable Reward Long Rollouts
The Unlearnability Phenomenon in RLVR for Language Models
May 16, 2026Yulin Chen, He He, Chen ZhaoReinforcement Learning With Verifiable Reward Large Language Model Unlearning
Nudging Beyond the Comfort Zone: Efficient Strategy-Guided Exploration for RLVR
May 15, 2026Chanuk Lee, Sangwoo Park, Minki Kang +1Reinforcement Learning With Verifiable Reward Verifiable Rewards
SAGE: Shaping Anchors for Guided Exploration in RLVR of LLMs
May 15, 2026Chanuk Lee, Minki Kang, Sung Ju HwangReinforcement Learning With Verifiable Reward Large Language Model Reasoning
Video Models Can Reason with Verifiable Rewards
May 14, 2026Tinghui Zhu, Sheng Zhang, James Y. Huang +5Video-Language Models Reinforcement Learning With Verifiable Reward
Learning from Language Feedback via Variational Policy Distillation
May 14, 2026Yang Li, Erik Nijkamp, Semih Yavuz +1Unsupervised On-Policy Self-Distillation On-Policy Distillation
Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance
May 14, 2026Kai Yan, Alexander G. Schwing, Yu-Xiong WangReinforcement Learning With Verifiable Reward Verifiable Rewards
Learning from Failures: Correction-Oriented Policy Optimization with Verifiable Rewards
May 14, 2026Mengjie Ren, Jie Lou, Boxi Cao +6Reinforcement Learning With Verifiable Reward Verifiable Rewards
GenCircuit-RL: Reinforcement Learning from Hierarchical Verification for Genetic Circuit Design
May 14, 2026Noah FlynnReinforcement Learning With Verifiable Reward Verifiable Rewards
Generative Floor Plan Design with LLMs via Reinforcement Learning with Verifiable Rewards
May 13, 2026Luis Lara, Aristides Milios, Zhi Hao Luo +5Floor Plan Generation Large Language Model Planning
Revisiting Reinforcement Learning with Verifiable Rewards from a Contrastive Perspective
May 13, 2026Feng Zhang, Xinhong Ma, Ziqiang Dong +5Group Relative Policy Optimization Reinforcement Learning With Verifiable Reward
AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Reward
May 12, 2026Runhui Huang, Jie Wu, Rui Yang +2Multimodal Generation Unified Multimodal Models
Reward Hacking in Rubric-Based Reinforcement Learning
May 12, 2026Anas Mahmoud, MohammadHossein Rezaei, Zihao Wang +3Rubric-Based Reinforcement Learning Verifiable Rewards
Entropy Polarity in Reinforcement Fine-Tuning: Direction, Asymmetry, and Control
May 12, 2026Jiazheng Zhang, Ziche Fu, Junrui Shen +17Reinforcement Learning With Verifiable Reward Reinforcement Fine-Tuning
Selective Off-Policy Reference Tuning with Plan Guidance
May 12, 2026Duc Anh Le, Tien-Phat Nguyen, Thien Huu Nguyen +2Verifiable Rewards Off-Policy Evaluation
Understanding and Preventing Entropy Collapse in RLVR with On-Policy Entropy Flow Optimization
May 12, 2026Huimin Xu, Shuai Zhao, Xiaobao Wu +1Reinforcement Learning With Verifiable Reward Flow-Based Policy
RubricEM: Meta-RL with Rubric-guided Policy Decomposition beyond Verifiable Rewards
May 11, 2026Gaotang Li, Bhavana Dalvi Mishra, Zifeng Wang +9Rubric-Based Reinforcement Learning Rubrics
Verifiable Process Rewards for Agentic Reasoning
May 11, 2026Huining Yuan, Zelai Xu, Huaijie Wang +6Reinforcement Learning With Verifiable Reward Verifiable Rewards
Relative Score Policy Optimization for Diffusion Language Models
May 11, 2026Zichao Yu, Shengze Xu, Bingqing Jiang +2Reinforcement Learning With Verifiable Reward Diffusion Language Models
FormalRewardBench: A Benchmark for Formal Theorem Proving Reward Models
May 11, 2026Zeynel A. Uluşan, Burak S. Akbudak, Can S. Erer +1Theorem Reasoning Benchmark
How You Begin is How You Reason: Driving Exploration in RLVR via Prefix-Tuned Priors
May 9, 2026Yifan Xu, Junren Chen, Yifan ChenReinforcement Learning With Verifiable Reward Verifiable Rewards
DUET: Optimize Token-Budget Allocation for Reinforcement Learning with Verifiable Rewards
May 8, 2026Haoyu Hu, Xuandong Zhao, Xuhai "Orson'' Xu +1Reinforcement Learning With Verifiable Reward Verifiable Rewards
Your Language Model is Its Own Critic: Reinforcement Learning with Value Estimation from Actor's Internal States
May 8, 2026Yunho Choi, Jongwon Lim, Woojin Ahn +3Reinforcement Learning With Verifiable Reward Verifiable Rewards

Jun 2, 2026 · cs.CLJ/K move · Enter open · S save

Hint-Guided Diversified Policy Optimization for LLM Reasoning

Zhiyu Cao, Kaixin Wu, Mingjie Zhong, Peifeng Li+3

School of Computer Science and Technology, Soochow University, Suzhou, China · Ant Group, Hangzhou, China

Recent developments in Large Language Models (LLMs) have showcased impressive reasoning capabilities, with Reinforcement Learning with Verifiable Rewards (RLVR) being a promising enhancement strategy. However, existing reward mechanisms are constrained to the outcome-level correctness and lack explicit signals to guide the model to consider diverse solutions. In contrast, human problem solving typically involves evaluating multiple potential approaches and selecting the most reliable solution, a cognitive process that current RLVR frameworks do not explicitly incentivize. Inspired by this, we propose Hint-Guided Diversified Policy Optimization (HDPO), allowing the model to first list all potential candidate solution outlines as hints and then select the most reliable one for further reasoning. HDPO comprises two stages of Cold Start for Structured Reasoning and Hint-Guided Diversified Reinforcement Learning to incentivize the model to generate diverse and reliable solutions following the ``propose-select-think'' trajectory. Experimental results show that HDPO effectively boosts LLM reasoning and enhances the diversity of candidate solutions as well as the LLM's ability to identify reliable solutions.

Large Language Model Reasoning Reinforcement Learning With Verifiable Reward Multi-Objective Policy Optimization Deep Reinforcement Learning Verifiable Rewards

Open paper Ask about it PDF