Reinforcement Learning with Verifiable Rewards

Also known as RLVR

Overview

This field studies how to improve language and multimodal models by rewarding outputs whose correctness or task progress can be checked, for example with unit tests, mathematical answers, formal proofs, or simulated environments. Common approaches use policy-gradient methods such as PPO and GRPO, with outcome rewards supplemented by step-level feedback, rollout exploration, or replay to improve credit assignment and data efficiency. Work spans math and coding benchmarks as well as search, GUI, and other interactive agents. A central tension is that rewards must be scalable yet faithful: imperfect or narrow verifiers can be exploited, and a correct final answer does not by itself establish sound reasoning, visual grounding, or robust generalization.

Latest papers

CardsList

738 papers69 papers in the last four weeks, down 49% on the four weeks before. 0.5% of all new papers.

  1. Cross-Question Reliable Reinforcement Learning

    Nov 18, 2026Hector G. Rodriguez, Marcus RohrbachLLM AbstentionConfidence Estimation in Language Models

  2. ViStep-RL: Stepwise Reinforcement Learning for Long-Horizon Visual Agents

    Nov 18, 2026Junyang Chen, Yao Qin, Xiao Li +4RL for VLMsLong-Horizon RL

  3. Learning to Edit IFC Building Models: Verifiable Checkers as the Training Signal for Dependency-Aware Editing Agents

    Nov 17, 2026Jiaxin Zhang, Yao Luo, Yuze Dan +2Building Information ModelingReinforcement Learning with Verifiable Rewards

  4. Optimistic Verifiers Get Hacked: Reward Hacking Under an Exact Process Oracle

    Nov 16, 2026Arunkumar V, Manoranjan Gandhudi, Gangadharan G. R. +2Reward HackingReinforcement Learning with Verifiable Rewards

  5. SpeCal: Spectral Calibration for Unsupervised RLVR

    Nov 16, 2026Kai Tang, Xing Zheng, Haobo Wang +7Reinforcement LearningRL for Language Model Reasoning

  6. Where Should LLM Agents Adapt at Test Time? In Context, in Weights, or Both

    Nov 15, 2026Parsa Mirtaheri, Mohammadreza Armandpour, Keivan Alizadeh +5Test-Time AdaptationExperience Learning for LLM Agents

  7. Policy Optimization With Multiple Verifiers via Pareto Rankings

    Nov 14, 2026Kai Yamashita, Shohei Taniguchi, Hiroki Furuta +2RL for Language Model ReasoningReinforcement Learning with Verifiable Rewards

  8. Negative-Only Policy Optimization for One-Sided Verifiable Rewards

    Nov 12, 2026Jiacheng Xu, Shuo He, Fuxiang Zhang +2Reinforcement LearningReinforcement Learning with Verifiable Rewards

  9. Reward-Driven Collider Physics Challenges for Self-Improving Agentic AI via Reinforcement Learning

    Nov 11, 2026Alexander Yue, Qibin Liu, Julia GonskiAI Agents for Scientific DiscoverySelf-Improving Agents

  10. Honesty Is a Race: Predicting When Verifiable-Reward RL Teaches a Model to Bluff

    Nov 11, 2026Nathaniel Bottman, Alexei OblomkovReinforcement Learning with Verifiable RewardsLLM Honesty

  11. The Illusion of Diversity: Aligning LLM Exploration via Effective Entropy

    Nov 11, 2026Xiaoliang Fu, Jiaye Lin, Yangyi Fang +4RL for Language Model ReasoningRL Exploration

  12. AutoScaffold: AI-Guided Scaffolding for Reinforcement Learning of Language Models

    Nov 10, 2026Zijian Zhang, Rizhen Hu, Jiangweizhi Peng +4RL for Language ModelsLLM-Guided RL

  13. Are Dense Rewards Worth Their Tokens in GRPO?

    Nov 10, 2026Vikash Singh, Weicong Chen, Debargha Ganguly +16RL for Language ModelsDense Reward RL

  14. When Credit Turns Against Tools: Transition-Aware Credit Assignment in Agentic Reinforcement Learning

    Nov 8, 2026Xiangyu Lu, Zhanke Zhou, Jiazhe Ning +3Agentic RLCredit Assignment

  15. Plug-and-Play Verifier for Decoupling Process Reward in Stabilizing Long-Horizon Agentic Reasoning

    Nov 6, 2026Mingwei Xu, Jieyuan Pei, Binghao Tu +1Agentic RLRL for Language Model Reasoning

  16. Not All Entropy Is Equal: Reward-Conditioned Entropy Allocation in Reinforcement Learning with Verifiable Rewards

    Nov 6, 2026Song Yu, Li Li, Zhenming WuEntropy Collapse in RLRL for Language Model Reasoning

  17. GIST: Gibbs-Targeted Hierarchical Data Selection for Offline RLVR

    Nov 4, 2026Xuliang Huang, Tianxiang Zhao, Chengwei Qin +1Offline RLRL for Language Model Reasoning

  18. ReSI-Math: Exploring Recoverable Capability Frontiers for Efficient Reasoning Improvement

    Nov 3, 2026Yao Cui, Zhen Yang, Yuandong Wang +3LLM Mathematical ReasoningEfficient Language Model Reasoning

  19. On the Primacy Bias in RLVR Training

    Nov 2, 2026Phuc Minh Nguyen, Ngoc-Hieu Nguyen, Parshin Shojaee +6RL for Language Model ReasoningReinforcement Learning