Reinforcement Learning

Also known as RL

Follow this topic Ask about this topic

Momentum

144 papers in the last four weeks, up 243% on the four weeks before. 1.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 1,138

All topics

Inducing Process Supervision from Outcome-Only Reinforcement Learning
Sep 29, 2026Shengda Fan, Xin Cong, Zhong Zhang +2Reinforcement Learning Process Reward Models
Renmin University of China · Tsinghua University · University of Electronic Science and Technology of China +1
SERA: Scale-Equalized Rollout Allocation for Maximum Likelihood Reinforcement Learning
Sep 29, 2026Zihao Chen, Fanxiang Xiong, Hongran Ren +6Reinforcement Learning RL for Language Model Reasoning
Harbin Institute of Technology, Shenzhen · The Chinese University of Hong Kong, Shenzhen · Nanyang Technological University
BRIDGE: Bilevel Retrieval-Credit-Aware Agentic Reinforcement Learning
Sep 29, 2026Quan Xiao, Mingda Liu, Gaowen Liu +2Reinforcement Learning Agentic RAG
Department of Electrical and Computer Engineering, Cornell University · Institute of Integrated Research, Institute of Science Tokyo · Cisco Research
Massively Parallel Reinforcement Learning with a Chaotic Reconfigurable Clockless Chip
Sep 28, 2026Eric Oliveira-Gomes, Damien RontaniReinforcement Learning Chaotic Dynamical Systems
CentraleSup´elec and Universit´e de Lorraine, LMOPS UR4423 Laboratory, Metz F-57070, France
ChronoSRL: Temporal Geometry for Self-Supervised Reinforcement Learning
Sep 28, 2026Nico Bohlinger, Jan PetersRL for Robotics Representation Learning
Technical University of Darmstadt, Germany · Robotics Institute Germany (RIG); German Research Center for AI (DFKI); hessian.AI
X-Reset: Scaling Object-Centric Reinforcement Learning via Cross-Embodiment Resets
Sep 28, 2026Prithwish Dan, Chenyang Ma, Wei ZhanReinforcement Learning Generalization in Robotic Manipulation
Applied Intuition · University of North Carolina at Chapel Hill · University of California, Berkeley
Provable Benefits of Regularization: Fast Rates for Adversarial Imitation Learning
Sep 28, 2026Hanbin Zhou, Shangzhe Li, Alexander Braverman +1Reinforcement Learning Adversarial Imitation Learning
HKUST(GZ) · UNC Chapel Hill · Cornell University
Verifier Errors in RLVR: Reward Hacking, Limits of Feedback, and Selective Control
Sep 28, 2026Christian Moya, Elliott Thornley, Guang LinReward Hacking Reinforcement Learning
Purdue University · National University of Singapore
Behavioral Foundation Models for Quality Diversity
Sep 28, 2026Nazim Bendib, Nicolas Perrin-Gilbert, Olivier SigaudReinforcement Learning Quality-Diversity Optimization
Sorbonne Université, ISIR Paris, France
An analysis of Mirror-Descent Soft Actor-Critic
Sep 28, 2026Denis Zorba, Michal ValkoReinforcement Learning Online Mirror Descent
School of Mathematics, University of Edinburgh, United Kingdom · INRIA, Paris, France
Passive-Dynamic-Walking-Inspired Dynamics Guidance for Energy-Efficient Humanoid Locomotion
Sep 28, 2026Hyeonjin Choi, Joongheon Kim, Daekyum KimHumanoid Robot Locomotion Reinforcement Learning
School of Mechanical Engineering, Korea University, Seoul 02841, Republic of Korea · School of Electrical Engineering, Korea University, Seoul 02841, Republic of Korea · School of Smart Mobility, Korea University, Seoul 02841, Republic of Korea
Teach to Learn: Hint Annealing for Self-improving LLM Reasoning
Sep 28, 2026Zile Wang, Zijian Li, Haodong Wang +5Reinforcement Learning Self-Training for Language Models
The Hong Kong University of Science and Technology · Yuanbao Team, Tencent
Learning High-Risk High-Precision Motion Control
Sep 28, 2026Nam Hee Kim, Markus Kirjonen, Perttu HämäläinenRobotic Control Reinforcement Learning
Aalto University Espoo, Finland
SIPO: Selective-Inference Policy Optimization for Tree-Structured Agentic RL
Sep 28, 2026Zenghuang Fu, Ningqi Chen, Mingda Jia +10Agentic RL Reinforcement Learning
University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · The University of Hong Kong +4
Unified Trajectory Matching Policy Optimization: Diverse T2I Generation and VLA Generalization
Sep 28, 2026Zhiyuan Ma, Jiaming Li, Lingzhen Li +7Reinforcement Learning Vision-Language-Action Models
School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China
FlexLoop: Depth-Elastic Looped Policies for Adaptive Test-Time Computation in Deep RL
Sep 28, 2026Xun Wang, Ruishuo Chen, Yu Chen +2Efficient Neural Network Inference Reinforcement Learning
Institute for Interdisciplinary Information Sciences, Tsinghua University
Escaping Local Views: Discovering Latent Concepts for Interpretable Multi-Agent Reinforcement Learning
Sep 28, 2026Yijie Sun, Sanquan Sun, Yanda Zhu +3Reinforcement Learning Partially Observable RL
Nanjing University · Hong Kong Polytechnic University · Shenzhen University
LLMs as Adaptive Meta-Solvers: Strategy-Diverse RL for Industrial-Scale Optimization
Sep 28, 2026Shihao Zhang, Weiting Liu, Siyu Shao +4Algorithm Selection Reinforcement Learning
East China Normal University · Alibaba Group · Fudan University +4
Q-learning Penalized Transformer for Safe Offline Reinforcement Learning
Sep 28, 2026Shengchao Hu, Peng Wang, Jifeng Hu +5Reinforcement Learning Transformer-Based RL
Shanghai Jiao Tong University, China · Shenzhen Campus of Sun Yat-sen University, China · Jilin University, China +1
DexTaG: Tactile-as-Guidance in Reinforcement Learning for Dexterous Manipulation
Sep 27, 2026Han Yang, Yian Wang, Yunlong Song +2Reinforcement Learning Contact-Rich Robotic Manipulation
University of Massachusetts Amherst. · Genesis AI.
QwenGyre: An Elastic Reinforcement Learning Framework for Training xLong-Horizon Agents
Sep 27, 2026Weiqi Wang, Yuxin Zhou, Mouxiang Chen +9Reinforcement Learning Long-Horizon Agent Tasks
Alibaba Token Hub, Alibaba Group · University of Science and Technology of China · Tsinghua University
Principal Steering Subspaces for Online Adaptation of Frozen Generative Robot Policies
Sep 27, 2026Jialeng Ni, Nathan Zhao, Kunpeng SongRobot Policy Learning Reinforcement Learning
University of Michigan, Ann Arbor, MI, USA. · XPENG Robotics, Santa Clara, CA, USA.
DuraS2ST: Chain-of-Thought and Reinforcement Learning for Duration-Aligned Speech-to-Speech Translation
Sep 27, 2026Yayue Deng, Dingdong Wang, Yuxuan Hu +7Speech Translation Reinforcement Learning
The Chinese University of Hong Kong, China · Microsoft Corporation · Work done during an internship at Microsoft
Elucidating the Design Space of Regression-based Diffusion Reinforcement Learning
Sep 27, 2026Toyota Li, David Zhao, Alan ZhaoReinforcement Learning Constrained RL
Tencent
GTRL: Grounding Divide-and-Conquer Value Learning with Temporal Differences
Sep 27, 2026Abdul Monaf Chowdhury, MD Sameer Iqbal Chowdhury, Shifat E Arman +1Reinforcement Learning Temporal-Difference Learning
Department of Robotics and Mechatronics Engineering, University of Dhaka, Bangladesh · Department of Computer Science, Texas State University, USA · Department of Computer Science, University of Oxford, UK
Search-Aware Reinforcement Learning for Multi-Component Query Understanding in Roblox Game Search
Sep 24, 2026Nayoung Choi, Shengjian Chen, Xiaokai Wei +6Reinforcement Learning RL for IR
Emory University Atlanta, Georgia, USA · Roblox Corporation San Mateo, California, USA
Just Ask Jev: Reinforcement Learning for Calibrated Decisions as a Zero-Shot Detector of AI Alignment Failures
Sep 24, 2026Ruoqi Guo, Yi Liu, Gelei Deng +6LLM Safety Benchmarks LLM Alignment
Griffith University · Nanyang Technological University · UNSW +4
Right Choice of Classification Algorithms Based on Reinforcement Learning for Prediction of Non-Alcoholic Fatty Liver
Sep 24, 2026Hasan Samadbin, Arman DaliriAlgorithm Selection Reinforcement Learning
Department of Computer Engineering, Karaj Branch, Islamic Azad University, Karaj, Iran
An Analysis of Streaming Deep Reinforcement Learning for Adaptive Continual Learning in Robotics
Sep 23, 2026Teeratham Vitchutripop, Alyssa Quarles, Wenhe Zhang +2Reinforcement Learning Continual Robot Learning
Department of Computer Science, Yale University, New Haven, CT 06520, USA
Reinforcement Learning with Verifiable Rewards for Small Search Agents
Sep 23, 2026Gaurisankar Jayadas, Aske Plaat, Álvaro Serra-Gómez +1Reinforcement Learning Reinforcement Learning with Verifiable Rewards
Leiden Institute of Advanced Computer Science, Leiden University, Leiden, The Netherlands

Sep 29, 2026, cs.LGJ/K move · Enter open · S save

Inducing Process Supervision from Outcome-Only Reinforcement Learning

Shengda Fan, Xin Cong, Zhong Zhang, Haotian Chen+1

Renmin University of China · Tsinghua University · University of Electronic Science and Technology of China+1

Reinforcement Learning Process Reward Models RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards

Open paper AskPDF arXiv

Process reward models (PRMs) have become a key component for LLMs, as their step-level feedback supports both post-training and test-time reasoning. However, training strong PRMs remains costly: human step annotation is difficult to scale, while Monte Carlo estimation is computationally expensive and can drift from the intrinsic correctness of steps. To get effective PRMs at low cost, we introduce TIPS (Thinking-Induced Process Supervision), an outcome-only reinforcement learning (RL) framework for training generative PRMs. In TIPS, the model generates a chain-of-thought (CoT) followed by step-level labels and an outcome label. The reward depends solely on whether the predicted outcome matches the ground truth, and the resulting group-relative advantage is used to optimize the entire generated response. Intuitively, when checking intermediate steps helps determine the outcome, more accurate checks can lead to better outcome judgments and higher rewards. Outcome-only RL can therefore reinforce step-level verification without explicit process supervision. We validate the effectiveness of TIPS across math and agent benchmarks and four backbone families. Notably, TIPS-Qwen3-4B-Thinking-2507 reaches 85.2 F1 on ProcessBench with only 3.2K outcome-labeled trajectories, surpassing all evaluated trained PRMs and strong prompt-only judges such as GPT-5.4-Instruct and Claude-4.7-Opus, while still trailing o1-mini. Code and data are available at https://github.com/RUCBM/TIPS.

Momentum

Related topics

Latest papers 1,138