Process Reward Models

Also known as PRM

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, up 40% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 91

All topics

RewardWeaver: Long-Horizon Interactive Learning for Language Agents via Self-Evolving Reward Adaptation
Oct 7, 2026Hengbo Xiao, Boyao Zhang, Purui Liu +4RL for LLM Agents Rubric-Based RL
BoT-GRPO: Efficient Process-Reward RL for Reasoning via Bag-of-Token Aggregation
Oct 7, 2026Yingxiang Yang, Weihang Xiao, Zhunxuan Wang +2RL for Language Model Reasoning Group Relative Policy Optimization
Amazon AGI · Virginia Tech
World Potential Model: Pretrained World Knowledge as Progress Potentials
Oct 7, 2026Jun Zhao, Jixin Tang, Yang Shu +6Long-Horizon LLM Agents RL for LLM Agents
National University of Singapore · Fudan University · Tsinghua University +1
EnGRICH: Enhancing Generative Reward Modeling with Critiques from Humans
Oct 4, 2026Xuancheng Li, Beining Wang, Haitao Li +7Reward Modeling Process Reward Models
Department of Computer Science and Technology, Tsinghua University, Beijing, China · Tencent, Beijing, China
Learning Process Rewards via Reasoning State Propagation
Sep 30, 2026Kai Gan, Zi-Hao Zhou, Bo Ye +3Process Reward Models RL for Language Model Reasoning
School of Computer Science and Engineering, Southeast University, Nanjing 210096, China · Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, China · Zhongguancun Academy +1
Inducing Process Supervision from Outcome-Only Reinforcement Learning
Sep 29, 2026Shengda Fan, Xin Cong, Zhong Zhang +2Reinforcement Learning Process Reward Models
Renmin University of China · Tsinghua University · University of Electronic Science and Technology of China +1
Why Deterministic PRM Guidance Underperforms in Discrete Diffusion Reasoning
Sep 28, 2026Yan Zhan, Shaobo Liu, Zhijun GaoProcess Reward Models Diffusion Language Model Decoding
Peking University · Shenzhen University
ARS: Agentic Reward System for Robot Learning
Sep 28, 2026Sheng Hu, Weiyi Lu, Lingbing Zeng +5RL for Robotics Process Reward Models
AIRC, Midea Group
Rewarding Reasoning, Not Answers: Fixing and Bounding Test-Time Reinforcement Learning on Medical QA
Sep 15, 2026Kailong Fan, Anqi Pu, Yichen Wu +7Process Reward Models RL for Language Model Reasoning
1Harvard Medical School/MGH · 3Harvard University · 2Zhejiang University
SocialRL: Refining LLMs' Social Intelligence through Multi-turn Reinforcement Learning and Reward Design
Sep 9, 2026Jianing Wang, Xintao Wang, Aili Chen +7RL for Language Models Reinforcement Learning
Fudan University · Hello Group
Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning
Sep 3, 2026Kevin Du, Alexander Hoyle, Laura Ruis +1CoT Faithfulness Process Reward Models
ETH Zürich · Work done during an internship at Cohere. · MIT +1
Mitigating Over-Optimization in PRM-Guided Search in Mathematical Reasoning by Optimizing the Guide
Aug 30, 2026Taejong Joo, Diego KlabjanInference-Time Search Process Reward Models
Department of Industrial Engineering & Management Sciences Northwestern University
FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation
Aug 30, 2026Hao Feng, Zhi Zuo, MingJian Liang +6Process Reward Models 3D Scene Generation
SPEAR: Distilling Domain-Adaptive Reasoning Skeletons via Sequential Symbolic Alignment in Reinforcement Learning
Aug 27, 2026Zhuochun Li, Yuelyu Ji, Yiming Zeng +1Process Reward Models RL for Language Model Reasoning
University of Pittsburgh, Pittsburgh, USA · University of Connecticut, Storrs, USA
SCOUT: Unlocking Enhanced Spatial Reasoning via Structured Chain-of-Thought and Multi-Objective Process Reward
Aug 12, 2026Zile Zhou, Huining Yuan, Weichen Zhang +2Visual Spatial Reasoning Process Reward Models
Shenzhen International Graduate School, Tsinghua University, Shenzhen, China
StructReward: Efficient Structured Process Rewards for Self-Correcting Multimodal Reasoning
Aug 8, 2026Yifan Li, Ruxin Sun, Tongzhou ZhaoProcess Reward Models Multimodal Reasoning
Quality-Diversity Stress Tests for Process Reward Models:What Archive Coverage Can and Cannot Certify
Aug 8, 2026Ibne Farabi Shihab, Fariya AfrinProcess Reward Models Adversarial Attacks
Department of Computer Science, Iowa State University · Department of Computer Science, Kalinga Institute of Industrial Technology
BiCAA: Bidirectional Credit Assignment for Search-Augmented Agent
Aug 2, 2026Yibin Huang, Bin Xu, Hailong Cao +1Process Reward Models Credit Assignment in RL
Faculty of Computing, Harbin Institute of Technology
Learning Latent Reasoning Traces for Scalar Reward Models End-to-End
Jul 31, 2026Sanwoo Lee, Clive Bai, Hsiu-Yuan Huang +3Reward Modeling LLM Alignment
National Key Laboratory for Multimedia Information Processing, Peking University · School of Computer Science, Peking University · LLM Department, Tencent
Progress Reward Modeling for Robotic Learning: A Comprehensive Survey
Jul 22, 2026Jianshu Zhang, Keliang Wu, Haoran Lu +8Reward Modeling Process Reward Models
Northwestern University · Carnegie Mellon University · University of Wisconsin–Madison +2
Rewarding Better Thinking for LLM Preference Alignment
Jul 22, 2026Xubo Liu, Wenya Guo, Ruxue Yan +2Process Reward Models Credit Assignment in RL
VCIP, DISSec, College of Computer Science, Nankai University, Tianjin, China
KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling
Jul 10, 2026Peng Kuang, Haibo Jin, Xiaoyu Han +5Process Reward Models KV Caching
University of Illinois Urbana-Champaign · Imperial College London · City University of Hong Kong
TimeThink: Reasoning with Time for Video LLMs
Jul 6, 2026Handong Li, Longteng Guo, Zikang Liu +8Temporal Video Grounding Process Reward Models
School of Artificial Intelligence, University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · OPPO AI Center, OPPO Inc.
Reward Granularity in RLVR: Comparing Process and Outcome Reward Structures for Mathematical Reasoning in Small Language Models
Jul 3, 2026Anagha Radhakrishna Palandye, Rebecca Glick, Osheen KaulProcess Reward Models RL for Language Model Reasoning
New York University
Evidence-State Rewards for Long-Context Reasoning
Jul 2, 2026Ya Gao, Pekka MarttinenProcess Reward Models RL for Language Model Reasoning
1Aalto University
Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning
Jun 30, 2026Junha Jung, Minbyul Jeong, Suhyeon Lim +5Process Reward Models Medical VQA
Korea University · AIGEN Sciences · Upstage AI +3
SEVA: Self-Evolving Verification Agent with Process Reward for Fact Attribution
Jun 29, 2026Aojie Yuan, Yi Nian, Haiyue Zhang +2AI Agent Reliability Process Reward Models
University of Southern California, Los Angeles, USA · University of Michigan, Ann Arbor, USA
Process Advantage Signal Shaping: A Paradigm-Agnostic Middleware for Process-Supervised RL in LLM Reasoners
Jun 28, 2026Chao Wang, Hongtao Tian, Tao Yang +3Reinforcement Learning Process Reward Models
Tsinghua University · Work done while interning at Tencent. · WeChat, Tencent
The Weakest Link Tells It All: Outcome-Supervised Process Reward Modeling via Learnable Credit Assignment
Jun 26, 2026Tianyu Jia, Yue Fang, Hongxin Ding +6Process Reward Models Fine-Grained Credit Assignment
National Engineering Research Center of Software Engineering, Peking University, Beijing, China · School of Computer Science, Peking University, Beijing, China · Key Laboratory of High Confidence Software Technologies, Ministry of Education, Beijing, China +3
Neglected Free Lunch from Post-training: Progress Advantage for LLM Agents
Jun 24, 2026Changdae Oh, Wendi Li, Seongheon Park +3Process Reward Models RL Post-Training
University of Wisconsin–Madison · Argonne National Laboratory

Oct 7, 2026, cs.AIJ/K move · Enter open · S save

RewardWeaver: Long-Horizon Interactive Learning for Language Agents via Self-Evolving Reward Adaptation

Hengbo Xiao, Boyao Zhang, Purui Liu, Yuxuan Zheng+3

RL for LLM Agents Rubric-Based RL Reward Shaping Process Reward Models Reinforcement Learning with Verifiable Rewards Credit Assignment in RL

Open paper AskPDF arXiv

Reinforcement learning with verifiable rewards (RLVR) has driven substantial progress in domains where task outcomes can be reliably evaluated, but long-horizon interaction remains challenging due to sparse terminal feedback and difficult credit assignment. Process rewards provide denser supervision, yet the capabilities most relevant for training can change as the policy evolves: a behavior that is easy to evaluate or frequently deficient need not be the bottleneck currently limiting task success. We introduce RewardWeaver, a self-evolving reward adaptation framework for language agents in long-horizon interaction. RewardWeaver maintains a validated capability space in which the semantics of admitted Rubrics remain fixed, and closes the loop between policy optimization, task evaluation, failure attribution, and reward adaptation. After each training stage, it performs outcome-grounded backward attribution on low-outcome trajectories, aggregates recurrent and policy-controlled capability bottlenecks, and dynamically selects the corresponding process rewards for the next stage. Recurrent failures not covered by the existing capability space trigger a separate, controlled expansion procedure. We evaluate REWARDWEAVER on SOTOPIA, Amazon?HistoryPrice, and a newly constructed Sales Benchmark. Across social interaction, bilateral bargaining, and domain-specific sales, REWARDWEAVER establishes new state-of-the-art (SOTA) results. Ablations further demonstrate the importance of dynamic reward allocation, failure-grounded attribution, and stable semantics for admitted capabilities.

Momentum

Related topics

Latest papers 91