Process Reward Modeling

Ask about this topic

Recent momentum

-42%

7 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in External Reward Models

Neighbouring directions

External Reward ModelsSparse RewardsReward ModelingPotential-Based Reward ShapingOutcome-Based RewardsReasoning-Aware RewardShared Rewards

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

1 new paper

A weekly snapshot of new work published in Process Reward Modeling.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Process Reward Modeling.

Period ending 2026-09-07

5 new papers

A weekly snapshot of new work published in Process Reward Modeling.

92 papers

Latest in Process Reward Modeling

Browse all topics →
CardsList

  1. Multitask Reinforcement Learning for Assisting Choice Model Specification

    Sep 16, 2026Gabriel Nova, Stephane Hess, Sander Van CranenburghMulti-Task Reinforcement LearningProcess Reward Modeling

  2. Proof-Carrying Cognition: Closing the Verification Gap with Reality-Settled Reward

    Sep 9, 2026Eshwar Reddy M, Sourav KarmakarReasoning BenchmarkVerifier

  3. Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning

    Sep 3, 2026Kevin Du, Alexander Hoyle, Laura Ruis +1Reasoning ChainReasoning Traces

  4. WorldReward: Reward Modeling for Camera-Conditioned World Models

    Sep 3, 2026Yibin Wang, Zehan Wang, Junshu Tang +13Video World ModelsWorld Models

  5. Patterning in Practice: Debiasing Reward Models with Susceptibilities

    Sep 1, 2026George Wang, Elizabeth Donoway, Daniel MurfetProcess Reward ModelingImplicit Bias

  6. HSRM: Hidden-State Reward Models for Test-Time Verification

    Aug 31, 2026Xianzhi Li, Xiaodan ZhuMathematical ReasoningVerifier

  7. Small Language Models as Judges for Rubric-Based Reinforcement Learning

    Aug 30, 2026Fengyu Xie, Yilun Zhao, Bingsen Chen +2Rubric-Based Reinforcement LearningLarge Language Model Judges

  8. Towards Socially Compliant Navigation in Deep Reinforcement Learning via Proxemics-Based Reward Modeling

    Aug 13, 2026Takieddine Soualhi, Jacques Saraydaryan, Laetitia MatignonSocial Robot NavigationNavigation

  9. MuseCritic: Learning Multi-Aspect Song Rewards through Natural-Language Aesthetic Critiques

    Aug 12, 2026Jiabao Zhuang, Changhao Jiang, Hanchen Wang +11AestheticsCritique

  10. Se-DPO: Self-Evolving Token Credit for Direct Preference Optimization

    Aug 10, 2026Wenxiao Zhao, Shu Wang, Ying Nian WuDirect Preference OptimizationCredit Assignment

  11. Finding the Signal in the Spam: Jointly Learning Rewards and Worker Reliability from Pairwise Comparisons

    Aug 10, 2026Kaustubh Shivshankar Shejole, Tanish Agarwal, Arpit Agarwal +1Process Reward ModelingShared Rewards

  12. Multi-Agent Reinforcement Learning via Agent-Specific Preference

    Aug 9, 2026Ni Mu, Yao Luan, Yiqin Yang +1Multi-Agent Reinforcement LearningProcess Reward Modeling

  13. TrustRoboReward: Preference-Ordered Isotonic Score Editing for Multi-Paradigm Robot Reward Models

    Aug 9, 2026Yidong Wang, Yan Zhan, Ziteng Feng +16Process Reward Modeling

  14. RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward Construction

    Aug 6, 2026Chenglong Wang, Ziming Zhu, Yifu Huo +9Process Reward Modeling

  15. Rewriting or Reweighting? A Geometric Account in Language Models

    Aug 3, 2026Juntong Wang, Shengkun Yang, Xiyuan Wang +1Model ActivationsProcess Reward Modeling

  16. Beyond Routing Weights: Faithful Response-Level Interpretation of Mixture-of-Experts Reward Models via Contribution Contrast

    Jul 31, 2026Yifan Wang, Jinyi Mu, Mayank Jobanputra +4Mixture-of-Experts ModelsProcess Reward Modeling

  17. LEMUR: Learning to Align with Multi-Objective Reinforcement Learning from Preference Feedback

    Jul 31, 2026Manith Adikari, Bei Peng, Samuele Vinanzi +1Constrained Reinforcement LearningProcess Reward Modeling

  18. Learning Latent Reasoning Traces for Scalar Reward Models End-to-End

    Jul 31, 2026Sanwoo Lee, Clive Bai, Hsiu-Yuan Huang +3Process Reward ModelingEfficient Latent Reasoning

  19. DS@GT ARC at CheckThat! 2026: LLM-Based Trace Ranking and Grouped Reward Modeling for Multilingual Numerical Claim Verification

    Jul 27, 2026Sagnik Sinha, Shreyas ShresthaLlm-DrivenReasoning Traces

  20. From Evaluation to Optimisation: Hierarchy-Aware Training Signals for CWE Prediction in Python

    Jul 23, 2026Muntasir Adnan, Manile Srun, Carlos C. N. KuhnVulnerability Detection & RepairQuadratic Slack Penalty

  21. CSPF: A Constrained Shared-Private Fusion Method for Non-Verifiable Preference Evaluation

    Jul 23, 2026Hehao Zhang, Danli Wang, Xinyuan Wang +1Pairwise PreferencesProcess Reward Modeling

  22. Progress Reward Modeling for Robotic Learning: A Comprehensive Survey

    Jul 22, 2026Jianshu Zhang, Keliang Wu, Haoran Lu +8Scalable Robot LearningProcess Reward Modeling

  23. Measuring Reward-Seeking via Contrastive Belief Updates

    Jul 21, 2026Axel Højmark, Jérémy Scheurer, Evgenia Nitishinskaya +5Process Reward ModelingDeep Reinforcement Learning

  24. A Method for Learning Value Systems in Generative AI

    Jul 18, 2026Andrés Holgado-Sánchez, Holger Billhardt, Sascha OssowskiGenerative Artificial IntelligenceArtificial Intelligence Alignment

  25. When Model Merging Rivals Joint Multi-Task Reinforcement Learning: A Task-Vector Geometry Analysis

    Jul 17, 2026S. Aaron McClendonModel MergingMulti-Task Reinforcement Learning

  26. Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learning

    Jul 15, 2026Dingsu Wang, Filip Ryzner, Kelly He +12Recommender SystemsAnalytics

  27. Meta-Learning Preferences for Multilingual LLM Alignment

    Jul 14, 2026Jiaying Lin, Seongho Son, Nam Phuong Tran +3Cross-Lingual AlignmentLarge Language Model Alignment

  28. KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling

    Jul 10, 2026Peng Kuang, Haibo Jin, Xiaoyu Han +5Reliable Medical Process-Level Reward Model Evaluation FrameworkProcess Reward Modeling

  29. Large Behavior Model: A Promptable Digital Twin of the Retail Customer

    Jul 8, 2026Wachiravit Modecrua, Krittin Pachtrachai, Touchapon KraisingkornLarge Behavior ModelProcess Reward Modeling

  30. Decentralized Aggregation of LLM Predictions via Wagering Mechanisms

    Jul 5, 2026Yuhong Luo, David M. Pennock, Xintong WangBettingProcess Reward Modeling

  31. PAPA: Online Personalized Active Preference Alignment

    Jul 1, 2026Anindya Sarkar, Nasik Muhammad Nafi, Isaac Lyngaas +2Preference AlignmentTraining-Free Reward Alignment

  32. Test-Time Verification for Text-to-SQL via Outcome Reward Models

    Jun 29, 2026Mattia Tritto, Giuseppe Farano, Dario Di Palma +4Text-To-SqlProcess Reward Modeling

  33. To Reason or to Fabricate: Reasoning Without Shortcuts via Hint-Anchored Pairwise Aggregation

    Jun 28, 2026Jiuheng Lin, Chen Zhang, Yansong FengProcess Reward ModelingShortcuts

  34. The Weakest Link Tells It All: Outcome-Supervised Process Reward Modeling via Learnable Credit Assignment

    Jun 26, 2026Tianyu Jia, Yue Fang, Hongxin Ding +6Reliable Medical Process-Level Reward Model Evaluation FrameworkProcess Reward Modeling

  35. Scaling Multi-Reference Image Generation with Dynamic Reward Optimization

    Jun 25, 2026Wenwang Huang, Yusen Fu, Junjie Wang +6Large-Scale Image GenerationImage Generation

  36. SpatialFlow-GRPO: Where Spatial Credit Drives Image Editing

    Jun 25, 2026Yankai Yang, Yancheng Long, Wei Chen +7Image EditingFlow-Grpo

  37. Holistic Data Scheduler for LLM Pre-training via Multi-Objective Reinforcement Learning

    Jun 23, 2026Chenhao Dang, Jing Ma, Mingjie LiaoModel PretrainingProcess Reward Modeling

  38. RARM: Confidence-Gated Progress Reward Modeling for RL in Manipulation

    Jun 20, 2026Pengzhi Yang, Xinyu Wang, Pengyu Jing +7Process Reward Modeling

  39. VeriBound: PAC-Bayesian Generalization Bounds for Process Reward Models Trained with Formal Verification Tools

    Jun 17, 2026Amirul Rahman, Mohammed Sabih AlsharariReinforcement Learning With Verifiable RewardFormal Verification

  40. TuneJury: An Open Metric for Improving Music Generation Preference Alignment

    Jun 15, 2026Yonghyun Kim, Junwon Lee, Haiwen Xia +5Music GenerationPreference Alignment

  41. Closing the Reflection Gap: A Free Calibration Bonus for Agentic RL

    Jun 12, 2026Yinglun ZhuAgentic Reinforcement-Learning FrameworkReflections

  42. Reward Modeling for Multi-Agent Orchestration

    Jun 11, 2026King Yeung Tsang, Zihao Zhao, Vishal Venkataramani +5Process Reward ModelingReward Modeling

  43. ComplexConstraints and Beyond: Expert Rubrics for RLVR

    Jun 8, 2026Sushant Mehta, Liudas Panavas, Suhaas Garre +1Rubric-Based Reinforcement LearningRubrics

  44. DynaCF: Mitigating Shortcut Learning in Reward Models via Dynamic Counterfactual Sensitivity

    Jun 8, 2026Fengyuan Liu, Yongliang Miao, Zirui He +3Process Reward ModelingCounterfactual Rollouts

  45. PAFO: Pareto Fairness Optimization for Personalized Reward Modeling

    Jun 6, 2026Xiaoyan Zhao, Haoting Ni, Yang Zhang +3Process Reward ModelingPareto Frontier

  46. Beyond Rubrics: Exploration-Guided Evaluation Skills for Reward Modeling

    Jun 5, 2026Xing Yue, Linjuan Wu, Daoxin Zhang +2RubricsProcess Reward Modeling

  47. Sparse Mixture-of-Experts Reward Models Learn Interpretable and Specialized Experts for Personalized Preference Modeling

    Jun 2, 2026Yifan Wang, Jinyi Mu, Mayank Jobanputra +5Mixture-of-Experts ModelsProcess Reward Modeling

  48. Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skill

    Jun 2, 2026Tao Chen, Gangwei Jiang, Pengyu Cheng +10Process Reward ModelingReward Modeling

  49. HARVE: Hacking-Aware Reward-Head Vector Editing for Robust Reward Models

    Jun 2, 2026Shuang Liu, Yuxuan Bo, Qiuyang Zhao +4Process Reward Modeling

  50. From Long News to Accurate Forecast: Importance-Aware Fusion and PRM-Guided Reflection for Time Series Forecasting

    Jun 2, 2026Mingyang Liu, Qingcan Kang, Yuke Wang +6HeadlinesStep-Level Supervision

  51. EST-PRM: Stress-Testing Process Reward Models Before They Become Load-Bearing

    May 30, 2026Ibne Farabi Shihab, Fariya Afrin, Sanjeda Akter +1Reliable Medical Process-Level Reward Model Evaluation FrameworkProcess Reward Modeling

  52. Consolidating Rewarded Perturbations for LLM Post-Training

    May 29, 2026Zheyu Zhang, Shuo Yang, Gjergji KasneciLarge Language Model Post-TrainingProcess Reward Modeling

  53. Generalized Intention Modeling in Multi-Agent Reinforcement Learning

    May 29, 2026Mateusz Odrowaz-Sypniewski, Jasmine Bayrooti, Ajay Shankar +1Multi-Agent Reinforcement LearningProcess Reward Modeling

  54. PEARL: Training Socratic Tutors with Pedagogically Aligned Reinforcement Learning

    May 28, 2026Qikai Chang, Zhenrong Zhang, Linbo Chen +4Socratic DialogueCurriculum Reinforcement Learning

  55. RUBRIC-ARROW: Alternating Pointwise Rubric Reward Modeling for LLM Post-training in Non-verifiable Domains

    May 27, 2026Haoxiang Jiang, Zihan Dong, Tianci Liu +5Rubric-Based Reinforcement LearningRubrics

  56. AdaDPO: Self-Adaptive Direct Preference Optimization with Balanced Gradient Updates

    May 27, 2026Shaolong Chen, Madalina Ciobanu, Qingqing Mao +1Direct Preference OptimizationLarge Language Model Post-Training

  57. The Missing Piece in Pre-trained Model Evaluation: Reward-Guided Decoding Unlocks Task-Oriented Behavior Without Parameter Updates

    May 27, 2026Shaobo Wang, Guo Chen, Ziyue Wang +5Large Language Model DecoderProcess Reward Modeling

  58. KARMA: Karma-Aligned Reward Model Adaptation

    May 26, 2026Jared Scott, Jesse RobertsProcess Reward ModelingSocial Reasoning

  59. Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring

    May 25, 2026Zhengyang Wang, Sanwoo Lee, Jiaxin Wang +3Automated Essay ScoringScoring

  60. When In-Distribution Gains Fail: Evaluating Weak-to-Strong Reward Models under Preference Shift

    May 25, 2026Khoi Le, Tri Cao, Phong Nguyen +5Preference LearningWeak Supervision