Overview

Reward model evaluation studies whether learned judges match human preferences and provide useful signals for selecting or improving language-model and agent behavior. Researchers use pairwise and listwise preference benchmarks, calibration and uncertainty metrics, and stress tests across settings such as long-form writing, math, code, personalized dialogue, and robot or computer-use trajectories. Evaluations also test downstream effects in best-of-N selection and reinforcement learning, alongside methods such as human-verified data, LLM judges, and perturbation-based audits. A central tension is that strong benchmark accuracy may not transfer across domains or predict safe policy improvements, especially when long-horizon errors, surface biases, and reward hacking are involved.

Latest papers

CardsList

54 papers9 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

  1. GPRM: Global Perspective Process Reward Model

    Nov 16, 2026Zifan Zhang, Zhengbo Jiao, Shaobo Wang +10Process Reward ModelsLanguage Model Reasoning Evaluation

  2. Robotic Reward Models in the Foundation-Model Era

    Nov 16, 2026Guoqiang Liang, Yiqi Lin, Shangchen Zhou +4Reward Model EvaluationVideo Reward Modeling

  3. DeepResearch RewardBench: Evaluating Reward Models for Deep Research Report

    Nov 6, 2026Shudong Liu, Yuting Zhong, Guanhua Chen +5Reward Model EvaluationLLM-as-a-Judge

  4. Goodhart in the Planner: Sampling-Based Control Exploits Rewards Learned from Human Preferences

    Nov 6, 2026Soovadeep Bakshi, Apurba BoseReward HackingPreference-Based RL

  5. High-Dimensional Off-Policy Evaluation without Sample Splitting using an Onsager Correction

    Nov 5, 2026Saksham Jain, Guillaume Braun, Masaaki ImaizumiOff-Policy EvaluationReward Model Evaluation

  6. Forecasting How RLHF Responds to Reward-Model Edits Before Training

    Nov 2, 2026Zixiao Wang, Duzhen Zhang, Xingbo Du +2Reinforcement LearningRL Post-Training

  7. AndroidFlux: Evaluating and Reward Modeling Failure Recovery Capabilities in Mobile Use Multimodal Agents

    Oct 25, 2026Gyubeum Lim, Yemo Koo, Ghunwoo Jang +1Multimodal Agent EvaluationReward Model Evaluation

  8. ACWM-RM: A Reference-Free Reward Model from Complementary Mismatch Preferences

    Oct 23, 2026Shibo Hong, Siyu Ren, FengJiao Chen +3Multimodal Reward ModelingRL for Video Generation

  9. Poolwise: Evaluating Reward Models for Selection across Prompts

    Oct 22, 2026Mateusz Modrzejewski, Tomasz RadzikowskiReward Model EvaluationPairwise Preference Evaluation

  10. Scaling Laws for Generative Reward Models

    Oct 22, 2026Angel Raychev, Nathan Lile, Rafael RafailovReward ModelingRL for Language Models

  11. LegalRewardBench: Benchmarking Reward Models for Legal Preference Evaluation

    Oct 13, 2026Hui Huang, Jie Zhou, Hongli Zhou +7Reward Model EvaluationPairwise Preference Evaluation

  12. Benchmarking and Training Reward Models for Cross-Source Evidence Grounding in Search Agents

    Oct 13, 2026Haochen Zhao, Minsheng Hao, Zheng Li +8Evidence-Grounded GenerationAI Agent Benchmarks

  13. CriticHack: Evaluating Visual Rewards Under Robot Policy Optimization

    Oct 1, 2026Jiaxuan Luo, Xingguo Xu, Shanshan Wang +2RL for RoboticsReward Hacking

  14. Beyond Reference-Based Evaluation: Reward Models for Meta-Evaluation of Grammatical Error Correction

    Sep 18, 2026Ruotian Wu, Bill E. Johnson, Gene Saunders +3Grammatical Error CorrectionAutomated Evaluation

  15. F2^{2}DR: A Fine-Grained Full-Pipeline Reward Framework for DeepSearch Workflows

    Sep 17, 2026Bojian Xiong, Wentao Ding, Yujing Lu +11Reward ModelingLLM Evaluation

  16. TryOnReward: Learning Foveated Consistency for Reinforcement Fine-Tuning of Virtual Try-On

    Sep 6, 2026Xueheng Li, Yong Liu, Xiaolong Fu +5Virtual Try-OnMultimodal Reward Modeling

  17. UniRRM: Unified Reasoning Reward Models Across Languages and Evaluation Paradigms

    Sep 5, 2026Peng Lai, Yichao Du, Junchao Wu +6Reward ModelingReward Model Evaluation

  18. Evaluator Ensembles Under Reward Hacking: Covariance Geometry and Finite-Search Guarantees

    Aug 8, 2026Fariya Afrin, Ibne Farabi ShihabReward HackingLLM Evaluation

  19. OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models

    Jul 30, 2026Qiushi Sun, Kanzhi Cheng, Yian Wang +20VLM EvaluationComputer-Use Agent Benchmarks

  20. SeekJudge: A Practical Reward Framework for Reinforcement Learning in Computer-Use Agents

    Jul 25, 2026Yang Wan, Zhenhao Zhang, Jierui Wang +1Reward ModelingLLM-as-a-Judge

  21. Discretizing Reward Models

    Jun 19, 2026Vijay Viswanathan, Shiqi Wang, Devamanyu Hazarika +4Reward ModelingReinforcement Learning

  22. Beyond Rubrics: Exploration-Guided Evaluation Skills for Reward Modeling

    Jun 5, 2026Xing Yue, Linjuan Wu, Daoxin Zhang +2Reward ModelingLLM Evaluation

  23. Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skill

    Jun 2, 2026Tao Chen, Gangwei Jiang, Pengyu Cheng +10Reward ModelingReward Model Evaluation

  24. When RLHF Fails: A Mechanistic Taxonomy of Reward Hacking, Collapse, and Evaluator Gaming

    Jun 2, 2026Zelalem Abahana, David Evans, Satish Mahadevan Srinivasan +1Reward HackingLLM Evaluation

  25. HARVE: Hacking-Aware Reward-Head Vector Editing for Robust Reward Models

    Jun 2, 2026Shuang Liu, Yuxuan Bo, Qiuyang Zhao +4Reward ModelingReward Hacking