Overview

Reward modeling turns comparisons, ratings, demonstrations, rubrics, or verifiable outcomes into signals for judging responses and actions. Methods range from pairwise preference models and scalar outcome or process critics to generative rubric judges, tool-based verifiers, and uncertainty-aware or personalized models. These signals guide preference optimization, best-of-N selection, test-time search, and training in language, image and video generation, robotics, and agents. A central challenge is that high preference accuracy may not capture diverse or shifting human intent, while optimization can exploit scoring biases, so evaluation must consider calibration and downstream behavior as well as ranking accuracy.

Latest papers

CardsList

340 papers21 papers in the last four weeks, down 56% on the four weeks before. 0.2% of all new papers.

  1. Motion-Aware Reward Modeling for Instruction-Guided Video Editing

    Nov 17, 2026Li Li, Xiangbo Gao, Bo Ni +11Reward ModelingVideo Reward Modeling

  2. Rethinking Visual Reasoning in Text-to-Image Reward Modeling

    Nov 12, 2026Shiye Su, Xiaohan Wang, Ludwig Schmidt +1Reward ModelingT2I Generation Evaluation

  3. Leveraging Psychophysical Attentional Distribution for Gaze-Augmented Reward Modeling

    Nov 10, 2026Chaeho Lee, Junyup Kim, Wansoo Kim +2Reward ModelingPreference Learning for LLMs

  4. Enforcing Axioms for AI Alignment under Loss-Based Rules

    Nov 9, 2026Alexandros Hollender, Sonja KraiczyLLM AlignmentReward Modeling

  5. REAL: Reward Modeling through Evidence-Linked Analysis of Lifelikeness in Generated Speech

    Nov 9, 2026Yaodong Song, Jie Lian, Xusheng Yang +6Reward ModelingSpeech Generation Evaluation

  6. Generator-Aligned Reward Modeling with Target-Aware Bounded Optimization for Visual Generation

    Nov 5, 2026Ziqiao Weng, Yuanzhi Liang, Haibin Huang +2Reward ModelingControllable Video Generation

  7. ArtiVidRM: Verifiable Artifact-as-Rubric Reward Modeling for Explicit Quality Articulation in Video Generation

    Nov 5, 2026Caorui Li, Yangguang Ji, Shuxia Lin +12Video Reward ModelingReward Modeling

  8. Forecasting How RLHF Responds to Reward-Model Edits Before Training

    Nov 2, 2026Zixiao Wang, Duzhen Zhang, Xingbo Du +2Reinforcement LearningRL Post-Training

  9. Rome Wasn't Built in One Turn: Replay-Grounded Reward Signals for Long-Horizon Freeciv Agents

    Oct 30, 2026Yanchen Liu, Xinyu Che, Brihi Joshi +6Game-Playing AgentsRL for Game AI

  10. Reward-Adaptive Co-Evolution of Policy and Rubric

    Oct 29, 2026Yizhu Chen, Jianguang Jiang, Jiameng Huang +5Rubric-Based RLReward Design for RL

  11. AndroidFlux: Evaluating and Reward Modeling Failure Recovery Capabilities in Mobile Use Multimodal Agents

    Oct 25, 2026Gyubeum Lim, Yemo Koo, Ghunwoo Jang +1Multimodal Agent EvaluationReward Model Evaluation

  12. CropReward: A Human-Preference Benchmark and Reward Model for Aesthetic Image Cropping

    Oct 25, 2026Xiangfei Sheng, Xiaofeng Pan, Leida Li +4Reward ModelingHuman Preference Modeling

  13. Memory-Aware Reward Modeling: Learning Human Preferences for LLM Memory Use

    Oct 22, 2026Yijiang River Dong, Zexue He, Cheng Yu +9Memory-Augmented Language ModelsReward Modeling

  14. Scaling Laws for Generative Reward Models

    Oct 22, 2026Angel Raychev, Nathan Lile, Rafael RafailovReward ModelingRL for Language Models

  15. Differentially Private Sparse Reward Estimation with Preference Feedback

    Oct 21, 2026Meng Ding, Mingxi Lei, Jie Zhang +2Reward ModelingRL from Human Feedback

  16. AdvFidelity: Unifying Preference Alignment and Few-Step Image Generation within Reinforcement Learning

    Oct 21, 2026Sicong Kang, Fangao Zeng, Yuhan Li +6RL for Image GenerationDiffusion-Based Image Generation

  17. PerSPL: Personalized Semi-supervised Preference Learning

    Oct 21, 2026Xiaoan Xu, Tingzhou Wei, Juncheng Dong +3Personalized Reward ModelingUser Preference Modeling

  18. CollabSciReM: Aligning Language Models for Scientific Conversations via Science-Aware Reward Decomposition

    Oct 20, 2026Sasi Kiran Gaddipati, Gollam Rabby, Sören AuerLLM AlignmentReward Modeling

  19. Judging the Justification: Decision Certificate Supervision for Generative Reward Models

    Oct 20, 2026Guiquan Sun, Bing Bai, Martin Renqiang Min +1Reward ModelingFaithfulness of Language Model Explanations

  20. Steered Not Stirred: Effective Reward Tilting using Surrogate Reward Mixing

    Oct 18, 2026Alec Sargood, Olivia Gallup, Georg Maierhofer +4Inference-Time GuidanceReward Modeling

  21. Reason-guided Human Reward Modeling for Preference-based Reinforcement Learning

    Oct 16, 2026Anshul Nayak, Shahil Shaik, Jonathan Smereka +1Preference-Based RLReward Modeling

  22. Language Models Learn to Improve Language Models

    Oct 16, 2026Minhua Lin, Zijun Wang, Zewen Liu +7Language Model Self-ImprovementLarge Language Model-Guided Optimization

  23. Reward Engine: Reward-Centric Self-Evolution for Open-Ended Tool Agents

    Oct 16, 2026Litong Feng, Ji Qi, Yiran Cheng +3Tool-Using AgentsSelf-Improving Agents

  24. AVC-Reward: Event-Centric Audio-Video Consistency Evaluation

    Oct 15, 2026Yuruo Wu, Kaihang Pan, Kai Shen +5Video Generation EvaluationAudio-Video Generation

  25. Blame Errant Words, Not the Canvas: Defect-Aware Spatial Credit Assignment for Visual Text Generation

    Oct 14, 2026Sujie Hu, Huaisong Zhang, Pujing Yang +7Text Rendering in T2I GenerationReward Modeling

  26. RM-OPD: On-Policy Distillation for Generative Reward Models

    Oct 14, 2026Qinglin Su, Licheng Pan, Zhen Fang +5Reward ModelingRL for Generative Models