External Reward Models

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

12 new papers

A weekly snapshot of new work published in External Reward Models.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in External Reward Models.

Period ending 2026-09-07

9 new papers

A weekly snapshot of new work published in External Reward Models.

Inside this field

Focused directions

332 papers

Latest in External Reward Models

Browse all topics →
CardsList

  1. SCOUT: Per-Context Reset Curricula for Sparse-Reward Reinforcement Learning

    Jul 29, 2026Siddharth Aphale, Ayushman SinghSparse RewardsCurriculum Reinforcement Learning

  2. Top-kk Pareto Bandits: Hypervolume Regret for Multi-Objective Slate Selection

    Jul 28, 2026Nicolas Gutowski, Fabien Chhel, Alexandre Letard +1Multi-Armed BanditsPareto Frontier

  3. ODYSSE: Episode-wise Policy Optimization for Personalized Agentic Reasoning

    Jul 28, 2026Jiaqi Zhang, Tong Chen, Junliang Yu +2Agentic ReasoningMulti-Objective Policy Optimization

  4. Structure-aware Relative Policy Optimization for Ranking

    Jul 28, 2026Yiteng Tu, Weihang Su, Zitao Su +3RankingExternal Reward Models

  5. Meta-Learned Reward Shaping for Reinforcement Learning from Human Feedback

    Jul 28, 2026Yunpeng ChuReinforcement Learning From Human FeedbackPotential-Based Reward Shaping

  6. DS@GT ARC at CheckThat! 2026: LLM-Based Trace Ranking and Grouped Reward Modeling for Multilingual Numerical Claim Verification

    Jul 27, 2026Sagnik Sinha, Shreyas ShresthaLlm-DrivenReasoning Traces

  7. Decentralised Consensus Learning Networks: SME Rotation Without Centralised Reward

    Jul 27, 2026Florin NeaguBeliefExpert Demonstrations

  8. Hierarchical Soft Actor-Critic for Sparse-Reward Long-Horizon Reinforcement Learning

    Jul 26, 2026Zahra Abdalla Elashaal, Afef Hfaiedh, Nahla Khraief +2Hierarchical Reinforcement LearningSparse Rewards

  9. Optimal Reward Shaping: Autonomous Car Parking Case Study

    Jul 26, 2026Emre Özkaya, Nicolas R. GaugerPotential-Based Reward ShapingDeep Q-Networks

  10. Learning as Reasoning Unfolds: Progressive Rollout Allocation for Efficient Reinforcement Learning

    Jul 24, 2026Heyang Jiang, Henry Liu, Baharan MirzasoleimanReinforcement Learning With Verifiable RewardLong Rollouts

  11. AdaKP: Online Adaptive Knowledge-Point Selection for Reasoning-Oriented Reinforcement Learning

    Jul 23, 2026Zibin Meng, Zhenyu Zhao, Chunqiang RunReinforcement Learning With Verifiable RewardSparse Rewards

  12. The Dark Room in the Reward Channel: Dense Prediction Rewards Collapse GRPO-Trained LLM Agents -- and The Channel, Not the Content, Decides What Works

    Jul 23, 2026Yu WangShared RewardsLarge Language Model Agents

  13. From Evaluation to Optimisation: Hierarchy-Aware Training Signals for CWE Prediction in Python

    Jul 23, 2026Muntasir Adnan, Manile Srun, Carlos C. N. KuhnVulnerability Detection & RepairQuadratic Slack Penalty

  14. PrefReward: Learning User Preference Matrix for Personalized Text Generation

    Jul 23, 2026Yue Wu, Chengbing Wang, Yimeng Bai +3PersonalizationText Generation

  15. CSPF: A Constrained Shared-Private Fusion Method for Non-Verifiable Preference Evaluation

    Jul 23, 2026Hehao Zhang, Danli Wang, Xinyuan Wang +1Pairwise PreferencesProcess Reward Modeling

  16. Progress Reward Modeling for Robotic Learning: A Comprehensive Survey

    Jul 22, 2026Jianshu Zhang, Keliang Wu, Haoran Lu +8Scalable Robot LearningProcess Reward Modeling

  17. Progress-conditioned Group Policy Optimization for Long-Horizon Agentic Tasks

    Jul 22, 2026Kaibing Yang, Guangfeng Cai, Shengtian Yang +6Group Relative Policy OptimizationAgentic Reinforcement-Learning Framework

  18. The Mechanism Matters: When Knowledge Graphs Help Reinforcement Learning

    Jul 21, 2026Mohammed Sameer SyedKnowledge GraphsSparse Rewards

  19. DobicVLM: Aligning Chest X-Ray Report Generation with Clinically-Grounded Programmatic Rewards via Group Relative Policy Optimization

    Jul 21, 2026Thanni Adewuyi, Angelica Obayi, Andem Aniekan +10Medical Vision-Language ModelsChest Radiography

  20. Measuring Reward-Seeking via Contrastive Belief Updates

    Jul 21, 2026Axel Højmark, Jérémy Scheurer, Evgenia Nitishinskaya +5Process Reward ModelingDeep Reinforcement Learning

  21. Counterfactual Shapley Credit Assignment

    Jul 18, 2026Mingxuan Li, Kai-Zhan Lee, Elias BareinboimCredit AssignmentCounterfactual Rollouts

  22. A Method for Learning Value Systems in Generative AI

    Jul 18, 2026Andrés Holgado-Sánchez, Holger Billhardt, Sascha OssowskiGenerative Artificial IntelligenceArtificial Intelligence Alignment

  23. Principled Direction-Free Intrinsic Motivation through Model-Free Epistemic Free-Energy Estimators

    Jul 18, 2026Alireza Furutanpey, Schahram DustdarIntrinsic MotivationExternal Reward Models

  24. Feedback Attribution and Representation Geometry: Metrics for Comparing Individual and Shared Rewards in MARL

    Jul 17, 2026Tasha Pais, Richard HigginsMulti-Agent Reinforcement LearningShared Rewards

  25. Foresight Residual RL for Long-Horizon Robot Manipulation with Vision-Language-Action Models

    Jul 17, 2026Yuhan Liu, Xinyu Zhang, Litao Liu +1Long-Horizon PlanningSparse Rewards

  26. When Model Merging Rivals Joint Multi-Task Reinforcement Learning: A Task-Vector Geometry Analysis

    Jul 17, 2026S. Aaron McClendonModel MergingMulti-Task Reinforcement Learning

  27. Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learning

    Jul 15, 2026Dingsu Wang, Filip Ryzner, Kelly He +12Recommender SystemsAnalytics

  28. Meta-Learning Preferences for Multilingual LLM Alignment

    Jul 14, 2026Jiaying Lin, Seongho Son, Nam Phuong Tran +3Cross-Lingual AlignmentLarge Language Model Alignment

  29. Learning Safe Agent Behaviour from Human Preferences and Justifications via World Models

    Jul 14, 2026Ilias Kazantzidis, Timothy J. Norman, Yali Du +1Simulation-Based Reinforcement LearningExternal Reward Models

  30. Read It Back: Pretrained MLLMs Are Zero-Shot Reward Models for Text-to-Image Generation

    Jul 13, 2026Runhui Huang, Qihui Zhang, Zhe Liu +3Text-To-ImageShared Rewards

  31. SCOPE-RL: Optimizing Reasoning Paths Before and After Success

    Jul 13, 2026Xiaojian Liu, Han Xu, Jianqiang Xia +6Reinforcement Learning With Verifiable RewardVerifiable Rewards

  32. Generalizing Preference-based Reinforcement Learning: a Rationality Model for Incomparability

    Jul 13, 2026Simone Drago, Marco Mussi, Leonardo Bianconi +1Entropy Regularized Reinforcement LearningExternal Reward Models

  33. Efficient Online Proportional Sampling with Applications to Smoothed Online Learning

    Jul 13, 2026Amirmahdi Mirfakhar, Maria-Florina Balcan, Hedyeh BeyhaghiLearning-Augmented AlgorithmsOptimal Sample Complexity

  34. KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling

    Jul 10, 2026Peng Kuang, Haibo Jin, Xiaoyu Han +5Reliable Medical Process-Level Reward Model Evaluation FrameworkProcess Reward Modeling

  35. Correlation-Aware Contextual Bandits with Surrogate Rewards for LLM Routing

    Jul 10, 2026Ajay Narayanan Sridhar, Ronak Singh, Mehrdad Mahdavi +1Large Language Model RoutingMulti-Armed Bandits

  36. RLVP: Penalize the Path, Reward the Outcome

    Jul 8, 2026Bojie Li, Noah ShiOutcome-Based RewardsPenalties

  37. Large Behavior Model: A Promptable Digital Twin of the Retail Customer

    Jul 8, 2026Wachiravit Modecrua, Krittin Pachtrachai, Touchapon KraisingkornLarge Behavior ModelProcess Reward Modeling

  38. Residual-Conservative Model Predictive Path Integral Control

    Jul 8, 2026Hyung-Jin Yoon, Hunmin KimModel Predictive Path IntegralModel Predictive Control

  39. Improving LLM-Generated Process Model Quality Through Reinforcement Learning: The Role of Reward Function Design

    Jul 7, 2026Alexander Rombach, Chantale Lauer, Nijat MehdiyevReliable Medical Process-Level Reward Model Evaluation FrameworkExternal Reward Models

  40. More Convincing, Not More Correct: Self-Play Reward Hacking of Reference-Free LLM Judges

    Jul 7, 2026Chenyu ZhouLarge Language Model JudgesLlm-As-A-Judge

  41. Weak-to-Strong Generalization via Direct On-Policy Distillation

    Jul 6, 2026Shiyuan Feng, Huan-ang Gao, Haohan Chi +7On-Policy DistillationDeep Reinforcement Learning

  42. Non-Convex Sparse Reinforcement Learning via Non-Monotone Inclusions

    Jul 6, 2026Kyohei Suzuki, Konstantinos SlavakisEntropy Regularized Reinforcement LearningLipschitz Constant

  43. RSPO: Reward-Swap Policy Optimization for Multi-Turn LLM Agents

    Jul 6, 2026Qiang Liu, Taian Guo, Ruizhi Qiao +1Sparse Rewards

  44. VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models

    Jul 5, 2026Damir Shodiev, Aleksei Staroverov, Nikita Kachaev +2Vision-Language-Action ModelsLanguage-Conditioning Space Policy

  45. Regime-Conditional Stabilisation of LLM-Augmented Cooperative Multi-Agent Reinforcement Learning

    Jul 5, 2026Faid Keddouri, Sohaib Houhou, Aissa Boulmerka +1Potential-Based Reward ShapingMulti-Agent Reinforcement Learning

  46. Decentralized Aggregation of LLM Predictions via Wagering Mechanisms

    Jul 5, 2026Yuhong Luo, David M. Pennock, Xintong WangBettingProcess Reward Modeling

  47. Auto-AEG: Scalable Data Construction for Open-Vocabulary Audio Event Grounding

    Jul 5, 2026Zihan Zhang, Xize Cheng, Wenhao Yan +5Large Audio Language ModelsDense Temporal Annotation

  48. Reward Granularity in RLVR: Comparing Process and Outcome Reward Structures for Mathematical Reasoning in Small Language Models

    Jul 3, 2026Anagha Radhakrishna Palandye, Rebecca Glick, Osheen KaulReinforcement Learning With Verifiable RewardOutcome-Based Rewards

  49. Optimizing Visual Generative Models via Distribution-wise Rewards

    Jul 2, 2026Ruihang Li, Mengde Xu, Shuyang Gu +4Generative ModelsExternal Reward Models

  50. Many Voices, One Reward: Multi-Role Rubric Generation for LLM Judging and Reward Modeling

    Jul 2, 2026Dazhi Fu, Jiuding Yang, Yiwen Guo +1RubricsLarge Language Model Judges

  51. CoRe: Combined Rewards with Vision-Language Model Feedback for Preference-Aligned Reinforcement Learning

    Jul 2, 2026Hexian Ni, Tao Lu, Yinghao CaiOutcome-Based RewardsPreference Alignment

  52. LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression

    Jul 2, 2026Bowen Yuan, Zijian Wang, Yadan Luo +2Large Vision Language ModelsLens

  53. Simulation Based Reward Function Validation for Multi-Agent On Orbit Inspection

    Jul 1, 2026Patrick Quinn, Bala Prenith Reddy Gopu, George M. Nehma +1Multi-Agent Reinforcement LearningSpacecraft

  54. In-Context Reinforcement Learning under Non-Stationarity: A Survey

    Jul 1, 2026A Run, Ziluo DingIn-Context LearningDeep Reinforcement Learning

  55. PAPA: Online Personalized Active Preference Alignment

    Jul 1, 2026Anindya Sarkar, Nasik Muhammad Nafi, Isaac Lyngaas +2Preference AlignmentTraining-Free Reward Alignment

  56. VLM-AR3L: Vision-Language Models for Absolute and Relative Rewards in Reinforcement Learning

    Jul 1, 2026Kuan-Chen Chen, Winston Chen, Wei-Fang Sun +1External Reward Models

  57. UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization

    Jun 30, 2026Yaozhi Zheng, Yilei Jiang, Manyuan Zhang +5Visual GenerationCode Generation

  58. What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States

    Jun 30, 2026Chen Liu, Ling Chen, Hanzhang Zhou +7Agent MemoryGraphical User Interface Agents

  59. Test-Time Verification for Text-to-SQL via Outcome Reward Models

    Jun 29, 2026Mattia Tritto, Giuseppe Farano, Dario Di Palma +4Text-To-SqlProcess Reward Modeling

  60. Predictable GRPO: A Closed-Form Model of Training Dynamics

    Jun 29, 2026Rajat Ghosh, Datta Nimmaturi, Aryan Singhal +4Group Relative Policy OptimizationReward Modeling