External Reward Models

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in External Reward Models.

Period ending 2026-09-07

9 new papers

A weekly snapshot of new work published in External Reward Models.

Inside this field

Focused directions

332 papers

Latest in External Reward Models

Open your feed →
CardsList

  1. CellRFT: Reinforcement Fine-Tuning for Single-Cell Perturbation Modeling

    Sep 17, 2026Jie Yan, Li Liu, Hanze Guo +7Single-Cell Perturbation PredictionReinforcement Fine-Tuning

  2. Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluations

    Sep 16, 2026Leon Bergen, Usha Bhalla, Andrew Lee +15Outcome-Based RewardsLarge Language Model Evaluation

  3. Online Robust Reinforcement Learning Through Monte-Carlo Planning

    Sep 16, 2026Tuan Dam, Kishan Panaganti, Brahim Driss +1Monte Carlo Tree SearchModel-Free Reinforcement Learning

  4. Multitask Reinforcement Learning for Assisting Choice Model Specification

    Sep 16, 2026Gabriel Nova, Stephane Hess, Sander Van CranenburghMulti-Task Reinforcement LearningProcess Reward Modeling

  5. Fingers as Legs: Learning Self-Supported Locomotion and Manipulation with an Anthropomorphic Hand

    Sep 15, 2026Amirhossein Kazemipour, Hehui Zheng, Robert KatzschmannDexterous Robot HandsAdaptive Locomotion

  6. Intrinsic Robot Rewarding: Reusing VLA Representations for Autonomous Evaluation and Policy Improvement

    Sep 15, 2026Tobias Schaffer, Mohab Elkhayat, Daniela Nicklas +2External Reward ModelsVision-Language-Action Models

  7. Fast-Convergent Meta-RL via Gradient-Clustered BS Sampling for Edge Caching

    Sep 14, 2026Farnaz Niknia, Ping WangMeta-LearningHeterogeneous Edge Devices

  8. Learning to Coach for Experiential Learning

    Sep 14, 2026Guanheng Chen, Tianzhu Ye, Li Dong +3Experience-Driven LearningCurriculum Reinforcement Learning

  9. Specifying Reward Functions for RL Without Environment Sampling

    Sep 14, 2026Stephane Hatgis-Kessell, W. Bradley Knox, Emma BrunskillExternal Reward Models

  10. Strong and Compact Policies for Submodular Markov Decision Processes via LP-Based Submodular Orienteering

    Sep 14, 2026Lars Rohwedder, Rico ZenklusenMarkov Decision ProcessesSubmodular Maximization

  11. VisInteract: Towards Dynamic Interactive Text-to-Visualization under Imperfect Queries

    Sep 14, 2026Wenxin Xu, Jinwei Lu, Hwanhee Kim +4Visual AnalyticsReasoning-Aware Reward

  12. GAUGE: When Not to Trust LLM-as-a-Judge in User-Simulated Evaluation of Task-Oriented Agents

    Sep 14, 2026Umesh Bodhwani, Thanh Tran, Kai WeiAgentic EvaluationsLlm-As-A-Judge

  13. Why Sample What You Can Enumerate? Exact Policy Optimization for Genomic Tool Selection

    Sep 9, 2026Haoyue Liu, Xiaoyu Ma, Ye Chen +2Group Relative Policy OptimizationExternal Reward Models

  14. Proof-Carrying Cognition: Closing the Verification Gap with Reality-Settled Reward

    Sep 9, 2026Eshwar Reddy M, Sourav KarmakarReasoning BenchmarkVerifier

  15. AlphaRJM: Reward-Jump Memory for Stochastic Return-Guided Alpha Discovery

    Sep 8, 2026Sayan Dhan, Selvaraju NatarajanReward ModelingSoft Actor-Critic

  16. Phase-and-First-Arrival VLM Feedback for Sparse-Reward Reinforcement Learning in Surgical Manipulation

    Sep 7, 2026Wanli Liuchen, Fangyuan Wang, Bin Li +4Sparse RewardsRobot-Assisted Minimally Invasive Surgery

  17. Legibility is Not Interpretability: Comparing Judged and Actual Importance in Chain-Of-Thought Reasoning

    Sep 3, 2026Kevin Du, Alexander Hoyle, Laura Ruis +1Reasoning ChainReasoning Traces

  18. Sequential Beats Joint: On the Interplay between On-Policy Distillation and RLVR

    Sep 3, 2026Boyan Li, Bingsen Chen, Chenghao Yang +3Reinforcement Learning With Verifiable RewardOn-Policy Distillation

  19. WorldReward: Reward Modeling for Camera-Conditioned World Models

    Sep 3, 2026Yibin Wang, Zehan Wang, Junshu Tang +13Video World ModelsWorld Models

  20. Gradients Know What Outcomes Don't: Unlocking Reinforcement Learning for LLM Reasoning with Gradient-Aligned Rewards

    Sep 3, 2026Leqi Zheng, Jinbo Su, Fang Niu +8Reinforcement Learning With Verifiable RewardLarge Language Model Reasoning

  21. Learning to Zoom Efficiently with a Contrastive Curriculum

    Sep 2, 2026Falko Helm, Iryna GurevychCurriculumExternal Reward Models

  22. Patterning in Practice: Debiasing Reward Models with Susceptibilities

    Sep 1, 2026George Wang, Elizabeth Donoway, Daniel MurfetProcess Reward ModelingImplicit Bias

  23. HSRM: Hidden-State Reward Models for Test-Time Verification

    Aug 31, 2026Xianzhi Li, Xiaodan ZhuMathematical ReasoningVerifier

  24. Confounding Masquerading as Improvement: A Systematic Evaluation of Offline Reinforcement Learning for Stroke Antithrombotic Treatment in a 129,000-Patient Registry

    Aug 31, 2026Kihun RheeStrokeOffline Reinforcement Learning

  25. Locally-Guided Actor-Critic: Training a Goal-conditioned Actor with a Subgoal-aware Critic

    Aug 31, 2026Olivier Serris, Stéphane Doncieux, Olivier SigaudGoal-Conditioned Reinforcement LearningGoal-Conditioned Policy

  26. Small Language Models as Judges for Rubric-Based Reinforcement Learning

    Aug 30, 2026Fengyu Xie, Yilun Zhao, Bingsen Chen +2Rubric-Based Reinforcement LearningLarge Language Model Judges

  27. VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation

    Aug 19, 2026Yinming Huang, Shuyuan Tu, Xi Yan +6Joint Audio-Video GenerationGenerative Quality

  28. Towards Socially Compliant Navigation in Deep Reinforcement Learning via Proxemics-Based Reward Modeling

    Aug 13, 2026Takieddine Soualhi, Jacques Saraydaryan, Laetitia MatignonSocial Robot NavigationNavigation

  29. Redistribution-based Cost Inference Improves Sparse Safe Offline RL

    Aug 12, 2026Ebenezer Gelo, Geraud Nangue Tasse, Steven James +1Offline Reinforcement LearningSparse Rewards

  30. A Framework for Designing Reward Functions: From Objectives to Features to Human-Aligned Reward Functions

    Aug 12, 2026Di Yang Shi, W. Bradley KnoxExternal Reward ModelsObjectives

  31. MuseCritic: Learning Multi-Aspect Song Rewards through Natural-Language Aesthetic Critiques

    Aug 12, 2026Jiabao Zhuang, Changhao Jiang, Hanchen Wang +11AestheticsCritique

  32. When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits

    Aug 12, 2026Sang Su Lee, Vineeth Loganathan, Shishir Dash +1Linear Contextual BanditsOff-Policy Evaluation

  33. Exploration-Driven Personalized Federated Reinforcement Learning via Intrinsic Motivation

    Aug 11, 2026Md Rafid Islam, Rafsan Jany, Zahid Hasan +1Federated Reinforcement LearningSparse Rewards

  34. Se-DPO: Self-Evolving Token Credit for Direct Preference Optimization

    Aug 10, 2026Wenxiao Zhao, Shu Wang, Ying Nian WuDirect Preference OptimizationCredit Assignment

  35. Finding the Signal in the Spam: Jointly Learning Rewards and Worker Reliability from Pairwise Comparisons

    Aug 10, 2026Kaustubh Shivshankar Shejole, Tanish Agarwal, Arpit Agarwal +1Process Reward ModelingShared Rewards

  36. Multi-Agent Reinforcement Learning via Agent-Specific Preference

    Aug 9, 2026Ni Mu, Yao Luan, Yiqin Yang +1Multi-Agent Reinforcement LearningProcess Reward Modeling

  37. TrustRoboReward: Preference-Ordered Isotonic Score Editing for Multi-Paradigm Robot Reward Models

    Aug 9, 2026Yidong Wang, Yan Zhan, Ziteng Feng +16Process Reward Modeling

  38. A Unified Framework for Dynamic Reward Shaping in Reinforcement Learning

    Aug 8, 2026Fouad BahrpeymaPotential-Based Reward ShapingReward Gradients

  39. SCOUT: Self-Checking and Recovery-Aware Tool-Thought Agents for Ultra-Long Egocentric Video Reasoning

    Aug 8, 2026Keyang Zhong, Kuo Wang, Peng Liu +5Agentic Video GenerationLong-Horizon Agents

  40. Multiscale Reward Hedging from Correct Demonstrations

    Aug 7, 2026Pahan DewasurendraO(T^Β)$ Simultaneous RegretExternal Reward Models

  41. PAST: Prompt-Adaptive Sampling Termination for Efficient Diffusion Model

    Aug 7, 2026Renye Yan, Jikang Cheng, You Wu +4Adaptive SamplingExternal Reward Models

  42. RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward Construction

    Aug 6, 2026Chenglong Wang, Ziming Zhu, Yifu Huo +9Process Reward Modeling

  43. SkillHEX: Improving Agent Skills via Hypothesis-Driven Autonomous Exploration and Exploitation

    Aug 6, 2026Yuru Feng, Yaoqi Chen, Beidi Zhao +7Skill EvolutionExploitation

  44. Reward Structure Shapes the Interaction Between Episodic Exploration and Neural Memory in Reinforcement Learning

    Aug 5, 2026Jai Malegaonkar, Rohan Patil, Henrik I. ChristensenSparse RewardsExternal Reward Models

  45. Calibrating Artificial Guilt: Neurally Grounded Reward Shaping for Prosocial Multi-Agent Reinforcement Learning

    Aug 5, 2026Aaditya Mehta, Arya ShahPotential-Based Reward ShapingMulti-Agent Reinforcement Learning

  46. GORDON: Graph-based Object-centric Rewards for Decomposition of Long-Horizon Manipulation

    Aug 4, 2026Andrea Protopapa, Davide Buoso, Francesca Pistilli +2Reasoning-Aware RewardLong-Horizon Planning

  47. Hi-Token: Hierarchical Coordinate Tokenization for Generative Visual Grounding

    Aug 4, 2026Xiuyuan Zhu, Ke Lu, Kun Dong +6Explicit Visual GroundingVisual Tokens

  48. Agentic Reinforcement Learning with Self-Distilled Reward Shaping

    Aug 4, 2026Ranxu Zhang, Guinan Chen, Chenshaodong +5Agentic Reinforcement-Learning FrameworkPotential-Based Reward Shaping

  49. SMOPD: Multi-Reward Reinforcement Learning via Specialize-and-Merge Online Policy Distillation

    Aug 4, 2026Wen Wang, Jiahua Bao, Tu Yongsiqi +8Sparse RewardsGroup Relative Policy Optimization

  50. SP3O: Reinforcement Learning from Segment Preferences without Reward Modeling

    Aug 3, 2026Evan Assmus, Qining Zhang, Lei YingProximal Policy OptimizationReward Modeling

  51. Rewriting or Reweighting? A Geometric Account in Language Models

    Aug 3, 2026Juntong Wang, Shengkun Yang, Xiyuan Wang +1Model ActivationsProcess Reward Modeling

  52. Rethinking Personalized Reward Modeling for LLMs under Preference Heterogeneity via Group-Debiased Federated Learning

    Aug 3, 2026Seongyoon Kim, Boryeong Cho, Jihwan Oh +2Federated LearningReward Modeling

  53. Beyond Routing Weights: Faithful Response-Level Interpretation of Mixture-of-Experts Reward Models via Contribution Contrast

    Jul 31, 2026Yifan Wang, Jinyi Mu, Mayank Jobanputra +4Mixture-of-Experts ModelsProcess Reward Modeling

  54. Optimising for Flourishing: Flourishing Metrics and Return on Flourishing as Success Criteria for Artificial Intelligence and Post-AGI Economic Systems

    Jul 31, 2026Keyun Ruan, Jonathan D. Teubner, John M. BremenArtificial Intelligence SystemsEconomies

  55. LEMUR: Learning to Align with Multi-Objective Reinforcement Learning from Preference Feedback

    Jul 31, 2026Manith Adikari, Bei Peng, Samuele Vinanzi +1Constrained Reinforcement LearningProcess Reward Modeling

  56. Explore Beyond the Boundary Using Entropic Information

    Jul 31, 2026Bumgeun Park, Donghwan LeeSparse RewardsAutonomous Exploration Strategies

  57. Learning Latent Reasoning Traces for Scalar Reward Models End-to-End

    Jul 31, 2026Sanwoo Lee, Clive Bai, Hsiu-Yuan Huang +3Process Reward ModelingEfficient Latent Reasoning

  58. Beyond Binary Rewards: A Comparative Study of Reward Design for Reinforcement Unlearning

    Jul 30, 2026Efstratios Zaradoukas, Davide Gabrielli, Bardh Prenkaj +1Reasoning-Aware RewardCatastrophic Forgetting

  59. MARS-RA: Rank Aggregation for Credit Assignment via Multimodal Comparisons in Embodied Multi-Agent Cooperation

    Jul 30, 2026Dawei Wang, Di Zhao, Xinyuan Liu +5Multi-Agent Reinforcement LearningCredit Assignment

  60. SERPO: Self-Evolving Rubric Policy Optimization for Open-Ended Test-Time Reinforcement Learning

    Jul 29, 2026Jianze Wang, Kunwang Zheng, Ying Liu +5Open-Ended ResponsesExternal Reward Models